Mixed-method study of a conceptual model of evidence-based intervention sustainment across multiple public-sector service settings

详细信息    查看全文

• 作者：Gregory A Aarons (1)
  Amy E Green (1)
  Cathleen E Willging (2)
  Mark G Ehrhart (3)
  Scott C Roesch (3)
  Debra B Hecht (4)
  Mark J Chaffin (5)
  
  1. Department of Psychiatry ; University of California ; La Jolla ; San Diego ; CA ; USA
  2. Pacific Institute for Research and Evaluation ; Albuquerque ; NM ; USA
  3. Department of Psychology ; San Diego State University ; San Diego ; CA ; USA
  4. Department of Pediatrics ; University of Oklahoma Health Sciences Center ; Oklahoma City ; OK ; USA
  5. School of Public Health ; Georgia State University ; Atlanta ; GA ; USA
  
• 关键词：Sustainment ; Evidence ; based intervention ; Implementation ; Leadership ; Organizational culture ; Organizational climate ; Policy ; Public sector
• 刊名：Implementation Science
• 出版年：2014
• 出版时间：December 2014
• 年：2014
• 卷：9
• 期：1
• 全文大小：581 KB
• 参考文献：1. Edmondson, AC (2003) Framing for learning: lessons in successful technology implementation. Calif Manage Rev 45: pp. 35-54 CrossRef
  2. Edmondson, AC (2003) Speaking up in the operating room: how team leaders promote learning in interdisciplinary action teams. J Manage Stud 40: pp. 1419-1452 CrossRef
  3. Massatti, RR, Sweeney, HA, Panzano, PC, Roth, D (2008) The de-adoption of innovative mental health practices (IMHP): why organizations choose not to sustain an IMHP. Adm Policy Ment Hlth 35: pp. 50-65 CrossRef
  4. Romance NR, Vitale MR, Dolan M, Kalvaitis L: An empirical investigation of leadership and organizational issues associated with sustaining a successful school renewal initiative. / Paper presented at the Annual Meeting of the American Educational Research Association April, 2002; New Orleans, LA.
  5. Aarons, GA, Hurlburt, M, Horwitz, SM (2011) Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Hlth 38: pp. 4-23 CrossRef
  6. Chambers, DA, Azrin, ST (2013) Research and services partnerships: partnership: a fundamental component of dissemination and implementation research. Psychiatr Serv 64: pp. 509-511 CrossRef
  7. Chamberlain, P, Brown, CH, Saldana, L (2011) Observational measure of implementation progress in community based settings: the stages of implementation completion (SIC). Implement Sci 6: pp. 116-123 CrossRef
  8. Fixsen, DL, Naoom, SF, Blase, KA, Friedman, RM, Wallace, F (2005) Implementation Research: A Synthesis of the Literature. University of South Florida, Louis de la Parte Florida Mental Health Institute, the National Implementation Research Network (FMHI Publication #231, Tampa
  9. Tabak, RG, Khoong, EC, Chambers, DB, Brownson, RC (2013) Models in dissemination and implementation research: useful tools in public health services and systems research. Frontiers in Public Health Services and Systems Research 2: pp. 8
  10. Chambers, DA, Glasgow, RE, Stange, KC (2013) The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci 8: pp. 117 CrossRef
  11. Greenhalgh, T, Robert, G, Macfarlane, F, Bate, P, Kyriakidou, O (2004) Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 82: pp. 581-629 j.0887-378X.2004.00325.x" target="_blank" title="It opens in new window">CrossRef
  12. Stirman, SW, Kimberly, J, Cook, N, Calloway, A, Castro, F (2012) The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci 7: pp. 12 CrossRef
  13. Klein, KJ, Conn, AB, Sorra, JS (2001) Implementing computerized technology: an organizational analysis. J Appl Psychol 86: pp. 811-824 CrossRef
  14. Pluye, P, Potvin, L, Denis, JL (2004) Making public health program last: conceptualizing sustainability. Eval Program Plann 24: pp. 121-133 j.evalprogplan.2004.01.001" target="_blank" title="It opens in new window">CrossRef
  15. Proctor, E, Silmere, H, Raghavan, R, Hovmand, P, Aarons, GA, Bunger, A, Griffey, R, Hensley, M (2011) Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Hlth 38: pp. 65-76 CrossRef
  16. Mendel, P, Meredith, L, Schoenbaum, M, Sherbourne, C, Wells, K (2008) Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Hlth 35: pp. 21-37 CrossRef
  17. Bruns, EJ, Hoagwood, KE, Rivard, JC, Wotring, J, Marsenich, L, Carter, B (2008) State implementation of evidence-based practice for youths, part II: recommendations for research and policy. J Am Acad Child Adolesc Psychiatry 47: pp. 499-504 CrossRef
  18. Feldman, S (2009) The 鈥榤illionaires tax鈥?and mental health policy in California. Health Aff 28: pp. 809-815 CrossRef
  19. Raghavan, R, Bright, CL, Shadoin, AL (2008) Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implement Sci 3: pp. 3-26 CrossRef
  20. Aarons, GA, Ehrhart, MG, Farahnak, LR, Sklar, M (2014) Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annu Rev Public Health 35: pp. 255-274 CrossRef
  21. Aarons, GA (2005) Measuring provider attitudes toward evidence-based practice: consideration of organizational context and individual differences. Child Adolesc Psychiatr Clin N Am 14: pp. 255-271 j.chc.2004.04.008" target="_blank" title="It opens in new window">CrossRef
  22. Aarons, GA, Sommerfeld, DH, Walrath-Greene, CM (2009) Evidence-based practice implementation: the impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implement Sci 4: pp. 83-96 CrossRef
  23. Caldwell, DF, O鈥橰eilly, CA (2003) The determinants of team-based innovation in organizations: the role of social influence. Small Group Res 34: pp. 497-517 CrossRef
  24. Willging, CE, Lamphere, L, Waitzkin, H (2009) Transforming administrative and clinical practice in a public behavioral health system: an ethnographic assessment of the context of change. Journal of Health Care for the Poor and the Underserved 20: pp. 873-890
  25. Henggeler, SW, Chapman, JE, Rowland, MD, Halliday-Boykins, CA, Randall, J, Shackelford, J, Schoenwald, SK (2008) Statewide adoption and initial implementation of contingency management for substance abusing adolescents. J Consult Clin Psychol 76: pp. 556-567 CrossRef
  26. Beidas RS, Marcus S, Aarons GA, Hoagwood KE, Schoenwald S, Evans AC, Hurford MO, Hadley T, Barg F, Walsh LM, Adams D, Mandell D: Individual and organizational predictors of community therapists鈥?use of evidence-based practices in a large public mental health system. / JAMA Psychiatry, in press.
  27. Glisson, C (2002) The organizational context of children鈥檚 mental health services. Clin Child Fam Psych 5: pp. 233-253 CrossRef
  28. Aarons, GA, Sawitzky, AC (2006) Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychol Serv 3: pp. 61-72 CrossRef
  29. Aarons, GA (2004) Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res 6: pp. 61-74 CrossRef
  30. Ehrhart, MG (2004) Leadership and procedural justice climate as antecedents of unit-level organizational citizenship behavior. Pers Psychol 57: pp. 61-94 j.1744-6570.2004.tb02484.x" target="_blank" title="It opens in new window">CrossRef
  31. Schneider, B, Ehrhart, MG, Mayer, DM, Saltz, JL, Niles-Jolly, K (2005) Understanding organization-customer links in service settings. Acad Manage J 48: pp. 1017-1032 CrossRef
  32. Ehrhart, MG, Aarons, GA, Farahnak, LR (2014) Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci 9: pp. 157 CrossRef
  33. Aarons, GA (2006) Transformational and transactional leadership: association with attitudes toward evidence-based practice. Psychiatr Serv 57: pp. 1162-1169 CrossRef
  34. Frambach, RT, Schillewaert, N (2002) Organizational innovation adoption: a multi-level framework of determinants and opportunities for future research. Journal of Business Research Special Issue: Marketing Theory in the Next Millennium 55: pp. 163-176
  35. Jacobs, SR, Weiner, BJ, Bunger, AC (2014) Context matters: measuring implementation climate among individuals and groups. Implement Sci 9: pp. 46 CrossRef
  36. Butterfoss, FDB (2007) Coalitions and Partnerships in Community Health. Jossey-Bass, Hoboken, NJ
  37. Wallerstein, N, Duran, B The conceptual, historical, and practice roots of community based participatory research and related participatory traditions. In: Minkler, M, Wallerstein, N eds. (2003) Community-based Participatory Research for Health. Jossey-Bass, San Francisco
  38. Wallerstein, N, Duran, B (2010) Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health 100: pp. S40-S46 CrossRef
  39. Wells, K, Jones, L (2009) Research in community-partnered, participatory research. JAMA 302: pp. 320-321 jama.2009.1033" target="_blank" title="It opens in new window">CrossRef
  40. Widdus, R (2001) Public-private partnerships for health: their main targets, their diversity, and their future directions. Bull World Health Organ 79: pp. 713-720
  41. Garland, AF, Hurlburt, MS, Hawley, KM (2006) Examining psychotherapy processes in a services research context. Clin Psychol-Sci Pr 13: pp. 30-46 j.1468-2850.2006.00004.x" target="_blank" title="It opens in new window">CrossRef
  42. Wells, K, Miranda, J, Bruce, ML, Alegria, M, Wallerstein, N (2004) Bridging community intervention and mental health services research. Am J Psychiatry 161: pp. 955-963 jp.161.6.955" target="_blank" title="It opens in new window">CrossRef
  Improving the Quality of Health Care for Mental and Substance-use Conditions. National Academies Press, Washington DC
  43. Chaffin, M, Hecht, D, Bard, D, Silovsky, JF, Beasley, WH (2012) A statewide trial of the SafeCare home-based services model with parents in Child Protective Services. Pediatrics 129: pp. 509-515 CrossRef
  44. Swenson, CC, Brown, EJ, Lutzker, JR Issues of maltreatment and abuse. In: Freeman, A eds. (2007) Personality Disorders in Childhood and Adolescence. John Wiley & Sons Inc, Hoboken, NJ, pp. 229-295
  45. Bousha, DM, Twentyman, T (1984) Mother-child interactional style in abuse, neglect, and control groups: naturalistic observations in the home. J Abnorm Psychol 93: pp. 106-114 CrossRef
  46. Crittenden, PM (1992) Children鈥檚 strategies for coping with adverse home environments: an interpretation using attachment theory. Child Abuse Negl 16: pp. 329-343 CrossRef
  47. Egeland, B, Sroufe, A, Erickson, M (1983) The developmental consequence of different patterns of maltreatment. Child Abuse Negl 7: pp. 459-469 CrossRef
  48. Kent, J (1976) A follow-up study of abused children. J Pediatr Psychol 1: pp. 25-31 jpepsy/1.2.25" target="_blank" title="It opens in new window">CrossRef
  49. Culp, RE, Watkins, RV, Lawrence, H, Letts, D, Kelly, DJ, Rice, ML (1991) Maltreated children鈥檚 language and speech development: abused, neglected, and abused and neglected. First Language 11: pp. 377-389 CrossRef
  50. Fox, L, Long, SH, Langlois, A (1988) Patterns of language comprehension deficit in abused and neglected children. Journal of Speech & Hearing Disorders 53: pp. 239-244 jshd.5303.239" target="_blank" title="It opens in new window">CrossRef
  51. Gaudin, JM Short-term and long-term outcomes. In: Dubowitz, H eds. (1999) Neglected Children: Research, Practice and Policy. Sage, London, pp. 89-108 CrossRef
  52. Widom, CS, White, HR (1998) Problem behaviors in abused and neglected children grown-up: prevalence and co-occurrence of substance abuse, crime and violence. Criminal Behavior & Mental Health 7: pp. 287-310 CrossRef
  Child Maltreatment. Children鈥檚 Bureau, Washington, DC
  53. Lutzker, JR, Bigelow, KM, Doctor, RM, Kessler, ML (1998) Safety, health care, and bonding within an ecobehavioral approach to treating and preventing child abuse and neglect. J Fam Violence 13: pp. 163-185 CrossRef
  54. Whitaker, DJ, Lutzker, JR, Self-Brown, S, Edwards, AE (2008) Implementing an evidence-based program for the prevention of child maltreatment: the SafeCare庐 program. Report on Emotional & Behavioral Disorders in Youth 8: pp. 55-62
  55. Wright, C, Catty, J, Watt, H, Burns, T (2004) A systematic review of home treatment services. Soc Psychiatry Psychiatr Epidemiol 39: pp. 789-796
  56. Fagen, MC, Flay, BR (2009) Sustaining a school-based prevention program: results from the Aban Aya sustainability project. Health Educ Behav 36: pp. 9-23 CrossRef
  57. Ozer, E, Cantor, J, Cruz, G, Fox, B, Hubbard, E, Moret, L (2008) The diffusion of youth-led participatory research in urban schools: the role of the prevention support system in implementation and sustainability. Am J Community Psychol 41: pp. 278-289 CrossRef
  58. Elias, MJ, Zins, JE, Graczyk, PA, Weissberg, RP (2003) Implementation, sustainability and scaling up of social-emotional and academic innovations in public schools. School Psych Rev 32: pp. 303-319
  59. Foster, EM, Kelsch, CC, Kamradt, B, Sosna, T, Yang, Z (2001) Expenditures and sustainability in systems of care. J Emot Behav Disord 9: pp. 53-62 CrossRef
  60. Jacobs, JA, Dodson, EA, Baker, EA, Deshpande, AD, Brownson, RC (2010) Barriers to evidence-based decision making in public health: a national survey of chronic disease practitioners. Public Health Rep 125: pp. 736-742
  61. Grimes, J, Kurns, S, Tilly, WDI (2006) Sustainability: an enduring commitment to success. School Psych Rev 35: pp. 224-244
  62. Larsen, T, Samdal, O (2007) Implementing second step: balancing fidelity and program adaptation. J Educ Psychol Consult 17: pp. 1-29 CrossRef
  63. Jansen, M, Harting, J, Ebben, N, Kroon, B, Stappers, J, Engelshoven, E, Vries, N (2008) The concept of sustainability and the use of outcome indicators. A case study to continue a successful health counselling intervention. Fam Pract 25: pp. 32-37 CrossRef
  64. Baumann, A, Hunsberger, M, Blythe, J, Crea, M (2008) Sustainability of the workforce: government policies and the rural fit. Health Policy 85: pp. 372-379 j.healthpol.2007.09.004" target="_blank" title="It opens in new window">CrossRef
  65. Myers, KM, Valentine, JM, Melzer, SM (2007) Feasibility, acceptability, and sustainability of telepsychiatry for children and adults. Psychiatr Serv 58: pp. 1493-1496 CrossRef
  66. Aarons, GA, Sommerfeld, DH (2012) Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Psy 51: pp. 423-431 j.jaac.2012.01.018" target="_blank" title="It opens in new window">CrossRef
  67. Aarons, GA, Sommerfeld, DH, Hecht, DB, Silovsky, JF, Chaffin, MJ (2009) The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: evidence for a protective effect. J Consult Clin Psychol 77: pp. 270-280 CrossRef
  68. Aarons, GA, Fettes, DL, Sommerfeld, DH, Palinkas, LA (2012) Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat 17: pp. 67-79 CrossRef
  69. Hurlburt, M, Aarons, GA, Fettes, DL, Willging, C, Gunderson, L, Chaffin, MJ (2014) Interagency collaborative team model for capacity building to scale-up evidence-based practice. Child Youth Serv Rev 39: pp. 160-168 j.childyouth.2013.10.005" target="_blank" title="It opens in new window">CrossRef
  70. Aarons GA, Fettes DL, Hurlburt MS, Palinkas LA, Gunderson L, Willging CE, Chaffin MJ: Collaboration, negotiation, and coalescence for interagency-collaborative teams to scale-up evidence-based practice. / J Clin Child Adolesc 2014, pp.1鈥?4. Advance online publication.
  71. Aarons, GA, Green, AE, Palinkas, LA, Self-Brown, S, Whitaker, DJ, Lutzker, JR, Silovsky, JF, Hecht, DB, Chaffin, MJ (2012) Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implement Sci 7: pp. 1-9 CrossRef
  72. Waitzkin, H, Williams, R, Bock, J, McCloskey, J, Willging, C, Wagner, W (2002) Safety-net institutions buffer the impacts of medicaid managed care: a multi-method assessment in a rural state. Am J Public Health 92: pp. 598-610 CrossRef
  73. Willging, C, Waitzkin, H, Wagner, W (2005) Medicaid managed care for mental health services in a rural state. J Health Care Poor Underserved 16: pp. 497-514 CrossRef
  74. Stufflebeam, DL, Shinkfield, AJ (2007) Evaluation Theory, Models, and Application. Jossey-Bass, San Francisco, CA
  75. Patton, MQ (2002) Qualitative analysis and interpretation. Qualitative Research and Evaluation Methods. Sage Publications, Thousand Oaks, CA, pp. 431-539
  76. Miles, MB, Huberman, AM (1994) Qualitative Data Analysis: An Expanded Sourcebook. Sage Publications, Inc., Thousand Oaks, CA
  77. Fraser, D (2000) QSR NVivo Reference Guide. QSR International, Melbourne
  78. Steckler, A, Goodman, RM, McLeroy, KR, Davis, S, Koch, G (1992) Measuring the diffusion of innovative health promotion programs. Am J Health Promot 6: pp. 214-225 CrossRef
  79. Kano, M, Willging, C, Rylko-Bauer, B (2009) Community participation in New Mexico鈥檚 behavioral health care reform. Med Anthropol Q 23: pp. 277-297 j.1548-1387.2009.01060.x" target="_blank" title="It opens in new window">CrossRef
  80. Emerson, RM, Fretz, RI, Shaw, LL (1996) Writing Ethnographic Fieldnotes. University of Chicago, Chicago
  81. Schoenwald, SK, Sheidow, AJ, Letourneau, EJ (2004) Toward effective quality assurance in evidence-based practice: links between expert consultation, therapist fidelity, and child outcomes. J Clin Child Adolesc 33: pp. 94-104 CrossRef
  82. Glisson, C, Landsverk, J, Schoenwald, S, Kelleher, K, Hoagwood, K, Mayberg, S, Green, P (2008) Assessing the Organizational Social Context (OSC) of mental health services: implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research Special Issue: Improving Mental Health Services 35: pp. 98-113 CrossRef
  83. Bass, BM, Avolio, BJ (1995) MLQ: Multifactor Leadership Questionnaire (Technical Report). Center for Leadership Studies, Binghamton University, NY
  84. Aarons, GA, Ehrhart, MG, Farahnak, LR (2014) The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci 9: pp. 45 CrossRef
  85. Kraut, RE, Rice, RE, Cool, C, Fish, RS (1998) Varieties of social influence: the role of utility and norms in the success of a new communication medium. Organ Sci 9: pp. 437-453 CrossRef
  86. Hellofs, LL, Jacobson, R (1999) Market share and customers鈥?perceptions of quality: when can firms grow their way to higher versus lower quality?. J Mark 63: pp. 16-25 CrossRef
  87. Aarons, GA, McDonald, EJ, Sheehan, AK, Walrath-Greene, CM (2007) Confirmatory factor analysis of the evidence-based practice attitude scale (EBPAS) in a geographically diverse sample of community mental health providers. Adm Policy Ment Hlth 34: pp. 465-469 CrossRef
  88. Aarons, GA, Cafri, G, Lugo, L, Sawitzky, A (2010) Expanding the domains of attitudes towards evidence-based practice: the Evidence-based Practice Attitude Scale-50. Adm Policy Ment Hlth 39: pp. 331-340 CrossRef
  89. Mancini, JA, Marek, LI (2004) Sustaining community-based programs for families: conceptualization and measurement. Fam Relat 53: pp. 339-347 j.0197-6664.2004.00040.x" target="_blank" title="It opens in new window">CrossRef
  90. Goodman, RM, McLeroy, KR, Steckler, AB, Hoyle, RH (1993) Development of level of institutionalization. Health Educ Q 20: pp. 161-178 CrossRef
  91. Brown, CH, Wang, W, Kellam, SG, Muthen, BO, Petras, H, Toyinbo, P, Poduska, J, Ialongo, N, Wyman, PA, Chamberlain, P, Sloboda, Z, MacKinnon, DP, Windham, A (2008) Methods for testing theory and evaluating impact in randomized field trials: intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug Alcohol Depend 95: pp. 74-104 j.drugalcdep.2007.11.013" target="_blank" title="It opens in new window">CrossRef
  92. Hedeker, D, Gibbons, RD (2006) Longitudinal Data Analysis. Wiley-Interscience, Hoboken, NJ
  93. McCulloch, CE, Searle, SR (2001) Generalized, Linear, and Mixed Models. Wiley, New York
  94. Raudenbush, SW, Bryk, AS (2002) Hierarchical Linear Models: Applications and Data Analysis Methods. Sage Publications, Thousand Oaks, CA
  95. Singer, JD, Willet, JB (2003) Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence. Oxford University Press, New York CrossRef
  96. Hedeker, D An introduction to growth modeling. In: Kaplan, D eds. (2004) The Sage Handbook of Quantitative Methodology for the Social Sciences. Sage Publications, Thousand Oaks, CA
  97. Creswell, JW, Plano Clark, VL (2007) Designing and Conducting Mixed Methods Research. Sage Publications, Thousand Oaks, CA
  98. Tashakkori, A, Teddlie, C (2003) Issues and dilemmas in teaching research methods courses in social and behavioural sciences: US perspective. Int J Social Res Methodol 6: pp. 61-77 CrossRef
  99. Palinkas, LA, Aarons, GA, Horwitz, S, Chamberlain, P, Hurlburt, M, Landsverk, J (2011) Mixed method designs in implementation research. Adm Policy Ment Hlth 38: pp. 44-53 CrossRef
  100. Teddlie, C, Tashakkori, A (2003) Major issues and controversies in the use of mixed methods in the social and behavioral sciences. Handbook of Mixed Methods in Social and Behavioral Research. Sage Publications, Thousand Oaks, CA, pp. 3-50
  101. Phillips, JJ (2003) Return on Investment in Training and Performance Improvement Programs. Routledge, New York, NY
  102. McHugo, GJ, Drake, RE, Whitley, R, Bond, GR, Campbell, K, Rapp, CA, Goldman, HH, Lutz, WJ, Finnerty, MT (2007) Fidelity outcomes in the national implementing evidence-based practices project. Psychiatr Serv 58: pp. 1279-1284 CrossRef
  103. Kendall, PC, Beidas, RS (2007) Smoothing the trail for dissemination of evidence-based practices for youth: flexibility within fidelity. Prof Psychol: Res Pract 38: pp. 13-20 CrossRef
  
• 刊物主题：Health Promotion and Disease Prevention; Health Administration; Health Informatics;
• 出版者：BioMed Central
• ISSN：1748-5908

文摘

Background This study examines sustainment of an EBI implemented in 11 United States service systems across two states, and delivered in 87 counties. The aims are to 1) determine the impact of state and county policies and contracting on EBI provision and sustainment; 2) investigate the role of public, private, and academic relationships and collaboration in long-term EBI sustainment; 3) assess organizational and provider factors that affect EBI reach/penetration, fidelity, and organizational sustainment climate; and 4) integrate findings through a collaborative process involving the investigative team, consultants, and system and community-based organization (CBO) stakeholders in order to further develop and refine a conceptual model of sustainment to guide future research and provide a resource for service systems to prepare for sustainment as the ultimate goal of the implementation process. Methods A mixed-method prospective and retrospective design will be used. Semi-structured individual and group interviews will be used to collect information regarding influences on EBI sustainment including policies, attitudes, and practices; organizational factors and external policies affecting model implementation; involvement of or collaboration with other stakeholders; and outer- and inner-contextual supports that facilitate ongoing EBI sustainment. Document review (e.g., legislation, executive orders, regulations, monitoring data, annual reports, agendas and meeting minutes) will be used to examine the roles of state, county, and local policies in EBI sustainment. Quantitative measures will be collected via administrative data and web surveys to assess EBI reach/penetration, staff turnover, EBI model fidelity, organizational culture and climate, work attitudes, implementation leadership, sustainment climate, attitudes toward EBIs, program sustainment, and level of institutionalization. Hierarchical linear modeling will be used for quantitative analyses. Qualitative analyses will be tailored to each of the qualitative methods (e.g., document review, interviews). Qualitative and quantitative approaches will be integrated through an inclusive process that values stakeholder perspectives. Discussion The study of sustainment is critical to capitalizing on and benefiting from the time and fiscal investments in EBI implementation. Sustainment is also critical to realizing broad public health impact of EBI implementation. The present study takes a comprehensive mixed-method approach to understanding sustainment and refining a conceptual model of sustainment.