Center for Community Inclusion and Disability Studies
Prevention Center of Excellence

Annotated Bibliography: Substance Abuse Prevention & Evaluation

Complied by Clare Desrosiers May 3, 2006
Updated by Michelle Brown, BJ Kitchin and Rachel Hutchins March, 2008.

Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors: The Communities That Care Youth Survey. Evaluation Review, 26(6), 575-601.

This article describes the development of the Communities That Care Survey, which can be used to assess the existence of risk and protective factors for substance use in adolescent populations. Such an assessment can inform prevention planning.

Barrett, L., Plotnikoff, R. C., Raine, K., & Anderson, D. (2005). Development of measures of organizational leadership for health promotion. Health Education and Behavior, 32(2), 195-207.

The authors describe the process through which the content and construct validity of an organizational leadership survey were examined. Findings suggest that the survey has sufficient content and construct validity to be used to examine organizational leadership.

DePoy, E., & Gilson, S. F. (In press). Beyond evidence-based practice: An integrative framework for teaching.

The authors examine current scholarship in regards to evidence-based practice, systematic inquiry, and research. They assert the need for social work practice models “in which scientifically derived evidence supports decisions and outcomes” (p. 6). The authors further describe an evaluation inquiry model they believe to be a more effective approach than others developed from the medical and public health fields.

Gorman, D. M., & Labouvie, E. W. (2000). Using social indicators to inform community drug and alcohol prevention policy. Journal of Public Health Policy, 21(4), 428-446.

The authors describe their study, which examined whether the analysis of social indicators as a needs assessment is an effective way to determine need for prevention programming. Their conclusion is that “needs assessments using social indicator data are feasible and capable of providing data…that allow one to address issues of resource allocation.” The authors recommend the inclusion of social indicators such as crime and morbidity rates, alcohol and drug availability, and educational achievement. The authors recommend the use of municipal, as opposed to county, level data because this smaller unit of analysis provides a more accurate picture of need.

Hausman, A. J., Becker, J., & Brawer, R. (2005). Identifying value indicators and social capital in community health partnerships. Journal of Community Psychology, 33(6), 691-703.

In this article, the authors emphasize the importance of involving communities in the identification of indicators of success for an outcome evaluation. They also note that it is very important for program sustainability and success for organizations’ to conduct outcome evaluations.

Hansen, H. (2005). Choosing evaluation models: a discussion on evaluation design. Evaluation. 11, 447-462.

The focus of this article is a discussion of varying models used for either program or organizational evaluation. The authors distinguish between program and organization evaluation and then outline various models, the theory behind each model and provide a brief explanation of model benefits and as well as criticisms.

Kaplan, S., & Garrett, K. (2005). The use of logic models by community-based initiatives. Evaluation and Program Planning, 28, 167-172.

The use of logic models in program development and evaluation is discussed in this article. The authors describe a logic model as a “map of the relationship between a program’s resources, activities, and intended results, which also identifies the program’s underlying theory and assumptions. (p167)” Application of a logic model in three community-based initiatives is reviewed as well as the authors’ findings regarding logic model development and benefits of logic model use.

MacDonald, G., Garcia, D., Zaza, S., Schooley, M., Compton, D., Bryant, T., Bagnol, L., Edgerly, C., & Haverkate, R. (2006). Steps to a HealthierUS Cooperative Agreement Program: Foundational elements for program evaluation planning, implementation, and use of findings. Prev Chronic Dis [serial online] 2006 Jan [cited August 8, 2007]. Available from URL: www.cdc.gov/pcd/issues/2006/jan/05_0136.htm.

The authors of this article explain the use of ten foundational elements to inform the program evaluation process. The authors stress the importance of meeting national program recommendations while remaining true to the diverse needs of specific communities. The ten foundational elements are summarized in a table, noting specific considerations for each as well as additional resources to explore for each element. The Centers for Disease Control and Prevention’s public health practice evaluation framework is cited and recommended for use in evaluation efforts.

Miller, R. L., Bedney, B. J., Guenther-Grey, C., & The CITY Project Study Team. (2003). Assessing organizational capacity to deliver HIV prevention services collaboratively: Tales from the field. Health Education and Behavior, 30(5), 582-600.

The authors discuss a needs assessment tool they developed. From the findings of their research into the usefulness of the tool, they report that the tool helped to obtain information about organizational needs, abilities, capacities, and in the planning process.

Nation, M., Crusto, C., Wandersman, A., Kumpfer, K. L., Seybolt, D., Morrissey-Kane, E., & Davino, K. (2003). What works in prevention: Principles for effective prevention programs. American Psychologist, 58(6/7), 449-456.

The authors present findings from their review of literature reviews into the factors that facilitate effective prevention programs. One factor is prevention program outcome evaluation. The authors recommend evaluation strategies that emphasize continuous quality improvement.

Reedy, A., Luna, R., Olivas, G., Sujeer, A. (2005). Local public health performance measurement: implementation strategies and lessons learned from aligning program evaluation indicators with the 10 essential public health services. Journal of Public Health Management Practice, 11, 317-325.

In this article, the authors explain the development and implementation of an evaluation framework made to both work in concert with the 10 essential public health services outlined by the Center for Disease Control and Prevention and remain true to the mission of a local public health department. The authors discuss the steps taken throughout the three phases of the evaluation framework development and provide a description of the completed evaluation model. Challenges faced, throughout the process, as well as lessons learned are also included in the discussion.

Shaffer, H. J., Hall, M. N., & Bult, J. V. (1997, December 22). Program evaluation: A practical guide to discovering what works. Retrieved August 15, 2007 from Harvard Medical School Division of Addictions site http://www.divisiononaddictions.org/html/program_
evaluation.htm.

The authors of this article discuss the need for evaluation of programs and processes as to not continue with efforts that are either harmful or not useful and to continue with efforts that have outcomes in line with the intended purpose of the program or process. The authors also discuss research methods and the value of using these methods to assist in sound evaluation planning. Lastly, the practical use of evaluation research results are discussed.

Singer, H. H., & Kegler, M. C. (2004). Assessing interorganizational networks as a dimension of community capacity: Illustrations from a community intervention to prevent lead poisoning. Health Education and Behavior, 31(6), 808-821.

This article describes a study of the reliability of a research instrument that examines organizational capacity. Study results suggested organizational network data (which is what was obtained in the instrument) “can be a reliable means of assessing one dimension of a community’s capacity to address public health issues.”