Skip Maine state header navigation

Agencies | Online Services | Help

The Maine Approach

ELEMENT 10 - Program Evaluation

ENSURE ONGOING EFFECTIVE PROGRAM EVALUATION IN ORDER TO DETERMINE THAT PROGRAMS ARE MEETING STATED OUTCOMES AND CHANGING NEEDS.

Evaluation is the collection, appraisal and subsequent use of information about programs.

Prevention programs are being implemented in many schools and communities, often with limited funds. Program assessment can improve program operation, resource management. and accountability.

Evaluation of a program must begin when it is designed. Prevention and education programs are evaluated by process, outcome and impact techniques.

PROCESS EVALUATION is an assessment describing and documenting what actually was done, how much, when, for, and by whom.

OUTCOME EVALUATION is an assessment of ways in which participants of a program can be expected to change at the conclusion of that program (i.e. Did the program meet stated goals and objectives?)

IMPACT EVALUATION is an assessment of what the long term or "ripple" effect of the programs might be.

Evaluation must be infused throughout the program design. It is ongoing and is the basis upon which modifications are made and growth can be measured. COMPREHENSIVE PROGRAMS WHICH PLACE A HIGH PRIORITY ON EVALUATION ARE MORE EFFECTIVE IN HELPING TO ACHIEVE THE DESIRED RESULT: SAFE, DISCIPLINED, AND DRUG-FREE SCHOOLS AND COMMUNITIES.


PRESENT INDICATORS FOR STANDARDS OF BEST PRACTICE:

(Rating your understanding from 1 to a high of 5 may help you in your planning and evaluation.)

_____ An evaluation process is in place prior to all program implementation
_____ Ongoing data collection and analysis are taking place.
_____ All prevention and education programs and activities include an evaluation component linked to outcomes and based upon identified needs.
_____ Evaluation criteria exist for each element of "THE MAINE APPROACH''.
_____ Short and long term process, outcome and impact measures are identified

Process evaluation examines

_____ Target population, numbers of people served, etc.
_____ Personnel operating the program
_____ Services delivered
_____ Use of resources(staff, physical plant, AV materials, finances, etc.)

Outcome evaluation includes assessment of:

_____ The degree of how well stated goals and objectives are being met
_____ Changes in knowledge, attitudes, and behaviors
_____ The utilization of anecdotal information, pre-/post-tests, surveys, observation

Impact evaluation examines:

_____ The overall effect on community
_____ The measure of related crime activity, social policy change, etc.. over time (incidence/prevalence surveys, epidemiological studies, etc.)
_____ Appropriate stakeholders (depending upon the program or service) are involved in the design and implementation of the evaluation instruments.

Evaluation is used to manage prevention activities:

_____ To focus projects or program goals
_____ To improve service delivery
_____ To provide accountability
_____ To provide information for dissemination
_____ To lead, guide, and facilitate future programming
_____ Baseline data are obtained, when appropriate, prior to the implementation and presentation of a prevention program in order to measure new learning(pre-/post- tests).
_____ Evaluation ties results to specific risk, protective, and resiliency factors for the individual, family, school, and community.
_____ Evaluation measures focus on changing information, attitudes and behavior regarding use and abuse of ATOD.
_____ Findings from evaluation efforts are reported to the appropriate parties, including sponsoring agencies, the public, program participants and other stakeholders.
_____ A school/community team retreat is held annually for evaluation and planning purposes.
_____ Evaluation provides valid, reliable Information and is replicable.

Revised March 1995.


Maine Office of Substance Abuse
#11 State House Station
A.M.H.I. Complex, Marquardt Building
Augusta, ME 04333-0011

Main Office: 207-287-2595
Information and Resource Center: 1-800-499-0027 (In-State Only)or 207-287-8900
TTY : 1-800-606-0215

Back to The Maine Approach

Back to Prevention

Back to the OSA Home Page
For questions or comments, please send mail to: Web Administrator