| Questions about Target Population |
Yes |
No |
Decision Criteria |
- Has a target population been specified?
- Is the program reaching its target population?
- Are participants similar to non- participants?
|
|
|
Problems in this area indicate that the
program is not yet ready for an
outcome evaluation. A process
evaluation, however, could be helpful.
Review Section 2 (Subsection "Specify
The Target Population") for help in
defining the target population, and
Section 3 (Subsection "Recruitment")
for help in reaching them and
monitoring success. |
| Questions about the Program Model |
|
|
|
- Have formal goals and objectives been specified?
- Is there consensus among stakeholders about the objectives of
the program?
- Are there clearly defined linkages between the program's
theoretical framework, activities and objectives?
|
|
|
This area may also mean that the
program is not yet ready for an
outcome evaluation. Refer to Section 2
(Subsection "List Services and
Activities"). |
| Questions about Process |
|
|
|
- Are program activities clearly specified?
- Is there a specific schedule of activities?
- Is there consistency among providers?
- Is the program in the field consistent with the program model?
- Are projected goals being met?
|
|
|
A process evaluation would be very
helpful with process questions, and
may indicate areas in which the
program could improve. It is important
to address these issues before
proceeding to an outcome evaluation.
See Section 3 (Subsection "Monitoring
Delivery Of Services"). |
| Questions about Organization of
Services |
|
|
|
- Is there adequate staff coverage?
- Does the program have sufficient resources?
- Are the qualifications for providers specified?
- Is the organizational hierarchy and administration of the
program clear?
- Does implementation of the program vary across sites?
|
|
|
A program will not work well without the
supporting infrastructure. Programs
with these types of issues may appear
ineffective in an outcome evaluation.
Better to address these concerns and
make any needed program or
documentation changes before
proceeding. |
| Questions about Outcomes |
|
|
|
- Is the program's treatment clearly identifiable and
consistent?
- Are the outcomes clear, specific and measurable?
- Are there outcome data available?
|
|
|
These issues also need to be
addressed before proceeding to an
outcome evaluation. Refer to Section
2 (Subsection "Identify Program Goals,
Objectives And Outcomes") for
information on how to define outcomes
that are measurable. |
| Questions about Stakeholders |
|
|
|
- Are the stakeholders known? What type of information do they
need?
- Who will use the results of the study and how will these
results be used?
|
|
|
Before gathering any information,
consider the needs of the end-user of
this information. Refer to Section 1
(Subsection "Step 1: Determine The
Audience For The Evaluation") for
information on how best to determine
the needs of stakeholders. |
