Xcalibur uses three distinct approaches within the structure of Formative and Summative evaluation
- Process Evaluation
- Outcome Evaluation
- Impact Evaluation and Research
GEAR UP evaluation research takes place within an educational context and thus requires sensitivity to students, families, educators, and the community. Therefore, Xcalibur adheres to the American Evaluation Association Program Evaluation Standards and the Code of Federal Regulations, Part 46 - Protection of Human Subjects.
In the past seven years, much has changed in the GEAR UP world in terms of how we think about, conduct, and share results of evaluation and research. Interventions have become more standardized and defined, challenges and barriers are more dogmatic, and the burden for proof of accomplishments more demanding. Those pressures and changes require GEAR UP grants to respond using more thorough methods for providing evidence of success.
Xcalibur’s Participatory Evaluation contrasted to Conventional Evaluation
|Xcalibur’s Participatory Approach||Conventional|
|Who drives the evaluation?||Partners (e.g., school districts and institutions of higher education), grant project staff, families, and other stakeholders||Funders and program managers|
|Who determines indicators of program progress||Stakeholders, project staff, Xcalibur evaluator(s), and industry experts||Professional evaluators and outside experts|
|Who is responsible for data collection, analysis and preparing final reports?||Shared responsibility of evaluator and participating stakeholders||Professional evaluators and outside experts|
|What is the role of the evaluator?||Coach, facilitator, negotiator, “critical friend”, expert, and leader||Expert, leader|
|When is this type of evaluation most useful?||
|What are the costs?||
|What are the benefits?||