CS4Ed - Product Evaluation Process

Evaluation Process

	I. Establish Evaluation Goals
	Short term product review: Design? Use? Effectiveness? Teacher/student reactions? Longer-term product impact measures: Student learning? Teacher performance?

	II. Collect Baseline Data
	Review current research on the product. Review literature to support product design.

Formative Classroom Studies

Summative Studies

III. Develop Evaluation Series & Timeline

Design Based Research: Streamlined investigations guiding product design.
Product Design and Usage
> How product works in classrooms
> How design elements enhance use
Classroom Effectiveness
> How teachers use product
> How product influences teaching

Scientifically Based Research: Experimental or quasi-experimental studies to establish product effectiveness.
Impact on Student Learning
> How product produces changes in student learning
Impact on Teacher Practice
> How product produces changes in teacher practice

IV. Collect & Analyze Data

> Clinical interviews
> Systematic classroom observations
> One-on-one student testing
> Small-group testing
> Focus group discussions

> Data from norm-referenced tests and other quantitative measures
> Rigorous statistical analysis
> Qualitative procedures as needed

V. Generate Reports

> Timely results
> Non-technical, understandable language
> Specific recommendations

> Technical research reports
> Hypotheses, methods, analyses, conclusions
> Ready for publication

	VI. Review Goals
	Review original goals, adjust as needed, new recommendations

Evaluation Process >