Skip over navigation
Learning Point Associates Logo
North Central Regional Educational Laboratory
NCREL HomeNCREL Sitemap
Photo of children and teachers using technology
Technology Home
Assessment and Evaluation
Research
E-Learning
Planning
Policy
Professional Development
Research
Teacher Preparation
Teaching and Learning
Technology in Education
SRI International

An Educator's Guide to
Evaluating Claims about Educational Software

Red Flags Introductions Checklist Resources Glossary Buyer's Worksheet
Checklist

Does this research finding apply to my classroom, school, or district?
How do I determine if the research is designed to support these claims?

 

[comparison group issues]
[pre-post design]
[sample size issues]

[interpreting results]
How is student achievement measured?
Summary

Pre-post design:

How to evaluate a pre-post design

When no comparison group is readily available, researchers sometimes attempt to make each individual student his or her own "comparison" point by giving students a pre-test before the implementation of the technology intervention and a post-test afterward. The assumption is that any change that takes place between the pre-test and post-test measure can be attributed to the use of the technology.

The pre-post design is probably the most popular type of design that you will encounter, but its usefulness for determining the effectiveness of an intervention is limited. Although the design is capable of measuring changes in student performance, you can not be certain that any gains in achievement were caused by the use of the technology. Gains in student performance might reflect the rate at which students were learning new content before the technology was introduced. In addition, other policies and programs in the school or district might have been responsible for the improvements in student performance.

Interrupted time series design is an improvement on the pre-post design.



Copyright © SRI International. All rights reserved.
Please send comments and suggestions.

This site was created by the Center for Technology in Learning at SRI International under a task order from the Planning and Evaluation Service, U.S. Department of Education (DHHS Contract # 282-00-008-Task 3).

Center for Technology in Learning

Last updated on: 11/04/02

 


Contact Us | Privacy Policy
Copyright © Learning Point Associates.
All rights reserved.
Disclaimer and copyright information.