|
With all that has been written about research designs and statistical analyses, you might be surprised to learn that the most common problem we see is a failure to make sure that the research design components are aligned with the goals of the research.
There is no substitute for careful planning of an effectiveness study. The first component of proper research design planning is to have a clear sense of your goals and a clear sense of what you are trying to measure. Ask yourself, what is my product designed to achieve? If your product is designed to improve student learning, then that is what you should measure--student learning; you would certainly not want to measure student attitudes toward school or how teachers feel about the product. Be clear on the desired outcomes, document it clearly and succinctly, and make sure you are measuring the desired outcomes.
Second, you should be clear on your purpose for the research. Why are you conducting the study? Your choices of design, measurement, analysis, etc. will be very different if your purpose is to collect formative information for ongoing improvement of the product than if your purpose is to prove that your product is effective by looking at summative outcomes. For example, you would not want to solely conduct a post test at the conclusion of the study, if you are looking for formative information; ongoing observation, surveys or interviews might be more aligned to your desire for ongoing improvement information. Again, state your purpose clearly and succinctly, and make sure your study is aligned with your goals.
There is far more to aligning the research design with your goals. To see how others have aligned their goals with the research questions and design, check out SEG's study summaries here on our website.
SEG Measurement can help you design your efficacy research study to maximize success under ESSA guidelines. Call us today to find out how we can help you with your assessment and research needs.
|
