Guideline 14: Make the Research Report Easily Accessible and Invite External Review

Empirical Education
2 min readFeb 17, 2020

--

women looking at laptops

If you’re a K-12 educator or edtech provider, how can you make sure an edtech product will work in a specific school or community? Here’s one of 16 key guidelines for conducting and reporting edtech impact research that might help.

Edtech Research Guideline 14: Make the research report easily accessible and invite external review

These guidelines take the position that traditional peer-reviewed journals are generally inappropriate for product effectiveness research, although they continue to be important for scientific research, including advances in methodologies conducted in higher education institutions and similar organizations. As the pace of research (not just research on edtech impact) accelerates, the need for more open resources and repositories increases. There are a growing number of alternatives to traditional journals.

This guideline comes from the fourth section of the report, “Reporting the Results,” which focuses on good practices in reporting results from the research study. The need for evidence on quickly evolving products and the availability of non-traditional repositories is changing the landscape of reporting. We also address the question of risk to the edtech provider in supporting research that shows a negative (or not sufficiently robust) effect of the product.

A preview of other guidelines in this section include:

13. Produce reports with enough detail for decision makers to know if the results apply to their context

15. Make all findings from product evaluations available, as a general rule

16. In the marketing literature for a product, accurately describe its impact in non-technical language

For all audiences, the Guidelines not only provide approaches to practice, but also seek to advance the field by helping to identify an appropriate balance among the rigor, practicality, timeliness, and usefulness of evaluation studies of K-12 edtech products

This post is one in a series based on excerpts from the Edtech Guidelines published by Empirical Education and ETIN. For more information, you may access the full set of guidelines, here.

Photo by Kylie Haulk on Unsplash

--

--