In "A Primer on Effectiveness and Efficacy Trials" (Clinical and Translational Gastroenterology (2014) 5), Amit G Singal MD, MS, Peter D R Higgins MD, PhD and Akbar K Waljee MD, MS, explain:
Intervention studies can be placed on a continuum, with a progression from efficacy trials to effectiveness trials. Efficacy can be defined as the performance of an intervention under ideal and controlled circumstances, whereas effectiveness refers to its performance under ‘real-world’ conditions.1 However, the distinction between the two types of trial is a continuum rather than a dichotomy, as it is likely impossible to perform a pure efficacy study or pure effectiveness study. (source, see also here)
This method appears to be on the horizon of those who influence the cultures of the education industry (here, here, here, and here).
Goldie Blumenstyk has recently reported for the Chronicle of Higher Education about the release of papers from a first of its kind symposium on efficacy research hosted by the University of Virginia:
1. Colleges spend upward of $5 billion a year on educational-technology products, but often they lack data that could better inform the decisions they make on what to buy. Over the past year, several dozen academics, business executives, and policy wonks researched why “efficacy research” isn’t more of a factor in these decisions. Some of those findings were presented at a symposium in May, and now the full reports are available.
2. Efficacy research isn’t just missing in ed tech. It’s also all-too-absent when it comes to the burgeoning world of “alternative” educational credentials, at least according to a new report by Ithaka S+R, a nonprofit consulting organization, for the American Academy of Arts & Sciences. Among other recommendations to policy makers, funders, and the higher-education community, the report recommends broadening quality-assurance processes so they can include educational programs not offered through traditional colleges as well as an investment in “a more comprehensive data system that captures longitudinal, student-record data on students’ experiences across the full array of postsecondary pathways, as well as information about providers and their programs and credentials.” In a world where some advocates are still pushing for more complete data on students in traditional higher-education settings, that could be a big ask. Or perhaps it will become one more argument in their favor. —
The links to the reports produced from the symposium and the press release follow.