2. Centre for the Study of Learning and Performance: Systematic Review Theme Robert M. Bernard (Theme Leader) Philip C. Abrami Richard F. Schmid Anne Wade

3. What is a Systematic Review? A review of a clearly formulated question that uses systematic and explicit methods to identify, select and critically appraise relevant research, and to collect and analyze data from the studies that are included in the review. Statistical methods (meta-analysis) may or may not be used to analyze and summarize the results of the included studies.

4. Research Reviews We Do Meta-Analysis — A quantitative synthesis of empirical, primarily experimental, studies. Argument Catalogue — A systematic review of literature representing many perspectives (e.g., general public, practitioners, policymakers, researchers).

5. What is Meta-Analysis? Meta-Analysis is a set of quantitative research synthesis techniques and procedures. Meta-Analysis uses effect size as a metric for judging the magnitude of standardized difference between a treatment and control condition in a large set of studies.

6. Estimating the Population from Multiple Samples Meta-Analysis: Overall Interpretation Population Samples: Individual Interpretations ES+ p p p p p p

7. What Purpose Does an Argument Catalogue Serve? Helps frame the questions in a meta- analysis. Examines a question from various perspectives. Helps locate gaps in understanding between different constituencies.

8. Argument Catalogue: The Overlaps of Multiple Perspectives Practitioners General Public Researchers: Primary Evidence Researchers: Reviews of Research Policymakers

9. Current Systematic Reviews A comparative study of distance education and classroom instruction (meta-analysis). A comparative study of different instructional treatments in distance education (meta-analysis). A state of the field review of e-learning in five populations (argument catalogue). A comparative study of instructional conditions that support the development of critical thinking skills and dispositions (meta-analysis). A comparative study of the effects of technology integration in education (meta-analysis).

10. Come visit us at: http://doe.Concordia.ca/cslp http://doe.Concordia.ca/cslp Come visit us at: http://doe.Concordia.ca/cslp http://doe.Concordia.ca/cslp See what other educational technology and IT research and development projects we are currently involved in.