Copyright © Allyn & Bacon 2008 This multimedia product and its contents are protected under copyright law. The following are prohibited by law: any public performance or display, including transmission of any image over a network; preparation of any derivative work, including the extraction, in whole or part, of any images; any rental, lease, or lending of the program. Discussions and Conclusions Chapter 12

Copyright © Allyn & Bacon 2008 Discussion Topics Purpose and structure of these sections of a report Interpretation of the results Conclusions Criteria for evaluating discussion and conclusions sections of a report

Copyright © Allyn & Bacon 2008 Purpose and Structure The purpose of the discussion section is to present an interpretation of the results, the conclusions, and recommendations for further study – An evaluation of the methodology and results to help readers understand what the results mean and how they can be used – Integrates the research problem, review of the literature, and results – Speculates about the implications of the results through a synthesis of the study reflecting the professional judgment of the researcher

Copyright © Allyn & Bacon 2008 Purpose and Structure Loosely structured into two sections – Interpretation of the results – Conclusions

Copyright © Allyn & Bacon 2008 Interpretation of the Results An analysis of the results focusing on factors that might help explain them Interpretations related to the problem and/or hypothesis – Restatement of the research question – Interpretation of how well the data answers the question – Importance of the reader’s critical analysis of these interpretations Interpretations based on theory

Copyright © Allyn & Bacon 2008 Interpretation of the Results Interpretations related to methodology – Selection of participants – Measurement of variables – Experimental interventions – Statistical procedures Errors in reporting statistical results Violation of assumptions of the statistical procedures Use of appropriate statistical procedures, particularly in multivariate studies Statistical and practical significance

Copyright © Allyn & Bacon 2008 Conclusions Summary statements of the results as they pertain to the research problem – Can be found in various locations in the discussion section – Should include indications of why the conclusions are supported – See Trochim’s discussion of conclusion validityconclusion validity

Copyright © Allyn & Bacon 2008 Conclusions Limitations – Seven factors or variables that need to be considered in using the conclusions – Subject characteristics Population validity - generalizability to other individuals – Comparison of the sample, sampling frame, and target population – Comparisons across subjects within the sample – Situational characteristics Ecological validity - generalization to other settings, times, treatments, or measures

Copyright © Allyn & Bacon 2008 Conclusions – Seven factors (continued) Methodology – Non-experimental designs drawing causal conclusions – Experimental studies drawing causal conclusions when internal validity is weak Time Interventions – Explication of the intervention – Hawthorne Effect - the effects of individual’s realizing they are participating in a study

Copyright © Allyn & Bacon 2008 Conclusions – Seven factors (continued) Measures – Validity – Reliability Concerns related to overly strict analysis of limitations

Copyright © Allyn & Bacon 2008 Conclusions Recommendations and implications – Statements suggesting future action as a result of the study Focus on methodological issues Focus on practice

Copyright © Allyn & Bacon 2008 Evaluation Criteria The results should be adequately interpreted The conclusions should answer the research questions The conclusions should be limited by subject characteristics and selection, the nature of the interventions, and measures Statistical and practical significance are discussed separately

Copyright © Allyn & Bacon 2008 Evaluation Criteria Failure to show statistical significance does not mean there is not relationship or difference Limitations should be reasonable Recommendations and implications should be specific