Synthesize, Analyze, Evaluate, Validity & Reliability LA

Cluster 4: Informational Text & Research Process  LA The student will explain how text features (e.g., charts, maps, diagrams, sub-headings, captions, illustrations, graphs) aid the reader’s understanding.  LA The student will assess, organize, synthesize, and evaluate the validity and reliability of information in text, using a variety of techniques by examining several sources of information, including both primary and secondary sources.  Content/focus Analyze/evaluate information Validity/reliability of information Synthesizes information (from multiple sources and within text)

Definitions  Analyze- examine in detail the text.  Evaluate- form an idea about the passage, determine the significance.   Synthesize- to combine all information to create a new idea.

Cluster 4: Informational Text & Research Process SourcePrimary or SecondaryType of InformationQuestions to ask about the Source AlmanacSecondaryFacts, statistics, dates, & current events. Is it up to date? AtlasSecondaryMaps, geographical information Is it current and accurate? AutobiographyPrimaryAn account of a person’s life written by that person Is it authentic? DiaryPrimaryA personal record of events or reflections. Why is this record important? Do the observations seem accurate? EncyclopediaSecondaryinformation arranged alphabetically. Is it current and complete? NewspaperBothDaily publication containing news & ads. Is the writing objective or biased? Are the quotes authentic? SpeechPrimaryAn oral presentation.Is the content fact or opinion? TextbookSecondaryContains subject-area info. for school use. Is it up to date? Does it represent facts or opinions? World Wide WebBothSystem of connected documents. Is it objective? Is the site linked to a legitimate source? Literary WorkPrimaryOriginal work of literature.Is this an accurate version or edition?

RELIABILITY & VALIDITY

RELIABILITY  Reliability deals with the consistency of measurement in research; dependable; trustworthy; a reliable source of information  Reliability is the quality that guarantees us that we will get similar results when conducting the same test on the same population every time. Consider this ruler…

RELIABILITY Now compare this ruler… With this one…

RELIABILITY Each ruler will give the same answer each time… But this one will be wrong each time…

RELIABILITY Each ruler is reliable… But reliability doesn‘t mean much when it is wrong…

RELIABILITY So, not only do we require reliability… We also need…

VALIDITY Good Ruler Bad Ruler

VALIDITY Validity deals with the accuracy of the measurement; quality; the reality of the information

VALIDITY  Internal Validity questions if we are measuring what we think we are measuring. I am trying to determine if my students are learning the value of service to the community, so I give a survey at the end of the semester asking if they think will continue community service during the summer. They all say they will. Whaddaya think?

VALIDITY  External Validity questions if we can generalize our results to a larger population. I find that students at School A have a higher average score in reading than those in School B. Do you think we could improve School B’s reading scores by having School A’s teachers teach them? If Italians tend to have a lower incidence of heart attacks than Americans, would we expect Americans to decrease their heart attacks if they followed an Italian diet.

VALIDITY  Internal Validity: are we testing what we think we are.  External Validity: can generalize our results to a larger or different population.  There are other types of validity that focus on specific concerns researchers have concerning possible errors of accuracy in their studies. The subject teeters on the edge of philosophical debate about just how large a threat these other concerns are. It is important, but subject for more in-depth study.

RELIABILITY AND VALIDITY  The Bottom Line:  We need both reliability and validity in research to insure that we have consistent, accurate answers to our research questions.  Research must reflect reality and without reliable, valid data (which is interpreted correctly and consistently) research is meaningless.

Friday’s Task  Suppose I were to assign you to do a research paper on which type of light bulb is the best.  At each table is a folder containing a variety of articles and information  Your job is to select which bulb you would like to defend as the best bulb. Then determine which of the selected articles would best support position.