Collecting Quantitative Data Creswell Chapter 6

Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class = convenience sample Describe relevant characteristics

Permissions IRB – VSU and administrator Student assent Parent consent Colleague assent

What for? Any activity outside normal instruction  Activities  Survey/questionnaires  Interview  Audio or video records  Use of student work samples

What information? Consider RQs Consider triangulation  Three Es Consider covariates  Disaggregated subgroups Include field notes

Types of Measures Performance Attitude – self-report Behavior - observable Facts - archival

What Instruments? Locating an instrument (p.160)  Standardized test prep CRCT  Norm-referenced STAR  Widely used instrument AR, DIBELS  Used in research Creating an instrument

Reliability Scores are stable & consistent Test-retest Alternative forms Split half Inter-rater

Threats to Reliability Questions or tasks are unclear Data collection procedures are unclear Assessment criteria are unclear Student factors

Validity Assessment  Makes sense  Is meaningful  Measures what is intended

Types of Validity Content  Items represent target Criterion  Scores related to outcomes Construct  Scores are meaningful and fullfil purpose

Threats to Validity Poor research design Poorly designed assessments Irrelevant assessments Inability to predict Participant factors

Scales of Measurement Nominal (categories) Ordinal (ranking) Interval e.g. Likert Ratio (true zero)

Administration Standardize procedures Use written protocols Record field notes ASAP Ethics  Permission  Anonymity & confidentiality

Questions?