1. Foundations of Institutional Research 2018 Data quality improvement
Foundations of Institutional Research 2018
Data quality improvement
Presented by Liz Archer

2. Demands on IR I R
1,351 tasks

3. How to be an IR superhero

4. Institutional Need Hierarchy
Archer 2017
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

5. Communication matrix exemplar (Learner Analytics)
Stakeholder
Information type
Consolidated individual student profile
Summary of student risk profile per module
Summary of Student risk profile per qualification
Intervention uptake per module
Student support staff X
College management
School Director
Chair of Department
Module team
Tutors
Student  X

6. Group Activity Data quality improvement assignment
Individually identify three data quality issues that your institution are struggling with (5 min)
Discuss these issues in your group. Choose two to three of the most relevant issues to carry forward in your assignment (10 min)
Discuss the chosen issues in your group (10 min)
Feedback based on the questions provided (each group will be allowed 10 min)
Consolidation (5 min)
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

7. Introduction to statistics for institutional research
Foundations of Institutional Research 2018
Introduction to statistics for institutional research
Presented by Liz Archer

8. Introduction to statistics for Institutional Research
Purpose of using statistics in IR and HE administration
The tip of the iceberg
What is statistics?
Doing the groundwork
Types of statistics
Types of data
Statistical software
Treat data with respect
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

9. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
The tip of the iceberg
Technique
Method
Design
Paradigm
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

10. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
What is statistics
The science of collectiong, organizing, presenting, analyzing, and interpreting data to assist in making more effective decisions Statistical analysis – used to manipulate summarize, and investigate data, so that useful decision-making information results.
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

11. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

12. Statistical Superhero Basics
Southern African Association for Institutional Research

13. Understanding your Nemesis
Southern African Association for Institutional Research

14. Southern African Association for Institutional Research
Villain weakness
Southern African Association for Institutional Research

15. Southern African Association for Institutional Research
Know your superpowers
Data manipulation with cleaning go hand in hand
Using Inclusion / exclusion criteria
Visualizing
Outliers
Cleaning character
variables
Dealing with missing
data
Southern African Association for Institutional Research

16. Southern African Association for Institutional Research
Types of Statistics
Southern African Association for Institutional Research

17. Southern African Association for Institutional Research
Sampling Funnel
Southern African Association for Institutional Research

18. Southern African Association for Institutional Research
Levels of Measurement
Southern African Association for Institutional Research

19. Southern African Association for Institutional Research
Levels of Measurement
Southern African Association for Institutional Research

20. Southern African Association for Institutional Research
Levels of Measurement
Southern African Association for Institutional Research

21. What type of statistics
Southern African Association for Institutional Research

22. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
Parametric or Non
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

23. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
Statistical software
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

24. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
Most used?
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

25. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
The biggest?
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

26. The collective delusion
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

27. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

28. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

29. False sense of security
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

30. Important considerations
Parametric tests are more likely than their nonparametric counterparts to detect a statistically significant difference between two or more treatments of a significant relationship between two variables
The choice between parametric tests and nonparametric tests is dictated by the characteristics of the data
When the data allow you to choose between the two types then parametric tests is recommended
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

31. Institutional Research Context
In some cases, data reflect one or more of the following:
Small sample size
Data summarised in categories
Non-normal or unknown distribution
Nominal or ordinal measurement scales
Examples: Data organised by discipline, department, college/faculty, rank, etc
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

32. Institutional Research Context
Typically situations involving large number of observations such as student population or personnel/staff population
In these case use of parametric approaches are appropriate as underlying distributions are usually “close enough” to a normal distribution to provide reliable information
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

33. Treat data with respect
Data has a story to tell.
Therefore:
Do not fudge the data
Be objective in analyzing the data
Use the best tools to analyze the data
Do not exhaust the data beyond its capacity
Accuracy in dealing with data is of the utmost importance
Recognize your power and responsibility as story teller
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

34. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

35. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH

36. SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH
Discussion
SOUTHERN AFRICAN ASSOCIATION FOR INSTITUTIONAL RESEARCH