Presentation on theme: "Edmund Cannon Electronic and traditional learning on an econometrics unit September 2009."— Presentation transcript:
Edmund Cannon Electronic and traditional learning on an econometrics unit September 2009
2 Introduction Which students use Blackboard (BB) and how do they use it? Handouts (Word/pdf documents) versus Power-point slides. Possible consequences.
3 Estimating treatment effects Even with a perfectly-designed controlled experiment, effects would need to be large for them to appear statistically significant (sample size 145 or fewer). I have not performed a controlled experiment so any correlations will not identify treatment effects. But we can still learn something... Nb in idiot regressions, the best explanators for exam performance are lecture attendance and 1 st -year exam mark.
4 Powerpoint etc. Chen and Lin (2008, IREE) argue PP slides improves student performance: other papers more cautious. Students like PP. Need to think about how they use it.
5 What are print-outs of PP slides for? Probably helps dyslexic students. May reduce the number of mistakes on some of the pieces of paper in a students file. May make students more passive (substitutes visual for kinesthetic learning). May change a students lecture attendance. May substitute/complement other paper resources.
6 What are (Word doc) handouts for? Nb assuming a technical unit like econometrics Supplementary information to the text book. Provides material to discuss in the lecture/class. Lecturer too lazy / arrogant to use text book properly.
7 QM3 Econometrics Compulsory second-year unit for most Economics students Excluding Erasmus, etc, I analyse 145 students (whole sample) or 115 students (omit EconMath). All students have AAB+ at A-level, Maths A-level grade A/B and have passed QM1 (Maths) and QM2 (Statistics) in the first year. Most students have a further compulsory econometrics unit in the third year (not EconMath).
8 QM3 Econometrics, cont'd Textbook-based unit testing technical skills (Murray: Econometrics: A Critical Introduction). First term overlaps QM2 material - OLS (chapters 1-10). Second term all new – heteroskedasticity, auto-correlation, consistency, IV/2SLS, Demand and Supply (chapters 11-14). Exam: answer three questions on algebra, stata, economic interpretation.
Statistics for total BB useage 9 QM3QM2 / Stat EverTerm 2VacTerm 3EverTerm 2VacTerm 3 I47.08.12.54.922.214.171.124.9 II.i44.38.82.05.241.07.61.84.6 II.ii43.77.72.04.6126.96.36.199.5 III188.8.131.52.184.108.40.206.3 F220.127.116.11.418.104.22.168.7 Ordered probit relating class of mark to BB use is significant [p = 0.018].
10 What did I put on Blackboard? Exercises (one electronic, the rest paper). Handouts (Word/pdf documents). Power-point files for lectures. Lecture given PP slides put on BB Word doc put on BB Lecture 1530 Jan7 Feb Lecture 166 Feb22 Feb Lecture 1713 Feb22 Feb Intro to IV16 Feb Sargan16 Feb
Number of times students accessed teaching material 11 Tentative conclusion: students use BB as a mobile reference
Number of times accessed this doc on BB 12 QM3Power-point slides (L15)Handout (Intro IV) EverTerm 2VacTerm 3EverTerm 2VacTerm 3 I 22.214.171.124.126.96.36.199.3 II.i 188.8.131.52.02.51.00.31.2 II.ii 184.108.40.206.220.127.116.11.8 III 18.104.22.168.01.80.80.10.8 F 6.44.00.71.01.70.80.20.8 Nb strong correlation between downloading handout and downloading PP
Number of times accessed 13 QM3Power-point slides (L17)Handout (Sargan) EverTerm 2VacTerm 3EverTerm 2VacTerm 3 I 22.214.171.124.126.96.36.199.7 II.i 188.8.131.52.184.108.40.206.6 II.ii 1.31.00.20.10.90.2 0.5 III 220.127.116.11.21.00.40.00.4 F 1.61.00.30.40.70.40.00.2
Proportion of students accessed on BB for the first time 16 QM3Power-point slides (L17)Handout (Sargan) EverTerm 2VacTerm 3EverTerm 2VacTerm 3 I 0.800.700.05 0.700.300.100.30 II.i 0.810.680.080.050.680.300.140.24 II.ii 0.690.540.120.040.580.190.040.35 III 0.700.570.080.050.620.300.000.32 F 0.640.440.080.120.520.280.000.24 Conclusion: many students did not access material that was needed to supplement the textbook.
18 Conclusions Positive correlation between using BB and exam mark – tells us nothing new; Students access material on BB repeatedly (reference); Both good and bad students access material after course is over (consistent with cramming); What are students using material for?
19 Estimating treatment effects Consider a perfectly-designed controlled experiment, where the treatment effect is a binary variable and the explained variable is exam mark. Suppose the cross-section regression has an R 2 of 0.15 (which would be considered reasonable), that the standard deviation of exam mark is 15% and the treatment effect raises performance by 5%. Degrees of freedom must be about 150 for statistical significance.