1. Michael Jennings First Year in Maths Workshop 3 – July 2015 Michael Jennings, Deb King (Melb), Adam Bridgeman (Syd), Liz Johnson (Deakin) Not just another diagnostic test! GetSet 2: the final frontier

2. Michael Jennings … the Australian Government’s Office for Learning and Teaching. Today’s talk is brought to you by…

3. Michael Jennings Formative self-diagnostic system that provides students with personalised feedback on their current abilities, plus individualised subject selection advice via the feedback matrix Gives staff rich information Can be used at any time throughout the degree What is GetSet?

4. Michael Jennings Aim of the test is … … NOT to tell students how much they don’t know / forgotten … to gauge current mathematical / science understanding … to tell students what maths / science is used in their courses so they can choose the appropriate courses – feedback matrix … to identify at-risk students … to give staff up-to-date info on students

5. Michael Jennings GetSet in Engineering 2009-2014 OLT grant 2011 Led by USQ, involving UQ, UNE, UTS, and UNewcastle http://getset.uqcloud.net 20 maths questions –18 MCQs, 2 enter the answer – Can’t remember & Never seen before options 12 physics and 12 chemistry questions

6. Michael Jennings GetSet in Science 2015 OLT extension grant 2014 Led by UQ, involving Melbourne, Sydney and Deakin https://getset.science.uq.edu.au 19 maths/statistics questions – all MCQ – Can’t remember & Never seen before options Guest access

7. Michael Jennings BSc students’ feedback Semester 1, 2015 Yes, it gave me an insight into the knowledge that I need for 1st year60% Yes, it flagged some things that I have forgotten and need to review79% Yes, I feel that this is the beginning of my journey of studying science at UQ30% Yes, it made me feel that my needs are being assessed25% No, it achieved none of the above3% I'm not glad that I did completed the quiz8% I have a better idea of what I know and what I don't know73% I feel more confident24% I have a better understanding of first year knowledge expectations58% Revise my high school notes70% Find a relevant text book30% Ask someone who knows for help24% Do nothing because I did well12% Do nothing because I will pick it up during semester12% N/A - I didn't dislike it41% It was stressful8% It didn't help4% I forgot a lot of what I knew during the holidays44% It scared me16% I was still in a holiday mode37% It was time consuming and boring6%

8. Michael Jennings Question NoConcept Correct Answers % Q6Add two numerical fractions97.54 Q7Add two algebraic fractions77.05 Q8Solve an equation92.87 Q9Expand a factorised quadratic89.47 Q10Factorise a quadratic91.95 Q11Solve a quadratic83.76 Q12Solving simultaneous equations x=70.04 y=71.98 Q13Simplify an expression with powers76.46 Q14Understanding sine, cos, and tan84.89 Q15Straight line equations What is the slope of the line?88.99 What is the y intercept?78.52 Q16Simple derivative92.72 Q17Optimising a function77.67 Q18Visualising a derivative65.22 Q19Adding different base logarithms64.1 Q20Derivatives - Product rule49.38 Q21Derivatives - Chain rule73.45 Q22Simple integral89.66 Q23Definite integral64.81 Q24Calculate the area under graph76.6 Q25Composition of functions64.62 Staff summary Eng test 2013

9. Michael Jennings Feedback matrix https://getset.science.uq.edu.au

10. Michael Jennings OLT Extension Grant 2014-2015 Melbourne, Sydney, Deakin science, maths and business programmes UQ Science Macquarie Southern Cross, Charles Sturt, UWS, Curtin, Griffith, USQ, UTS, UNSW

11. Michael Jennings GetSet 2 – what’s new? Core questions AND options CORE Option 1 Option 3 Option 2

12. Michael Jennings GetSet 2 – what’s new? https://getset2.uqcloud.net/

13. Michael Jennings You want GetSet? You got it! However, you need: TIME $$ UQ Science 2015 $43,000 grant – $8000 per discipline

14. Michael Jennings What maths is in your course(s)? What do you want to know? –Procedural vs conceptual understanding. With what do you think students struggle? When are you going to do the test? What are you going to do with the info from the test? Post-test? End of first-year test? Major test? QS in Science – www.qsinscience.com.auwww.qsinscience.com.au

15. Michael Jennings You want GetSet? You got it! https://getsetforsuccess.wordpress. com/ https://getsetforsuccess.org.au

16. Michael Jennings Acknowledgements The 2009 online diagnostic test was funded by a The University of Queensland Teaching and Learning grant. The project team was A/Prof Lydia Kavanagh (Faculty of Engineering, Architecture and Information Technology), Dr Liza O’Moore (School of Civil Engineering), Professor Peter Halley (School of Chemical Engineering), Professor Paul Lant (School of Chemical Engineering), Professor Peter Adams (Faculty of Science), Michael Jennings (School of Mathematics and Physics), Professor Lawrie Gahan (School of Chemistry & Molecular Biosciences) and Dr Anton Raynor (School of Mathematics and Physics),. The OLT funded project involved USQ, UQ, UNE, UTS and UNewcastle. http://www.olt.gov.au/project-get-set-success-using- online-self-assessments-motivate-first-year-engineering-students- engaghttp://www.olt.gov.au/project-get-set-success-using- online-self-assessments-motivate-first-year-engineering-students- engag The feedback matrix was designed by A/Prof Lydia Kavanagh (Faculty of Engineering, Architecture and Information Technology), Dr Liza O’Moore (School of Civil Engineering).

17. Michael Jennings Burton, Lorelle, Dowling, David, Kavanagh, Lydia, O'Moore, Liza & Wilkes, Janelle (2012). Examining first year students' preparedness for studying engineering. In: Llewellyn Mann and Scott Daniel, AAEE 2012 Conference Proceedings. 23rd Annual Conference of the Australasian Association of Engineering Education (AAEE 2012), Melbourne, Australia, (1020-1028). 3 - 5 December 2012. Jennings, M. (2011). The transition from high school to university: The University of Queensland perspective. In: John Hannah, Mike Thomas and Louise Sheryn, Te Ara Mokoroa: The Long Abiding Path of Knowledge - Proceedings of Volcanic Delta 2011. Volcanic Delta 2011: The Eighth Southern Hemisphere Conference on Teaching and Learning Undergraduate Mathematics and Statistics, Rotorua, New Zealand, (139-149). 27 November - 2 December 2011. Kavanagh, L., O’Moore, L., & Samuelowicz, K. (2009). Characterising the first year cohort knowledge. 2009 Conference Proceedings. Annual Conference of the Australasian Association of Engineering Education (AAEE 2009). References