1. Amsterdam Airport Schiphol 1 Ludo W. van Meeuwen 1,3, Saskia Brand-Gruwel 1, Jeroen J.G. van Merriënboer 1,2, & Jeano J.P.R. de Bock 3 1 Open University of the Netherlands, 2 Maastricht University, The Netherlands, 3 Air Traffic Control The Netherlands Lund, May 7 2010 Self-directed Learning Skills in Air- traffic control

2. Amsterdam Airport Schiphol 2 Presentation Introduction –ATC –ATC-training Self-directed Learning Experiment Future experiments

3. Amsterdam Airport Schiphol 3 Casus Workload Management Tom ATC-Trainee

4. Amsterdam Airport Schiphol 4 1:Safe (5 NM or 1000 Ft.) 2:Efficient 3:Environmentally aware 1:Flight level (FL) 2:Heading 3:Speed

5. Amsterdam Airport Schiphol 5 Mental picture Chuncking

6. Amsterdam Airport Schiphol 6 Mental picture Chuncking Decision of order 3 7 6 5 2 1 4

7. Amsterdam Airport Schiphol 7 Mental picture Chuncking Decision of order R/T, Labeling… 3 7 6 5 2 1 4

8. Amsterdam Airport Schiphol 8 Adaptive training Need, adaptive training ATC Individual Task selection Drop-out Individual learning need Cognitive complex Tehnological change Current situation

9. Amsterdam Airport Schiphol 9 SDL / SRL

10. Amsterdam Airport Schiphol 10 Problems/Questions Offline measurement Thinking aloud CRR Can we measure SRL with use of CRR? Does CRR to foster SRL/self assessment?

11. Amsterdam Airport Schiphol 11 Eye-tracking SRL ATC Task Self- Assessment Task Selection Cued Retrospective Report Adjust Task- Selection Adjust Self- Assessment Recording of eye- movements. And performance measure for level of ATC competences by experts Measure for quality of self- assessment Measure for quality of task selection Measure for level of SRL skills Measure for quality influence of CRR on self- assessment Measure for influence of CRR on quality of task selection -Visual and audio cue -75 % speed -Recording of CRR Task Instruction List of Questions Prepare for task, information for self- efficacy judgment Questionnaire, self-efficacy

12. Amsterdam Airport Schiphol 12 Results CRR-utterances –Here, you see how I monitor this cluster of traffic (task level) –I could have chosen to decelerate this plane, but I used an other strategy… (meta-level/monitor). –Here I should have decided to change the arrival order since…(meta-level/adjustment) –This performance of me was terrible (meta-level)

13. Amsterdam Airport Schiphol 13 Results (prelim.) Regulation (task level): especially monitoring SRL (learning level): especially assessment Self-assessment 1: -4,2 (of 100) Self-assessment 2: -3,3 (of 100)

14. Amsterdam Airport Schiphol 14 Conclusion CRR is very suitable for measurement of SRL CRR seems to foster self- assessment –Increase number of participants

15. Amsterdam Airport Schiphol 15 Extension of this study Pre- measurement Post- measurement 6 weeks training, No SRL intervention 6 weeks training, with SRL intervention Expect: increase of SRL and performance

16. Amsterdam Airport Schiphol 16 Visual expertise Scanning strategies: - Experts, - Intermediates - Novices

17. Amsterdam Airport Schiphol 17 Thank you for your attention Questions? Remarks?!

18. Amsterdam Airport Schiphol 18 references Boekaerts, M., & Cascallar, E. (2006). How far have we moved toward the integration of theory and practice in self-regulation? Educational Psychology Review, 18, 199-210. Camp, G., Paas, F., Rikers, R. M. J. P., & van Merriënboer, J. J. G. (2001). Dynamic problem selection in air traffic control training: A comparison between performance, mental effort and mental efficiency. Computers in Human Behavior, 17, 575-595. Cascallar, E., & Boekaerts, M. (2006). Assessment in the evaluation of self-regulation as a process. Educational Psychology Review, 18, 297-306. Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2006). Towards a personalized task selection model with shared instructional control. Instructional Science, 34, 399-422. Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2008). Selecting learning tasks: Effects of adaptation and shared control on learning efficiency and task involvement. Educational Psychologist, 33, 733-756. Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2009). Combining shared control with variability over surface features: Effects on transfer test performance and task involvement. Computers in Human Behavior, 25, 290-298. Corbalan, G., Kester, L., & van Merriënboer, J. J. G. (2010). Learner controlled selection of tasks with different surface and structural features: Effects on transfer and efficiency. Eva, K. W., & Regehr, G. (2005). Self-assessment in the health professions: A reformulation and research agenda. Academic Medicine, 80(10), S46-S54. Eva, K. W., & Regehr, G. (2007). Knowing when to look it up: A new conception of self-assessment ability. Academic Medicine, 82(10), S81-S84. Eva, K. W., & Regehr, G. (2008). "I'll never play professional football" and other fallacies of self-assessment. Journal of Continuing Education in the Health Professions, 28(1), 14-19. Ericsson, K. A. (1998). The scientific study of expert levels of performance: General implications for optimal learning and creativity. High Ability Studies, 9(1), 75-100. Ericsson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363-406. Kicken, W., Brand-Gruwel, S., & van Merriënboer, J. J. G. (2008). Scaffolding advice on task selection: A safe path toward self- directed learning in on-demand education. Journal of Vocational Education and Training, 60, 223-239. Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2009a). Design and evaluation of a development portfolio: How to improve students' self-directed learning skills. Instructional Science, 37, 453-473. Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2009b). The effects of portfolio-based advice on the development of self-directed learning skills in secondary vocational education. Educational Technology Research and Development, 57, 439-460. Kicken, W., Brand-Gruwel, S., van Merriënboer, J. J. G., & Slot, W. (2010). The effects of p/reflection prompts on the development of self-directed learning skills in secondary vocational education. Manuscript submitted for publication. Knowles, M. S. (1975). Self-directed learning. Chicago, IL: Follett publishing company. Norman, D. A. (1988). The design of everyday things. London: The MIT Press. Norman, D. A. (2007). The design of future things. New York: Basic Books. Oprins, E., Burggraaff, E., & van Weerdenburg, H. (2006). Design of a competence-based assessment system for air traffic control training. The International Journal of Aviation Psychology, 16, 297-320. Salden, R. J. C. M., Paas, F., Broers, N. J., & van Merriënboer, J. J. G. (2004). Mental effort and performance as determinants for the dynamic selection of learning tasks in air traffic control training. Instructional Science, 32, 153-172. Salden, R. J. C. M., Paas, F., van der Pal, J., & van Merriënboer, J. J. G. (2006). Dynamic task selection in flight management system training. International Journal of Aviation Psychology, 16, 157-174. Salden, R. J. C. M., Paas, F., & van Merriënboer, J. J. G. (2006). Personalised adaptive task selection in air traffic control: Effects on training efficiency and transfer. Learning and Instruction, 16, 350-362.

19. Amsterdam Airport Schiphol 19 Van den Boom, G., Paas, F., & van Merriënboer, J. J. G. (2007). Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction, 17(5), 532-548. Van den Boom, G., Paas, F., van Merriënboer, J. J. G., & van Gog, T. (2004). Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence. Computers in Human Behavior, 20, 551-567. Van Gog, T., Paas, F., van Merriënboer, J. J. G., & Witte, P. (2005). Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting. Journal of Experimental Psychology: Applied, 11(4), 237-244. Van Merriënboer, J. J. G. (1997). Training complex cognitive skills. Englewood Cliffs, NJ: Educational Technology Publications. Van Merriënboer, J. J. G., & Kirschner, P. A. (2007). Ten steps to complex learning. Mahwah, NJ: Erlbaum / Taylor and Francis. Van Merriënboer, J. J. G., & Sluijsmans, D. A. (2009). Towards a synthesis of cognitive load theory, four-component instructional design, and self-directed learning. Educational Psychology Review, 21, 55-66. Van Merriënboer, J. J. G., & Sweller, J. (2005). Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychological Review, 17, 147-177. Vygotsky, L. S. (1978). Mind in society. London: Harvard University Press. William, D., & Black, P. (1996). Meanings and consequences: A basis for distinguishing formative and summative functions of assessment? British Educational Research Journal, 22, 537-548. Winne, P. H. (1995). Inherent details in self-regulated learning. Educational Psychologist, 30, 173-187. Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In P. R. Pintrich, M. Boekaerts & M. Zeidner (Eds.), Handbook of self-regulation (pp. 531-566). Orlando, FL: Academic Press. Zimmerman, B. J. (1986). Development of self-regulated learning: Which are the key sub processes? Contemporary Educational Psychology, 16, 307-313. Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 25(1), 3-17. Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41, 64-70.