1. Human Assisted Cognitive Modelling
Haiyue Yuan, Shujun Li
Deparment of Computer Science, Surrey Centre for Cyber Security, University of Surrey, UK
Patrice Rusconi
School of Psychology, University of Surrey, UK
Hybrid Human-Machine Computing HHMC 2017
20/21 Sep

2. Research Background Cognitive modelling
Emulate human behaviour (perceptual, cognitive, motor process)
Predict user performance and evaluate UI
GOMS (Goals, Operators, Methods, and Selection) rules, KLM (Keystroke-Level Model), CPM-GOMS, etc.
Cognitive modelling software (CogTool, SANLab-CM, Cogulator etc.)
Facilitate the design and modelling process
Still needs a fair amount of manual work
Difficult to model a system with complicated UI and user interaction

3. CogTool+
Based on the open source software CogTool developed at Carnegie-Mellon University
(semi-)automated modelling and simulations of human cognitive tasks
Keep humans as a source of additional data
External Human-Generated Data
Eye tracking data
ACT-R parameters
Simulation parameters

4. Case study 1
Human generated eye tracking data assisted cognitive modelling
Cognitive modelling an user authentication system ‘Undercover[1]’
Lab-based eye-tracking user study[2].
Reproduce some human behavioural patterns
[1]H.Sasamoto, N.Christin, and E.Hayashi “Undercover: authentication usable in front of prying eyes.”, In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA,
[2] H.Yuan, S.Li, P.Rusconi and N.Aljaffan, 2017, “When Eye-tracking Meets Cognitive Modeling: Applications to Cyber Security Systems,” in Human Aspects of Information Security, Privacy and Trust: 5th International Conference, HAS 2017, part of HCI International HCII 2017, Vancouver, BC, Canada, Proceedings, Lecture Notes in Computer Science, vol , pp , 2017, Springer

5. Case study 2 Predictive model of human movement
Fitts’ law parameter to tailor simulation process
Predictive model of human movement
Parameter a and b are empirically determined
Different user group (young, old, skilled, novice etc)
Add-on software module for tapping/pointing game to gather data

6. Conclusion Keep human in the loop is important
Finalise and share the CogTool+ software
How AI can be part of the human-assisted cognitive modelling process?
Acknowledgments
COMMANDO-HUMANS COMputational Modelling and Automatic Nonintrusive Detection Of HUMan behAviour based iNSecurity
Funders:
Project Members: 6

7. Thank you
Any questions ? 7