1. 1 Mobility for All: Mobility for All: architecture and technology demo approach architecture technology demo future work Jim Sullivan Co-Director, Cognitive Levers Project Center for LifeLong Learning and Design james.sullivan@colorado.edu Alexander Repenning CEO and President AgentSheets, Inc. alexander@agentsheets.com

2. 2 Old approach: “fit the user into the system” “Here is your map …. You live here … Your destination is here … Your bus will have this label… When you see this landmark, remember to pull the cable on the bus so the driver knows you will get off at the next stop. This is where you will get off… Don’t forget your backpack! OK, now let’s talk about the schedule …. do you know how to read a clock? … “

3. 3 New approach: design a system to “fit the user ” other things I can do things I have to remember my bus my drawing of my house my mom works here

4. 4 Mobile architecture mobility agents data servers internet backbone mobile users support communities transportation systems wireless networks mobile internet

5. 5 constructive Technology demonstration components real virtual GPS vehicle locations distance to person/stop agent mediated attention & memory prompts

6. 6 “Constructive” solution for mobile users Proof-of-concept of a location-aware, mobile device that: gives personalized, logical choices (based on location, time of day and week, abilities, etc.) provides multi-modal information and feedback in response to user choices and actions. communicates with a “virtual” transportation system (and potentially other sources of information) to: locate the “right bus” prepare for boarding get on the “right bus” prepare to get off at the “right” location reward good performance provide “cognitive post-its” to remember items easily forgotten in a complex itinerary

7. 7 Virtual 3D/real-time display For caregivers: Supports preparation and training: to better visualize/understand/interact with a complex and dynamic system to design see how personalized user prompts (prompting content & sequence, preparation time, prompting frequency, etc.) will interact with real-time vehicles. Support real-time monitoring and assessment: use a 3D real-time display to make “confederate observations” of MULTIPLE users determine real-time errors, and offer contextualized, real-time help review performance errors, and create training/intervention strategies

8. 8 Simulated person Real-time tracked busses Speech recognition

9. 9 Research hypotheses independence: mobile architecture will afford an ability to learn more routes, leading to increased independence. learning: instantiates an “errorless learning” strategy; supports learning and using “individually relevant” routes. efficiencies: less time to learn a route; more time to learn different routes; allows overworked therapists to identify and focus on users with greatest needs. personalization: memory and attention prompts can be contextualized and dynamically tailored to suit user needs. safety: dynamic error detection and recovery strategies can incorporate both automated and human intervention. assessment: can collect real-time data for development, user training and personalization, while avoiding abandonment. scale: can be used in other transportation systems with bus GPS infrastructure technologies (see nextbus.com). many potential “space program” applications!

10. 10 Mobility for All - future work architecture integration (goal: seamless “look and feel” for user communities) error detection and recovery (“panic button”) caregiver feedback (identify training and technology needs, script creation and modification) personalization technologies (customizable by caregivers; adaptable to users; engaging to use; supportive of learning and growth) test and evaluation on a mobile, wireless platform

11. 11 Cognitive Levers Project sponsored by the Coleman Institute