Introduction to the 2007 Workshop on Intelligent Systems for Assisted Cognition Henry Kautz University of Rochester Department of Computer Science

Vision Understanding human behavior from sensor data Actively prompting, warning, and advising the user Alerting caregivers as necessary Computer systems that improve the independence, safety, and social integration of people suffering from cognitive disabilities by…

user profile general knowledge wearable sensors environmental sensors decision making user interface caregiver alerts behavior cognitive state intentions activity

Common Causes of Cognitive Disabilities Alzheimer’s Disease Today: 4 million (US) 2050: 16 million Traumatic Brain Injury year newly disabled Intellectual and Developmental Disability 7.5 million (1% - 3% of the population) Autism-Spectrum Disorder 1 million (0.2% - 0.6% of the population)

Staff Sgt. Mark MacPherson, Washington Nat’l Guard 37 yr. old, environmental consultant Slides courtesy of Dr. Kurt Johnson, Dept. Rehabilitation Medicine, University of Washington

Lobes of the Cerebrum Parietal Lobe Temporal Lobe Frontal Lobe Limbic Lobe Occipital Lobe

Frontal Lobes Executive functioning Planning and organizing Multi-tasking Motivation and initiation of action Personality functioning Self-awareness Regulation of behavior Inhibitory controls Pragmatics

Cognitive Deficits from TBI Memory Planning Initiating Action Sustaining Attention Emotional intelligence Navigation Apperception Speed of Information Processing General Cognitive Economy

Emotional Consequences Depression Irritability Regulation of anger Personality Changes Impulsivity Denial Lack of empathy

Consequences Unemployment rate of 70 – 90% one to three years out Higher than expected divorce rates Caregiver burden Social isolation and loss of community

Opportunities for Assisted Cognition Systems Memory Reminding Systems Initiation & Focus Task Prompting Systems Apperception Affective Feedback Systems Navigation Wayfinding Systems

Dimensions of Assisted Cognition Remediation versus replacement Wheelchairs for the mind Plasticity? Monitoring versus interaction Post-hoc versus real-time End-user Person with disability Family Medical providers

Advantages of Assisted Cognition Less intrusive than “people” supports Vary the level of support depending on context and performance Potentially downloadable and configurable – “storefront access” Enormous flexibility in device, interface, and function Reduce caregiver burden

Where is the Work Being Done? Computer science Rehabilitation engineering Rehabilitation medicine & gerontology Architecture Assisted-living & nursing homes

Some Key Previous Workshops First International Workshop on Ubiquitous Computing for Cognitive Aids (UbiComp 2002) AAAI Fall Symposium on Caring Machines: AI in Eldercare (AAAI 2002 & 2005) Research Planning Workshop for Everyday Technologies for Alzheimer's Care (ETAC) (Int. Conf. Alzheimer’s Disease 2004) DARPA Workshop on Advancing Assisted Cognition Technology for Persons with Traumatic Brain Injury, 2005

This Workshop 43 talks and posters By far the largest gathering on this topic! 6 nations – US, Canada, Mexico, Italy, United Kingdom, Taiwan Universities, medical centers, large & small companies Many thanks to the University of Rochester & Microsoft Research