Walking on virtual tiles Adaptive augmented reality for aiding Parkinson patients Yoram Baram, Judith Aharon-Peretz, Yahalomit Simionvici, Lior Ron, Amir Baram

Background Parkinson’s Disease causes severe gait disturbance Current medication (L-Dopa) helps, but has adverse effects Visual cues help Parkinson patients to walk

A Parkinson’s patient On On medication Off medication

Walking on tiles

Augmented reality in closed-loop We propose adaptive augmented reality – a virtual tiled floor that responds dynamically to the patient’s own motions Patient dynamics: forward sideways turns head motions tremor

Apparatus We have developed a device comprising: Head and body mounted accelerometers See-through head-mounted display Digital processor Software that creates the desired augmented reality

Open and closed loop systems motor system image generator motion display eyes motor system image generator motion display eyes motion sensor adaptive filter

Medical experiments Performed at the Movement Disorders Clinic of Rambam Medical Center in Haifa, Israel Compared patient performance with the visual display turned off and on and with open and closed loop systems Patients were 12 hours off medication or in “off” Each experiment consisted of a patient walking a stretch of 10 meters 4 times. Last 2 times averaged

Results Test reslts Display off Open loop Close loop 1 Close loop 2

התפתחות התצוגה

קסדת טייסים

Virtual I-O Display

MicroOptical ClipOn Display

התפתחות יחידת החישוב

PC

Advantech PCM-5824

Compulab X86 Core

מערכת משוב רפואי

Conclusion Significant improvement in the walking abilities of Parkinson patients is facilitated by a portable device for creating an adaptive augmented reality of motion over tiles Improvement parameters are similar to those obtained by medication and by brain surgery, without the adverse effects