1. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Japan-Europe TeleCare Service Research and Development Project Improving elderly care with telerobotic technologies and cloud-based knowledge systems Takahiro Miyashita Dylan F. Glas Intelligent Robotics and Communication Laboratories Social Media Research Laboratory Group Advanced Telecommunications Research Institute International (ATR) EU-Japan Workshop on R&D Cooperation in the field of Networked Technologies & Systems April 18, 2013

2. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Background: Mental Care for the Elderly Koekake in Japanese: Conversational techniques for Supporting mental health Exercising the memory Delaying or preventing the onset of dementia Recognized as important by care experts, but often neglected in practice…

3. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Proposal Overview Objectives: 1.Reduce the burden on caregivers 2.Support care recipients (e.g. interaction support, monitor to prevent wandering) 3.Create employment opportunities for the elderly (tele-work) Develop remote conversation support technology enabling teleworkers with caregiving expertise to provide mental care for elderly patients in care facilities using telepresence robots.

4. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Proposed Methodologies Semi-autonomous robot technology - Enable care workers to teleoperate multiple robots Care Expertise Database - Extract / model expertise from teleoperation logs of conversations (Big data approach). International collaboration - AAL technology leaders in Italy and the UK - Experimental care facility environment in Denmark - Multiple time zones -> effortless 24-hour telecare Prototype Global TeleCare System Day Night Teleworker Schedule Management Care Expertise DB

5. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Challenging for amateurs –Cannot locate people –Difficult to follow etiquette (social rules) New system - easy to use as video conferencing Telepresence Telepresence robots for TeleworkTechnologyDevelopment Usable by experts who know the space Telepresence robots developed at ATR Specialists controlling a guide robot in Nara Conversation via Telenoid Significance to Industry Telepresence robots are an active sector for startup companies, showing rapid growth Ex. InTouch Health growth rate: 252 used by over 3000 doctors in over 400 hospitals Partnering with iRobot since July 2011

6. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Meals Exercise Bathing Office Work Catering The state of care facilities today… Recreation therapy Mental care is important, but there is not enough time… Too few caregivers - cannot provide sufficient mental care Most modern care robots are focused on physical care. Too few caregivers - cannot provide sufficient mental care Most modern care robots are focused on physical care.

7. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Future Vision: Care facilities utilizing telepresence robots Telepresence robot services for recreational therapy Telepresence robot services to monitor wandering Internet Care worker at remote location These services will be enabled by the Global TeleCare System! Communication support focusing on mental care, using telepresence robots Ease the effects of the shortage of caregivers and reduce their workload Create opportunities for elderly people to work and participate in society

8. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Translation Integration Global TeleCare Prototype System Japanese DB Other Language DBs (EU) Translation (EU->JP) Translation (JP->EU) Multilinguistic Grid (NICT) Outpatient care facility Inpatient care facility Elderly home Japanese teleworker (experienced caregiver ) Day Night 1. Technologies for Situation Awareness in Conversational Interaction 2. Technologies for Semi-Autonomous Conversational Interaction 3. Global TeleCare System Construction Technology Translation via Multilinguistic Grid Japan-EU shared Care Expertise DB Schedule Management European teleworker (experienced caregiver) Teleworker Schedule Management Global Care Expertise DB Accumulation and structuring of knowledge from caregivers in each country Location / participant data Extract data for conversation Move to appropriate location Determine appropriate conversational distance Participate in conversation

9. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Technology developed previously Research Themes Technology developed previously 1 Conversational Situation Awareness Technologies 2) Conversational Participation Technologies Structuring environmental information for pedestrian motion Wheelchair Window-shopping area Shopping Extension to Audio (Conversation) Extension to Multiple participants & Conversation scenarios This Proposa l Aggregation Microphone Array Mobile robots track position and conversation Structuring environmental information for conversation Speaker Addressee Its fun, like shopping with my grandchild. Its convenient that it moves automatically Received Best Paper Awards in human-robot interaction research: HRI07, HRI09, HRI12 (acceptance rate: HRI07: 22%, 09: 19%, 12: 25% )

10. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Internet Nara City Tourist Information Center Tourist guidance Nara City Tourist Information Center Tourist guidance Inside ATR Kyoto, Japan Teleoperation Inside ATR Kyoto, Japan Teleoperation Teleoperated Robot Robovie-R3 Tourist Information Headquarters, Nara City Teleoperation Tourist Information Headquarters, Nara City Teleoperation Teleoperation Interface Personal Computer Research Themes Technology developed previously Tourism, shopping, locomotion support: One person teleoperating 4 robots at once Multilingual Elderly Care This Proposal 3 Global TeleCare System Integration Technologies Ubiquitous Network Robot Platform (UNR-PF) Extension to

11. Merits of Japan-Europe Collaboration Complementary focus: In Europe: technology focused on elderly people living alone or receiving in-home care. In Japan: focus on group care facilities such as nursing homes. Sharing unique facilities: Early adopters in Denmark have established an experimental elderly care center (CareLab). Can conduct experiments in a real care environment Not easily possible in Japan. Collaboration: DTI, ECHORD++, AALIANCE2, etc. Coordination between projects Effective support of care givers / receivers in home / group care facilities Import technology to European society Proposed Collaborators –Denmark Dr. Troels Oliver Vilms Pedersen, Dr. Claus Risager DTI Patient@home –Italy Prof. Paolo Dario, Dr. Filippo Cavallo SSSA ECHORD++ AALIANCE2 RobotEra RoboLaw –United Kingdom Prof. Rossi Setchi, Dr. Renxi Qiu Cardiff Univ. SRS

12. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Coordination between organizations MOU's already signed with DTI, SSSA - cooperative research is beginning. – DTI: Collaborative research has begun with P@H – SSSA: Cooperation since 2008. In this case agreed to collaborate. Currently planning a collaborative workshop for Autumn 2013. EU-JAPAN Forum Ageing Societies in Europe and Japan: Policy Responses and Research & Innovation Solutions for Active and Healthy Ageing (Oct. 9-10, 2012) Agreed to coordination between all organizations.

13. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Expanding on Research Results Enhancing creative innovation / international competition Development of specific service models for care-focused telework through robot teleoperation – Variation between cultures – Different service tasks International standardization UNR Platform (infrastructure supporting TeleCare system): standardization completed: ITU-T SG16 Q25 IoT. Proposed standard methodologies for telepresence robots: ITU-T SG16 Q5 Telepresence systems.

14. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Application of Research Results Use in Society – Creation of service models through Japan-EU collaboration, extending beyond elderly care – Active seniors able to perform telework in their respective fields Personnel training – Development of education courses for nursing with telepresence robots, training of service providers

15. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Conclusion In pursuit of these three objectives: 1.Reducing workload of care workers 2.Supporting care receivers (conversation support, monitoring of wandering) 3.Supporting employment for elderly people We propose to implement a Global TeleCare Prototype System" enabling effortless 24-hour telecare through Japan-Europe collaboration enabled by the development of a Japan-Europe care expertise database and new teleoperation support technologies for telepresence robots. Thank you for your attention.

16. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Further References

17. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. Patient@Home Title: Patient-at-home: Innovative Welfare Technology for the 21st Century Telework government fund SPIR Principal Agency: Southern Denmark University, DTI Period: 2012.2 – 2018.1 Summary: Develop new social welfare technology and services for use at home by elderly people living alone, helping increase patients motivation with respect to their own healthcare and assemble a reliable framework for health care data collection. Merits of collaboration: By using P@H, it is possible to conduct experiments and develop service models, which would be difficult given the current situation in the field of elderly care within Japan.

18. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. ECHORD++ Title: European Clearing House for Open Robotics Development Plus Plus FP7-ICT Representative Organization: TUM (Prof. Alois Knoll) Period: 2013.10 – 2018.9 Overview: European collaborative robotics research is set up to collaborate directly with SMBs and startups. Creating experimental environments in which it is possible to easily test research results related to robots and before-market products with end-users. Merit of collaboration Provides an experimental environment usable for integrated technology development with other European FP7 projects outside of Denmark, and enables the survey of real user needs.

19. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. AALIANCE2 Title The Next Generation European Ambient Assisted Living Innovation Alliance FP7-ICT Primary Institution SSSA (Principal members 6 other institutions) Period 2011.10 – 2013.9 Overview AALIANCE2 is an Ambient Assisted Living initiative assisted living technologies incorporating environmental sensors and robots) utilizing leading-edge ICT to support health maintenance for the elderly, survey technology trends in the US and Asia, and support collaboration. Created a roadmap for AAL in Europe covering the next 10 years. Merit of Collaboration: Through technology exchange and discussion with Europes AAL-related industry and research organizations, we can develop an AAL roadmap for the EU and simplify standardization activities and collaboration with individual countries in the EU.

20. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. RobotEra Title Implementation and integration of advanced Robotic systems and intelligent Environments in real scenarios for the ageing population FP7-ICT Representative Organization SSSA Period 2012.1 – 2015.12 Overview An initiative aimed at actual deployment of advanced robot services in society: development, implementation, and demonstration of services related to effective elderly care and supporting independence, evaluating scientific and technological effectiveness and using surveys to investigate acceptance of these technologies in society. Merit of collaboration to advance the development of technology for home care and independence support for the elderly, this proposal combined with our technology will cover everything from independent living to group care facilities, and efficient development of tele-care support technologies.

21. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. RobotLaw Title Regulating Emerging Robotic Technologies in Europe: Robotics facing Law and Ethics FP7-ICT Representative agency SSSA Period 2012.3 – 2014.2 Overview To conduct surveys and discussion of ethical issues and necessary legislation regarding the introduction of robotic and bio-robiotic technology into society, particularly focusing on robots that interact with people, and to consolidate the results into a proposal to the EC.

22. Copyright (C) 2013 ATR, Kyoto, JAPAN All rights reserved. SRS Title Multi-Role Shadow Robotic System for Independent Living FP7-ICT Representative agency Cardiff Univ. Period 2010.2 – 2013.1 Overview: The objective of this project is the development of prototype teleoperation and semi-autonomous robot solutions to support home care for elderly people living alone Surveying customer needs and implementing systems to address them.