Presentation is loading. Please wait.

Presentation is loading. Please wait.

Prof. A. Taleb-Bendiab, talk: Whole Body Interaction Workshop07, Date: 03/06/2014, Slide: 1 Bio-Cybernetic Control for WBI: a birds eye view Prof. A. Taleb-Bendiab.

Similar presentations


Presentation on theme: "Prof. A. Taleb-Bendiab, talk: Whole Body Interaction Workshop07, Date: 03/06/2014, Slide: 1 Bio-Cybernetic Control for WBI: a birds eye view Prof. A. Taleb-Bendiab."— Presentation transcript:

1 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction Workshop07, Date: 03/06/2014, Slide: 1 Bio-Cybernetic Control for WBI: a birds eye view Prof. A. Taleb-Bendiab School of Computing Liverpool John Moores University Bio-Cybernetic Control for WBI: a birds eye view Prof. A. Taleb-Bendiab School of Computing Liverpool John Moores University

2 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 2Outline In the context of the Whole Body Interaction (WBI) In the context of the Whole Body Interaction (WBI) Definitions Definitions Biocybernetics, control, Augmented Reality, WBI Biocybernetics, control, Augmented Reality, WBI Drivers for WBI Drivers for WBI Overview of emerging requirements for WBI, Overview of emerging requirements for WBI, Technical challenges, requirements Technical challenges, requirements State-of-the-art relevant to bio-cybernetics control for WBI including: State-of-the-art relevant to bio-cybernetics control for WBI including: Bio and socio-inspired computational models Bio and socio-inspired computational models ambient intelligence, Autonomic Computing ambient intelligence, Autonomic Computing Middleware Middleware body area sensor and actuator networks, body area sensor and actuator networks, cognitive systems cognitive systems Underpinning technologies, Underpinning technologies, Conceptual frameworks for bio-cybernetics control Conceptual frameworks for bio-cybernetics control Conclusions Conclusions Open questions research challenges relevant to WBI Open questions research challenges relevant to WBI Q&A Q&A

3 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 3 Some Definitions #1 Biological Cybernetics (Bio-Cybernetics) Biological Cybernetics (Bio-Cybernetics) … is the application of cybernetics theory and systemics principles to further our understanding of systems biology … is the application of cybernetics theory and systemics principles to further our understanding of systems biology systemics integrate different levels of information and information processing to understand biological systems integrate different levels of information and information processing to understand biological systems function and development of cellular, multicellular systems, organisms, complex living systems and ecosystems. function and development of cellular, multicellular systems, organisms, complex living systems and ecosystems. [http://www.biological-cybernetics.de/wiki/index.php/Main_Page] [http://www.biological-cybernetics.de/wiki/index.php/Main_Page]http://www.biological-cybernetics.de/wiki/index.php/Main_Page [Source: Wikipedia] [Source: Wikipedia] Cybernetics Cybernetics the study of control and communication in the animal and the machine including: the study of control and communication in the animal and the machine including: organization, information flows, control organization, information flows, control

4 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 4 Some Definitions #2 Augmented Reality: Augmented Reality: …. combination of real world and computer generated data …. combination of real world and computer generated data uses of live video imagery which is digitally processed and "augmented" by uses of live video imagery which is digitally processed and "augmented" by the addition of computer generated graphics. the addition of computer generated graphics. Advanced research includes the use of motion tracking data, etc.., Advanced research includes the use of motion tracking data, etc.., and the construction of controlled environments containing any number of sensors and actuators. and the construction of controlled environments containing any number of sensors and actuators. [http://en.wikipedia.org/wiki/Augmented_reality] [http://en.wikipedia.org/wiki/Augmented_reality] Mixed reality: Mixed reality: refers to the merging of real and virtual worlds to produce new environments and visualisations where physical and digital objects co- exist and interact in real time. refers to the merging of real and virtual worlds to produce new environments and visualisations where physical and digital objects co- exist and interact in real time.virtual worldsvirtual worlds [http://en.wikipedia.org/wiki/Mixed_reality] [http://en.wikipedia.org/wiki/Mixed_reality] Virtual Worlds: Virtual Worlds: … simulated environment intended for its users to inhabit and interact via avatars … … simulated environment intended for its users to inhabit and interact via avatars … [http://en.wikipedia.org/wiki/virtual_world] [http://en.wikipedia.org/wiki/virtual_world]

5 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 5 Socially Augmented Intelligent PICT

6 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 6 Convergence of Real and Virtual Worlds: Second Life Second Life Second Life Virtual Worlds Virtual Worlds hand-held and wearable systems that act as gateways between the real and virtual worlds hand-held and wearable systems that act as gateways between the real and virtual worlds Eyewear, display badges and speakers worn about the neck will allow us to live more fully through our avatars Eyewear, display badges and speakers worn about the neck will allow us to live more fully through our avatars a wearable box that creates a 3D sound field that allows the wearer to hear voices from the virtual world without completely shutting out the real people around him a wearable box that creates a 3D sound field that allows the wearer to hear voices from the virtual world without completely shutting out the real people around him

7 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 7 Vodafone in Second Life More recently Vodafone now allows you to interact with your real phone via a Second Life avatar of the phone More recently Vodafone now allows you to interact with your real phone via a Second Life avatar of the phone The real phone can be answered from within SL The real phone can be answered from within SL Text messages can be sent and received between real-world and SL Text messages can be sent and received between real-world and SL

8 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 8 Sensors that Control Second Life Objects Sending external data into virtual worlds such as Second Life Sending external data into virtual worlds such as Second Life Using Potentiometer the cube can be controlled Using Potentiometer the cube can be controlled

9 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 9 Importance of WBI WBI WBI Interface Interface Transparency and virtualisation Transparency and virtualisation Systems and Processes Systems and Processes Interaction Interaction Behaviour Behaviour Structure/organisation Structure/organisation Affective Affective Sensing and Actuation Sensing and Actuation Co-evolve Co-evolve Technical Requirements Technical Requirements Protocols for WBI Protocols for WBI Standards and legacy systems Programming, Interaction and Control Models Usability Assurance QoS Safety and Security, Etc.

10 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 10 Example: Bio-Cybernetics Control

11 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 11 Virtual Lab

12 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 12 IBM Sensors Link Real and Virtual Sensor data is visualised in real-time Sensor data is visualised in real-time Blue balls with white designs represent active Bluetooth devices Blue balls with white designs represent active Bluetooth devices

13 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 13 The Story so Far #1 State-of-the-art in Situated AmI including; State-of-the-art in Situated AmI including; autonomic software models and architecture, standards autonomic software models and architecture, standards tools and techniques to support tools and techniques to support the design, modelling, analysis the design, modelling, analysis and evolution of autonomic software and evolution of autonomic software Define models for their Define models for their programming, control programming, control interaction models with human and/or other non-AC systems (legacy). interaction models with human and/or other non-AC systems (legacy). Delegation of authority and its adjustment Delegation of authority and its adjustment

14 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 14 The Story so Far #2 Has been informed by a set of design paradigms Has been informed by a set of design paradigms Model-based vs self-organising systems design models Model-based vs self-organising systems design models Top-down vs bottom-up Top-down vs bottom-up Top-down vs bottom-up Top-down vs bottom-up Applying and/or revisiting: Applying and/or revisiting: cybernetic principles cybernetic principles control systems theory, regulation, reward and sanctions control systems theory, regulation, reward and sanctions Decision theory, DAI and CI Decision theory, DAI and CI dynamic planning, deliberative models, ML dynamic planning, deliberative models, ML Middleware support Middleware support self-awareness, reflection and deliberation self-awareness, reflection and deliberation etc. etc.

15 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 15 Research Challenges #1 Conceptual Design and Management models Conceptual Design and Management models … how do we design, build, and evolve such systems so that they can meet givenand evolvingrequirements... … how do we design, build, and evolve such systems so that they can meet givenand evolvingrequirements... Incremental deployment of SAmI capabilities in legacy systems. Incremental deployment of SAmI capabilities in legacy systems. Hot-swapping, Dynamic AOP-based evolution, Interoperation Hot-swapping, Dynamic AOP-based evolution, Interoperation Programming, control and Interaction Models Programming, control and Interaction Models Usability and Interface Usability and Interface Balancing and adjusting governance and autonomy Balancing and adjusting governance and autonomy Social and other requirements Social and other requirements Not covered here Not covered here

16 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 16 Cybernetics: The Viable System Model Beers VSM implements a control & communication structure via hierarchies of homeostats (feedback loops) (1950) Beers VSM implements a control & communication structure via hierarchies of homeostats (feedback loops) (1950) Defines 6 major systems ensure viability of the system Defines 6 major systems ensure viability of the system ImplementationS1 ImplementationS1 MonitoringS2 MonitoringS2 AuditS3* AuditS3* ControlS3 ControlS3 Intelligence S4 Intelligence S4 Policy S5 Policy S5 Offers an extensible, recursive, model-based architecture, devolving autonomy to sub- systems Offers an extensible, recursive, model-based architecture, devolving autonomy to sub- systems Autonomic Systems Cognitive Systems

17 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 17 Situated AmI Capabilities A software system is autonomic, if it possesses the following capabilities: A software system is autonomic, if it possesses the following capabilities: Self-configuring choosing a suitable behaviour, based on user preferences, context, … Self-configuring choosing a suitable behaviour, based on user preferences, context, … Self-tuning choosing behaviours that optimize certain qualities (performance, year-end profits, …) Self-tuning choosing behaviours that optimize certain qualities (performance, year-end profits, …) Self-repairing shifting execution to another behaviour, given that the current one is failing Self-repairing shifting execution to another behaviour, given that the current one is failing Self-protecting choosing a behaviour that minimizes risks (attacks, viruses, …) Self-protecting choosing a behaviour that minimizes risks (attacks, viruses, …)

18 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 18 Our Approaches #1 Related Work: Related Work: IBM blueprint (www-03.ibm.com/autonomic/pdfs/ACBP2_ pdf) IBM blueprint (www-03.ibm.com/autonomic/pdfs/ACBP2_ pdf) An autonomic manager contains a continuous control loop that monitors activities and takes actions to adjust the system to meet business objectives An autonomic manager contains a continuous control loop that monitors activities and takes actions to adjust the system to meet business objectives Autonomic managers learn from past experience to build action plans Autonomic managers learn from past experience to build action plans Elements need to be instrumented consistently, based on open standards Elements need to be instrumented consistently, based on open standards Our model – J Reference Our model – J Reference

19 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 19 Projects in the Networked Appliances Lab. Composition of an Internet of Things Composition of an Internet of Things Infinitely Adaptable Gaming Infinitely Adaptable Gaming Bridging between Physical and Virtual (Demo) Bridging between Physical and Virtual (Demo) Managing 3D Multimedia Streams Managing 3D Multimedia Streams

20 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 20 What It Looks Like

21 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 21 Prototype Implementation Paul Fergus, David Llewellyn-Jones, Amjad Shaheed, Madjid Merabti, Abdennour El Rhalibi, Networked Appliances: Manipulation of 3D Multimedia Streams, Accepted for publication in the 5th IEEE International Consumer Communications and Networking Conference: Workshop on Networking Issues in Multimedia Entertainment, 2008, Las Vegas, USA

22 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 22 Augmenting Frames

23 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 23 Modelling Autonomy Our model Our model Using SSC used to formalizes the behaviour of dynamically changing systems FOL (McCarthy, 1963).. Using SSC used to formalizes the behaviour of dynamically changing systems FOL (McCarthy, 1963).. Support concurrent actions and timing constraints. Support concurrent actions and timing constraints. Each situation can be viewed as a history of previous actions. Each situation can be viewed as a history of previous actions. Action, guards and time can be modelled at deliberation points in an autonomic setting. Action, guards and time can be modelled at deliberation points in an autonomic setting. M. Randles, A. Taleb-Bendiab, Philip Miseldine, Andy Laws, "Adjustable Deliberation of Self-Managing Systems", ECBS 2005: [ppt] M. Randles, A. Taleb-Bendiab, Philip Miseldine, Andy Laws, "Adjustable Deliberation of Self-Managing Systems", ECBS 2005: [ppt]Adjustable Deliberation of Self-Managing SystemsECBS 2005pptAdjustable Deliberation of Self-Managing SystemsECBS 2005ppt Evolving and Adjustable Autonomy Evolving and Adjustable Autonomy Control) via Software governance (Control) via Formal modelling of norms, policies Formal modelling of norms, policies Enactment support – from spec. to code using Neptune language Enactment support – from spec. to code using Neptune language

24 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 24 Programming Autonomic Systems Neptune Meta-Language Neptune Meta-Language Integrated Development Environment: Integrated Development Environment: Miseldine, P., Taleb-Bendiab A. A Programmatic Approach to Applying Sympathetic and Parasympathetic Autonomic Systems to Software Design. to appear in the 2005 International Conference on Self-Organization and Adaptation of Multi-agent and Grid Systems (SOAS2005). Miseldine, P., Taleb-Bendiab A. A Programmatic Approach to Applying Sympathetic and Parasympathetic Autonomic Systems to Software Design. to appear in the 2005 International Conference on Self-Organization and Adaptation of Multi-agent and Grid Systems (SOAS2005).

25 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 25 Conclusions and Future Work Understanding WBI Understanding WBI Interface Interface Transparency and virtualisation Transparency and virtualisation Systems and Processes Systems and Processes Interaction Interaction Behaviour Behaviour Structure/organisation Structure/organisation Affective Affective Sensing and Actuation Sensing and Actuation Co-evolve Co-evolve Address the challenges including: Address the challenges including: Protocols for WBI Protocols for WBI Standards and legacy systems Programming, Interaction and Control Models Usability Assurance QoS Safety and Security, Etc.

26 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 26Acknowledgements Acknowledgements My thanks to All CMS Research Team

27 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 27 Thats the end – so Im off !

28 Prof. A. Taleb-Bendiab, talk: Whole Body Interaction07, Date: 03/06/2014, Slide: 28 Extra Slides …


Download ppt "Prof. A. Taleb-Bendiab, talk: Whole Body Interaction Workshop07, Date: 03/06/2014, Slide: 1 Bio-Cybernetic Control for WBI: a birds eye view Prof. A. Taleb-Bendiab."

Similar presentations


Ads by Google