1. School of something FACULTY OF OTHER Facing Complexity Using AAC in Human User Interface Design Lisa-Dionne Morris School of Mechanical Engineering l.d.morris@leeds.ac.uk Communication Matters Conference 2011 26 September 2011

2. Project aims The aim of this individual part of the project was to design and develop an improved human user interface. The objective was that the interface worked with the operational procedures associated with a NEWLY DESIGNED electronic appliance used for dispensing medication. Technology Users Compliance Palliative Care Socio-Technical System Cognitive and Intellectual decline

3. Project theme The theme is Facing Complexity with a focus on how to face the complexity of human interaction with new and emerging objects and technological systems. Following the theme of Donald A. Norman's latest book, where the paradigm of simplicity is questioned in relations to the design of human user interfaces. In user interface design, the risk is to make interaction unmanageable, in which complexity can appear suddenly, catching people by surprise.

4. Existing units

5. 2 versions of COMPLEXITY Humans want DEVICES to enable CHOICE. We need levels of complexity we do not want confusion. We need understandable devices and User Interface and Produce Designers need to understand how DIFFERENT HUMANS think. X Confusion, Frustration, Disorder Cognitive Complexity Perceptual Complexity

6. The final unit

7. Interface Design

8. Research scope (AAC) -Makaton Vocabulary Language Programme -Signs -Symbols -Spoken Word User Interface Design -Mediated communication - interaction design Humans -Thinking Process Skills -Cognitive capabilities

9. Argument Implementation and utilisation of Makaton Vocabulary Language Programme, a system of alternative and augmentative communication (AAC), might provide principles and procedures for technology enhanced learning for users with reduce cognitive and intellectual capabilities, this might offer a design intervention technique that was appropriate for people with reduced cognitive capabilities thus, providing a more sustainable interface.

10. Literature review on complexity User Interface RecognitionExplorationDiscovery

11. Human-Machine Loop In a very simple way, the human-machine loop has been associated with concepts such as speed, accuracy and integrity in the flow of information round the human-machine loop Pheasant (1986). The typical modality pattern is of sight as the primary input/receptive mode, and movement and sight as the primary output/expressive mode. The focus of this particular view is human computer interaction through a graphic user interface. Human Machine Displays Controls

12. Accessibility channel Receptive Mode (Input) The display gives visual support and prompting and provides objects of reference plus auditory clues for interaction Machine Human Displays Controls Expressive Mode (Output) Access controls are predominately symbol and text solutions plus audio re- enforcement

13. Reduced cognitive and intellectual skills Visuo-motor With this in mind, input (receptive) language and output (expressive) language is a less dominate trait in cognitive and intellectual impairment Romski et al (1997) and information- processing in the brain is best stimiuateld by sight and movement Barrie (1997) Perception Maximum possible distinction between visual language items and recognition of language structure based on an operator’s linguistic codes Walker et al. (1985) Semantic-symbolic Thus, the semantic- symbolic complexity is reduced if the chosen semantic- symbolic parameters include certain key semantic relationships, commonly expressed in early learnt language of an operational procedure Lahey et al. (1997). Three basic complexity parameters associated with reduced cognitive and intellectual skills

14. Definition of access control capabilities Access Control Capabilities and Communication Channels used by Operators with Cognitive and Intellectual Difficulties Operators demonstrate intentions by feeling and looking at user interfaces and by seeking verbal re-enforcement of the task. Successful interaction may use touch, sight and audio communication channels. To support access of an operational user interface designers must consider the use of appropriate size, colour and style of receptive and expressive language. Also, consider the use of touch, sight and verbal operational and sequence re-enforcement to make choices.

15. The total design process

16. Interface design

17. Interface design for patient and personal helper

18. Findings The implementation of verbal audio features supported the content of the screen, which enhances user’s cognitive processing. The implementation of animated or dynamic elements enhanced the ‘static’ interface. User preferences and language defined at the beginning of the design process, reduced the overall navigational elements of the interface

19. Reducing complexity Visual support such as, prompting objects of reference and auditory clues needed for receptive modes. Receptive language should combine visual clue such as colour or flashing lights to indicate the next operational procedure. A linear operational sequence indicates next operational procedures. Symbol and text solutions plus audio re-enforcement of operational sequence needed to support expressive modes. Additional, alternative or adaptive access channels may be required.

20. Further work

21. School of something FACULTY OF OTHER Facing Complexity Lisa-Dionne Morris School of Mechanical Engineering l.d.morris@leeds.ac.uk Thank you! Any questions?