Unconventional User Interface // // Mood Based Navigation Sheo // 1Haring, Naderer, Zachhuber Mood Based Navigation Shoe Roland Haring Otto Naderer Doris Zachhuber Matthias Kranz Unconventional User Interaction VO UE

Unconventional User Interface // // Mood Based Navigation Sheo // 2Haring, Naderer, Zachhuber Mood Based Navigation Shoe  Navigation system for pedestrians  Intended use in urban environments  Input: the user‘s current emotional state  To find other users who feel the same  To find an activity which fits the mood.  Output: LED-integrated shoe  Indicates the heading

Unconventional User Interface // // Mood Based Navigation Sheo // 3Haring, Naderer, Zachhuber Components  Server  Handles all clients  Does „mood matching“  Client  Ultra Mobile PC (UMPC)  Provides GUI to enter the current mood  Maintains connection to server  Features GPS receiver  Controls and powers the Arduino board  Arduino Board  Small programmable board (USB interface)  Controls LEDs  Programming e.g. in „Processing“ (JAVA)  Shoes  Integrated cross-shaped LED setup  Connected to Arduino‘s outputs  Direct user (left, right, back, forth)

Unconventional User Interface // // Mood Based Navigation Sheo // 4Haring, Naderer, Zachhuber Further Information / Project Site  Paper  Extensive information about the project  Explains every aspect more detailed  Available at our website  Website  Hosted on GoogleCode  At:  Supports subversion  Read-only access for „anonymous“  Sources and installers available

Unconventional User Interface // // Mood Based Navigation Sheo // 5Haring, Naderer, Zachhuber Arduino  Open Source Project (HW u. SW)  Analog und digital I/Os  USB-Interface for communication with the PC  Programming in C++ with Wiring Framework  Java-IDE  Big community  Lots of SW libraries  Lots of HW components  Autonomous usage via battery possible  Distribution  Mainly used among architects and media artists  12 distribution partners in Europa  Lots of clones 

Unconventional User Interface // // Mood Based Navigation Sheo // 6Haring, Naderer, Zachhuber Arduino Duemilanove MicrocontrollerATmega168 Operating Voltage5V Input Voltage7-12V Input Voltage (limits) 6-20V Digital I/O Pins14 Analog Input Pins6 DC Current per I/O Pin 40 mA Flash Memory16 KB SRAM1 KB EEPROM512 bytes Clock Speed16 MHz  Newest USB-Board of Arduino  $35 at Sparkfun  Hardware-Design available for free  Atmel ATmega168  USB to Serial Converter  Quarz-Oscillator  Multi-Pin Connector  Power supply USB or Battery/Power Adapter  PWM: 3, 5, 6, 9, 10, and 11. Provide 8-bit PWM output with the analogWrite() function Arduino NG  No built-in LED connected to digital pin 13  Atmel ATmega168 or ATmega8

Unconventional User Interface // // Mood Based Navigation Sheo // 7Haring, Naderer, Zachhuber Atmel ATmega168  RISC Processor  Power: 3,5µW – 45mW (bei 5V und 16 MHz)  Harvard Architecture  Memory  16KB Flash (Program + Data)  1KB SRAM (Data)  512Bytes EEPROM  16MHz Clock Frequency  23 GPIO Pins  6 PWM Outputs  6 Analog Inputs(10 Bit ADC-Converter)  2x 8-Bit Timer  1x 16-Bit Timer  Bus Interfaces  USART  SPI (Master)  I2C (Master/Slave)  Watchdog Timer

Unconventional User Interface // // Mood Based Navigation Sheo // 8Haring, Naderer, Zachhuber Duemilanove Accessories TouchShield XBee ShieldStepper Motor Control Ethernet Shield GPS ShieldSensoren / Aktuatoren

Unconventional User Interface // // Mood Based Navigation Sheo // 9Haring, Naderer, Zachhuber Sampe Project Ardrumo  MIDI drums  Self construction $53  Piezo elements for pressure sensitive sensors  Arduino-Board  A/D-Convertion of signals  Data transfer via USB  Only 14 lines of code!

Unconventional User Interface // // Mood Based Navigation Sheo // 10Haring, Naderer, Zachhuber Arduino LilyPad – Main Board Wearable E-Textile Technology developed by Leah Buechley [  Designed in cooperation with Spark Fun Electronics  Sewing on and washing of clothes possible  ATmega168V with Arduino Bootloader  Lots of accessories available(Input, Output, Power, Sensor und Actuator-Boards)  Dimensions:  50mm outer diameter  Thickness 0,8 mm MicrocontrollerATmega168V Operating Voltage V Input Voltage V Digital I/O Pins 14 (of which 6 provide PWM output) Analog Input Pins6 DC Current per I/O Pin 40 mA Flash Memory 16 KB (of which 2 KB used by bootloader) SRAM1 KB EEPROM512 bytes Clock Speed8 MHz

Unconventional User Interface // // Mood Based Navigation Sheo // 11Haring, Naderer, Zachhuber Arduino LilyPad – Accessories LilyPad Accelerometer 20 mm Ø, $24.95 LilyPad Bright White LED 6 x 11 mm, $ 1.95 LilyPad Button Board 8 x 16 mm, $ 1.50 LilyPad Buzzer 20 mm Ø, $ 7.95 LilyPad Tri-Color LED 20 mm Ø, $7.95 LilyPad Vibe Board 20 mm Ø, $14.95 LilyPad USB Link 0.9x1.25", $14.95 LilyPad Temperature Sensor 20 mm Ø, $ 4.95 LilyPad Power Supply AAA battery (1.2 – 5V) 56 x 26 mm, $14.95 LilyPad LiPower Supply Lithium Polymer battery (5V) 20 mm Ø, $14.95 Conductive Thread 117/17 2ply, 234/34 4ply, $19.95 LilyPad Light Sensor 20 mm Ø, $7.95 LilyPad Extensions: Bluetooth (siehe Abb.) Data-Logging

Unconventional User Interface // // Mood Based Navigation Sheo // 12Haring, Naderer, Zachhuber Leah Buechley – Turn Lights for Bikers  Buttons on the sleeve cuffs  Lights  LEDs

Unconventional User Interface // // Mood Based Navigation Sheo // 13Haring, Naderer, Zachhuber Arduino – Programming  Java IDE „Processing“  MIT-Project  Programming in C++  GNU Compiler  Simple Projects  Wiring Library abstracts Hardware  User has to implement setup and loop  Setup is called once  Loop is called cyclic  Only one file with source code per project (Sketch)  One control flow  No Interrupts  Many additional libraries from community  ~ 30 on  Stepper Motor Control  Soft-UART  LCD  Etc.  „Printf“-Debugging  Bootloader allows Flash-Programming via USB

Unconventional User Interface // // Mood Based Navigation Sheo // 14Haring, Naderer, Zachhuber Prototype – 2 Shoes Components:  4 green LEDs (front, right, back, left)  4 resistors (150 Ω)  Connector pins for every LED and GND (5V)  Arduino digital pins  USB cable to PC/PDA

Unconventional User Interface // // Mood Based Navigation Sheo // 15Haring, Naderer, Zachhuber Client - Server Architecture MBS Server MBS Client Position Update Mood Update Cancel Navigation (LED) Update Statustext Update

Unconventional User Interface // // Mood Based Navigation Sheo // 16Haring, Naderer, Zachhuber Mood / Activity Matrix 0 … not 1 … neutral 2 … little 3 … much

Unconventional User Interface // // Mood Based Navigation Sheo // 17Haring, Naderer, Zachhuber Matching Algorithm float Mood::getMatch(Mood &other) { float match = 0.0f; float cnt = 0.0f; for (int i=0; i<=MAX_MOOD_INDEX; i++) { if (other.getVal(i) == NEUTRAL || getVal(i) == NEUTRAL) { continue; } cnt++; float diff = abs((float)other.getVal(i) - (float)getVal(i)); const float MAX_DIST = 3.0f; match += 1.0f - diff / MAX_DIST; } match /= cnt; return match; } Threshold: 0.75

Unconventional User Interface // // Mood Based Navigation Sheo // 18Haring, Naderer, Zachhuber State Transition Diagram

Unconventional User Interface // // Mood Based Navigation Sheo // 19Haring, Naderer, Zachhuber Server C++ win32 OpenGL OSM Karte

Unconventional User Interface // // Mood Based Navigation Sheo // 20Haring, Naderer, Zachhuber Server Configuration

Unconventional User Interface // // Mood Based Navigation Sheo // 21Haring, Naderer, Zachhuber Client C++ win32 MFC

Unconventional User Interface // // Mood Based Navigation Sheo // 22Haring, Naderer, Zachhuber Client Configuration localhost

Unconventional User Interface // // Mood Based Navigation Sheo // 23Haring, Naderer, Zachhuber Sources All sources available at