2. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 1 Perceptual effectiveness of auditory icons Mikael Fernström, Eoin Brazil, Mark Marshall, Breege Moynihan Interaction Design Centre, University of Limerick, Ireland

3. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 2 Background Button sounds Liquid sounds More Everyday sounds Application Development

4. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 3 Auditory Icons Today… “Classical” A/Is available on all modern Win/Mac PCs. –works like SonicFinder –Static A/Is… Mostly duplication of visual interface. Few people use their A/Is…. < 5%?

5. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 4 Auditory Icons Today… WinMac Menus Widgets Shortcut keys Background processes System events

6. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 5 State-of-the-art A/Is can substantially enhance work, for example when using short-cut keys. –…. but perhaps only during our experiments? Narrative… Cartoonification…

7. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 6 Sound of a button… Task: Click the buttons in numerical order as fast as possible.

8. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 7 Button Sounds Button down Button up Button slip off Button click OK Button click FAIL Prel. result : sound improves performance by > 10%

9. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 8 Liquid sounds Parameters –Viscosity –Size of vessel –Rate of pouring –Height of pouring Perception & Use –Progress, static and dynamic

10. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 9 Liquid Sounds fill or empty?

11. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 10 Liquid Sounds half full/empty?

12. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 11 Liquid Sounds half full/empty?

13. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 12 Liquid Sounds full/empty completion?

14. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 13 Liquid Sounds half and completely full/empty completion?

15. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 14 Liquid Sounds preliminary conclusion Core ecological robust cues –Size of vessel – size of file –Rate of pouring – actual bandwidth –Height of pouring – speed of host –Viscosity – actual rate of down/upload

16. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 15 Everyday sounds… Test data set of 106 sounds recorded Duration 6-18 s. 39/106 sounds unambiguous!!!!

17. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 16 Making it work… Variety of input devices explored –Force feedback joystick –Polhemus Fastrack 6 DOF gesture sensors –Z-tiles (coming soon to a disappearing computer near you ;-)

18. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 17 Combining Haptics & Sound Exploring the use of interface mechanisms that exploit both haptic and sound senses Artefact: Using a haptic interface to cut through a wooden block (round / square; length, progress?)

19. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 18 Force feedback joystick Microsoft Forcefeedback Pro 2

20. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 19 Platform & Software Windows Platform Software: –DirectInput –Immersion SDK and Immersion Studio

21. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 20 API for Sound Objects How can Sound Objects interact? Using a metal pipe to hit a flat piece of wood…

22. Perceptual effectiveness of auditory iconsThe Sounding Object Workshop @ ICAD2001, Mikael Fernström 21 Future Work Questions / Suggestions ?