2. Interactive Visualisation of Sound Objects Visualise: (vb) to form a mental image or vision ofVisualise: (vb) to form a mental image or vision of Cognitive abilityCognitive ability Allows us to internalise dataAllows us to internalise data –Gain insight and understanding Internal Map = Cognitive ModelInternal Map = Cognitive Model 5 basic approaches Indentation Node-link diagrams Containment ClusteringGeographic

3. Visualisation Techniques / Methods Indentation Tree controlTree control FisheyeFisheyeContainment TreemapsTreemaps ZUI’sZUI’sIndentation Tree controlTree control FisheyeFisheyeContainment TreemapsTreemaps ZUI’sZUI’s Clustering Galaxy of NewsGalaxy of News ThemeScapeThemeScapeGeographic Floor plansFloor plans Street mapsStreet mapsClustering Galaxy of NewsGalaxy of News ThemeScapeThemeScapeGeographic Floor plansFloor plans Street mapsStreet maps Node-link diagrams 2D diagrams2D diagrams Cone TreeCone Tree Fisheye Cone TreeFisheye Cone Tree Hyperbolic viewerHyperbolic viewer XML3DXML3D Node-link diagrams 2D diagrams2D diagrams Cone TreeCone Tree Fisheye Cone TreeFisheye Cone Tree Hyperbolic viewerHyperbolic viewer XML3DXML3D

4. Sonic Browser Interface

5. Sonic Browser Psychophysical VisualAuditory Actions Cataloguing VisualAuditory Actions

6. Tool for Psychophysics Conduct simple experimentsConduct simple experiments –Based on a psychophysic scaling –1 to 4 dimension comparison of sounds (X,Y, Shape, Colour) –Supplements traditional discrimination methods by providing both increased participant motivation The scaling of the natural sounds vs. the model soundsThe scaling of the natural sounds vs. the model sounds –Do they scale? –Might validate sound models in relation to recordings of real sounds Psychophysical Visual Encoding Auditory Encoding Actions Bouncing BallsBreaking Glass

7. Tool for Cataloguing Utilise traditional IR methods such asUtilise traditional IR methods such as Indexing and FilteringIndexing and Filtering –Controlled by text filters of meta information and by alphasliders –Controlled by text filters of meta information and by alphasliders of sound properties Combine Sound Retrieval methods such asCombine Sound Retrieval methods such as –Automatic classification & clustering among several possible AIR methods –Cue points analysis and browsing of sound resources –Supplement with results of psychophysical scaling Cataloguing Visual Encoding Auditory Encoding Actions

8. Domain/Task Focus Work is user-centered informed by ethnographyWork is user-centered informed by ethnography Trying to understand how real people might work with sound objectsTrying to understand how real people might work with sound objects –E.g. Foley artists, composers, HCI designers simplify user navigation to sound objectssimplify user navigation to sound objects find and manipulate sound objectsfind and manipulate sound objects design visual aspectsdesign visual aspects design auditory aspectsdesign auditory aspects evaluate effectiveness & quality of use with respect to real working contextsevaluate effectiveness & quality of use with respect to real working contexts

9. My SOHO Objectives Perform a pilot experiment 3-5 participants comparing natural sounds versus sound models in psychophysics scenarioPerform a pilot experiment 3-5 participants comparing natural sounds versus sound models in psychophysics scenario Investigate results and use this to complement future work on sound modelsInvestigate results and use this to complement future work on sound models Gain insight and feedback from participants on current and future dimensions to this researchGain insight and feedback from participants on current and future dimensions to this research Provide a roadmap for the production of a tool which will be used to navigate sound model collectionsProvide a roadmap for the production of a tool which will be used to navigate sound model collections

10. Grey Areas / Dimensions How to map the parameters from the Sonic Browser to the Pure Data models in real time?How to map the parameters from the Sonic Browser to the Pure Data models in real time? How to do this for multiple models or model instances simultaneous (as when under the Aura)?How to do this for multiple models or model instances simultaneous (as when under the Aura)? How to catalogue dynamic models such as the impact model with multiple variable parameters?How to catalogue dynamic models such as the impact model with multiple variable parameters?