Presentation is loading. Please wait.

Presentation is loading. Please wait.

Locative Media. Digital media with a sense of place, embedded into the real physical world Locative Media Can You See Me Know? grafedia.net.

Similar presentations


Presentation on theme: "Locative Media. Digital media with a sense of place, embedded into the real physical world Locative Media Can You See Me Know? grafedia.net."— Presentation transcript:

1 Locative Media

2 Digital media with a sense of place, embedded into the real physical world Locative Media Can You See Me Know? grafedia.net

3 Pervasive gaming: world as a game-board Space annotation: media with a specific position in space Location awareness & GPS-enabled locative media Mobile music & locative audio Social spaces etc Locative Media Can You See Me Know? grafedia.net

4 Mobility as creative act Creative use of public space Aesthetic Urban Practices Origins

5 Aesthetic Urban Practices Graffiti 3D, ephemeral, transient, layers... Origins

6 Reclaim the streets Walking situationist dérive, psycho-geography aboriginal walkabouts Aesthetic Urban Practices Origins

7 Aesthetic Urban Practices Urban sports: skateboarding parkour >> urban space as resource for aesthetic movements Origins

8 Mark Weiser’s vision (1991) –disappearing computer –everyday world literally used as interface away from desktop settings, available at hand in the real world: where needed, “where the action is” “The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it.” (Weiser) Ubiquitous Computing Origins

9 Implementing the vision –Mobile devices combined with computers embedded in the environment –Awareness of physical & social context + each other >> Mapping the digital world onto the physical one >> User interface: tangible and embedded in the real world Ubiquitous Computing Origins

10 Technologies –context awareness –mobile computing –tangible interfaces –social navigation –embedded sensor networks –global positioning –wearable computing –augmented & mixed-reality –ad hoc and p2p user networks –etc Ubiquitous Computing Origins

11 Examples –“walk-up-pop-up” –wearables –ambient displays –intelligent work environments –augmented, interconnected everyday objects –etc Media cup, TecO Ubiquitous Computing Origins

12 Everyday physical world: not designed for the purpose of these new activities offers a rich and heterogeneous variety of engaging interaction situates them in cultural and social context, with existing web of meaning more than a setting, a resource for computer-mediated aesthetic interaction >> Everyday activities as basis for interaction + everyday physical real world as interface Ubiquitous Computing Origins

13 Audio, positioning, mobile-telephony Mobile phone, Bluetooth, iPod, Zune, cameraphones, GPS-mobiles, RFID tags, 2D Barcodes, etc Smart phones SDK (>> programmable) –devices always at hand –user always “on-line” –all of your music with you at anytime Consumer Electronics Origines technologiques

14 Can You See Me Know? Blast Theory + Equator Pervasive Computing: The world as game-board Botfighters and Pirates! Backseat Gaming Can You See Me Now? iPerG... Pervasive Gaming Projects

15 SPACE ANNOTATION: media with specific position in space Examples: –Virtual: Geonotes, Urban Tapestries –Physical: Yellow Arrows, Grafedia grafedia.net Yellow Arrow, Count Media Space Annotation Projects

16 GPS-drawing Non-linear narratives Tracking and mapping paths Hundekopf, knifeandfork Drift, Teri Rueb Biomapping, Christian Nold GPS & Positioning Projects

17 SOCIAL SPACES: connecting people in public space Hummingbirds Jabberwocky MobiTip Familiar strangers, Intel Research Social Computing Projects

18 Audio space annotation Mobile music sharing/listening: - distributed - ad hoc - sound walks Mobile music making: - situated - collaborative Wearable audio Mobile phone as platform for sound-art... Locative Audio Projects

19 Hear&There (Rozier, MIT Medialab, 1999) Locative Audio Audio space annotation

20 Tacticle Sound Garden [TSG] (Mark Shepard, Buffalo Univ ) Locative Audio Audio space annotation

21 Tejp / Audio tags (PLAY & FAL, ) Locative Audio Audio space annotation

22 Tejp / Audio tags (PLAY & FAL, ) Exploring embodied interaction with digital space annotation F.ex: audio tags whispering to by- passers as they approach them, creating a short space of intimacy in public space Locative Audio Audio space annotation

23 Tejp / Audio tags (PLAY & FAL, ) Locative Audio Audio space annotation

24 Tejp / Audio tags (PLAY & FAL, ) Locative Audio Audio space annotation

25 Audio Bombing (Fleming et al., 2007) Sonic Graffiti (C-Y Lee, 2007) Locative Audio Audio space annotation

26 [Murmur] (murmur.ca) Locative Audio Audio space annotation

27 Location 33 (Carter & Liu, USC, 2005) Distributed and located music Locative Audio

28 SoundPryer (Mattias Östergren, Interactive Institute, 2001) TunA (Arianna Bassoli et al., Medialab Europe, 2002) Locative Audio Mobile music sharing

29 Locative Audio Bass Station (Mark Argo & Ahmi Wolf, 2003) Push!Music (Håkansson et al., 2005) Mobile music sharing

30 Drift (Rueb) 34n118w (Knowlton, Spellman, 2002) Craving (Garnicnig, Haider, 2007) Seven Mile Boots (Beloff et al., ) The Case at Kulturhuset (Knifeandfork, 2004) Riot! (Mobile Bristol, Hewlett Packard) Sound walk Locative Audio

31 Seven Mile Boots (Beloff et al., ) Sound walk Locative Audio

32 Bit Radio (Bureau of Inverse Technology) Radio pirates Locative Audio

33 7/11 (New Beginnings, Göteborg) Radio pirates Locative Audio

34 Key Chain Radio Station (Rikako Sakai, Ivrea, 2004) Radio pirates Locative Audio

35 Sonic City (Gaye et al., FAL & PLAY, ) Sound Lens (Toshio Iwai, Tokyo Univ.) Solarcoustics: CONNECT (Barnard, ITP/NYU, 2005) Situated music making

36 Locative Audio Sonic City (Gaye et al. FAL & PLAY, ) Mobile music making with the city as interface: Creating a real-time personal soundscape of electronic music by walking through and interacting with urban environments Situated music making

37 Locative Audio Sound Mapping (video) (Mott et al., Reverberant, 1997) Sonic Interface (Akitsugu Maebayashi, 1999) Warbike (McCallum, ) Skatesonic (video) (van Toder, 2006) Situated music making

38 Locative Audio ImprovE (video) (Wideberg & Hasan, 2006) CosTune (Nishimoto et al., ATR, 2001) Malleable Mobile Music (Atau Tanaka, Sony CSL, 2004) Collaborative mobile music making

39 Locative Audio China Gates (Clay, Majoe, 2006) Sequencer404 (Hatcher, Jimison et al., 2006) Cellphonia (Bull et al, 2006) Collaborative mobile music making

40 Locative Audio Nomadic Radio (Shawney, MIT Medialab, 1998) Sonic Fabric (Alice Santaro, 2002) Wearable audio

41 Locative Audio ”Personal instruments” (Krzysztof Wodiczko, 1969) (Chelle Hugues, RCA/CRD, 2000) Wearable audio

42 Locative Audio Robotcowboy (Wilcox, 2007) Hearing Sirens (Cathy van Eck, 2007) Wearable audio

43 Kadoum (Waagenaar, 2000) Dialtones. A Telesymphony (Levin, 2001) Pocket Gamelan / Mandala (Schiemer, Havryliv, 2006) Egotone (I. Lee, 2007) Locative Audio Mobile phones as platforms

44 Locative Audio CaMus (Rohs, Essel, Roth, 2006) TRATTI (Beloff, Pichlmair, ) Intelligent streets (Sonic Studio & Univ. of Westminster, 2004) Mobile phones as platforms

45 Locative Audio Output Output: Headphones vs boombox vs using everyday objects SoundbugTM speakers & piezos Flower Speakers (LET’S corporation, Japan, 2004)

46 Interactions happening anywhere, on the move : taking advantage of the mobile setting: playing with social and geographic dynamics implied by mobility >> outdoors everyday space, location and social context becoming resources for interaction as you move through space >> spontaneous & situated collaboration with people around or distributed across the city Interaction Properties Locative media

47 Interactions happening anywhere, on the move becoming embedded in the physical and social context of everyday life >> people managing interaction in heterogeneous context >> and in simultaneity with other activities (crossing a street... waiting for the bus...) Interaction Properties Locative media tunA, Bassoli et al, Medialab Europe, 2002

48 User-authored content spread across public space: raises questions about –property of information –privacy & surveillance –spamming? Augmenting environments and supporting activities with embedded computation: what if it changes what makes things what they are? If ubicomp spreads into public space, according to whose will? Top-down corporations, government vs bottom-up citizens, communities? Conflicts of interests? Questions Locative media

49 User control (Greenfield): How do you know you are interacting with a computer if invisible? How do you protect your privacy? avoid false commands? How do you know where to look for interaction? How to query/notify presence, access, place, manipulate media? How is the place? Who is there? What activities are going on there? How mobile is/are the user(s)? What meaning do the place, activities, and things around have and for whom? Questions Locative media

50 Ubicomp vs pervasive computing: at hand when needed vs always on everywhere Connect physical and virtual world: technical and HCI issue but also sociological, aesthetic, even political and environmental. F.ex. Yellow Arrow vs Geonotes: –physical vs virtual markers –Graffiti style interaction vs screen-based Questions Locative media

51 Enabling technologies Available to General Public

52 Mobile peer-to-peer Tracking, positioning and placement Sensing and data-processing Content creation and manipulation Enabling Technologies Available to the General Public

53 * Server-Client * Mobile peer-to-peer: –Bluetooth –WiFi –Infrared Enabling Technologies Available to the General Public

54 * Bluetooth Standard communication protocol for wireless personal area network (PANs) Connect and exchange information (commands, files) between devices Microwave radio frequency -> non-directional Short range (power-class-dependent: m) Use: BluetunA, bluejacking, Nokia’s Digidress Enabling Technologies Mobile Peer-to-Peer

55 * WiFi Wireless local area network Radio, non-directional Internet and VoIP phone access, network connectivity for for consumer electronics, etc Connect to local access points Server-client vs ad hoc networks Enabling Technologies Mobile Peer-to-Peer

56 * Phones vs Wifi-enabled PDAs Connectivity: closed/open network vs operators Cost Range Distributed vs ad hoc vs server-client Compatibility Programmability: SDK, OS Memory, speed Enabling Technologies Mobile Peer-to-Peer

57 * Platform: Opentrek Peer-to-peer networking platform specifically designed for Wireless Ad Hoc Networks Cross-platform! Ad hoc networking -> collaborate Enabling Technologies Mobile Peer-to-Peer

58 * Tracking, positioning and placement –Phone cells –WiFi hotspots –GPS –Virtual media –Physical markers: 2D barcodes, RFID, user ID to phone Enabling Technologies Available to the General Public

59 * Global Positioning System (GPS) 30 geo-stationary satellites -> location, speed, direction, path Shadows, accuracy Use: CYSMN?, GPS drawing, Drift GPS-enabled phones, PDAs Platform: Geotracing Enabling Technologies Tracking, Positioning and Placement

60 * Geotracing Enabling Technologies Tracking, Positioning and Placement

61 * Placing media: socialight.net In-place and remote annotation with smart-phone /PDA social network community sound, text, images, video google maps + GPS Enabling Technologies Tracking, Positioning and Placement

62 * RFID Radio-frequency identification Storing and remotely retrieving data Storage & processing + antenna Physical markers Tagging objects Range: 5-20cm Passive (powered by inductivity when used) vs active RFID Enabling Technologies Tracking, Positioning and Placement

63 * RFID –Uses: –Passports –Transport payments –Product tracking –Automotive –Animal identification –RFID in inventory systems –Human implants –RFID in libraries Controversy: privacy issues. Shielding? Enabling Technologies Tracking, Positioning and Placement

64 * 2D barcodes QR (Quick Response) code, Datamatrix code, etc Physical markers Can store between one and 500 characters Tag objects, places Scan with cameraphones -> hyperlink (physical mobile interaction) How to: Kaywa reader + generator: Enabling Technologies Tracking, Positioning and Placement

65 * Unique ID to phone Physical markers with unique IDs Tag objects, places Send number to server -> store & retrieve media Arrows available, but not ID generator Enabling Technologies Tracking, Positioning and Placement

66 * Sensing: –sensors –data processing: microcontrollers Enabling Technologies Available to the General Public

67 * Micro-controllers Basic Stamp II, Basic X – 24 Tutorial: Arduino –open source hardware physical computing I/O platform –cheap (20 Euro) –easy (Processing) –assemble yourself –stand-alone or connect to computer (MAX/MSP, etc) –www.arduino.cc Enabling Technologies Sensor Data Processing

68 * Creating and manipulating content: –Mobile Processing –Python –J2ME –miniMIXA –PdA (Pd on PDAs, linux) –Keyworx Enabling Technologies Available to the General Public

69 * Mobile Processing Open source programming environment for design and prototyping software for mobile phones. Similar to Processing environment. Runs on Java powered mobile devices. Bluetooth -> communication Control example: attach light sensor on screen so sending info from phone to laptop Enabling Technologies Creating and Manipulating Content

70 * MiniMIXA Commercial DJ software for mobile phones, PDAs * Keyworx Multimedia platform (base for GeoTracing f.ex.) * PDa (Puredata anywhere): Pd for Linux on PDAs Enabling Technologies Creating and Manipulating Content

71 * Python PyS60 Interactive object-oriented language Nokia S60 phones and more Record, playback, play MIDI notes, control MAX/MSP patches... PyS60: and Tutorial (Jürgen Scheible - Mobilenin) Enabling Technologies Creating and Manipulating Content

72 3 rd party software (Java, etc) Hacking hardware: use camera, microphone, speakers, audio out... Enabling Technologies Hacking mobile phones


Download ppt "Locative Media. Digital media with a sense of place, embedded into the real physical world Locative Media Can You See Me Know? grafedia.net."

Similar presentations


Ads by Google