1 City With a Memory CSE 535: Mobile Computing Andreea Danielescu Andrew McCord Brandon Mechtley Shawn Nikkila

2 Final Introduction Expanding previous project Building with a Memory –interactive piece to promote community awareness –CCTV camera for motion analysis –one monitor and two light panels Want to distribute building to city –multiple locations –multiple modalities –mobile abilities Expansion is desirable –community involves more than just one location –multiple modalities increases accuracy and abilities –mobility increases range of sensing and interaction Global reflection capable –mobility is key

3 Challenges Choosing appropriate sensing modalities –video, audio, GPS, and force Fusing modalities properly –analyze separately and combine on server Generating useful feedback –combined video with audio as visual display Preserving privacy –anonymity through abstraction Going mobile –Android mobile smart phone audio, GPS, and force sensors sampled sparingly minimal overhead in analysis feedback dictated by server no unique identifier stored/associated with data

4 Design Porting from local to networked –original installation expansion Develop networking protocol –server-client Visualization updated –mobile application required –tiered based on user selection Mobile application –gather and analyze sensor data –report features to server –receive and display activity data

5 Implementation Server –receive data features from clients –fuse data and analyze for activity sound activity merged with itself force activity merged with optical flow mobile aggregated and used for global only weighted mobile vs. static –send display information to clients Client (mobile application and installation) –sense (collect sampled data) –analyze (obtain features) –send (data features) –receive (display parameters)

6 Implementation Sensing Data –all data is collected independently –analyses done for basic features –data sent on fixed regular interval –data “snapped” to closest building Visualization –tiered global: all buildings shown with their aggregate activity building: all rooms shown with their aggregate activity room: pixilated installation activity screen –abstract squares represent activity movement mapped to color –low {white, blue, green, yellow, orange, red, violet} high sound mapped to size

7 Data and Analysis Future user study plans –comprehensive user study left as future work time constraints –month-long study with many participants using mobile application –users split into groups based on visualizations available specific granularity available all levels available textual data (no levels) –time using application and/or particular visualization recorded –experiment conducted during semester students/faculty/staff using the spaces times of high activity

8 Discussion/Conclusions We would like to see that –adding modalities helped activity accurately measured and appropriately displayed more modalities could improve further remove sensing restrictions –adding mobile aspect expanded project mobile application not terribly intrusive or taxing networking effectively creates activity sensor network mobile data can quickly become a problem network issues with connectivity loss of resolution in data –community was enhanced project successfully brings awareness to community inspired by community

9 City With a Memory CSE 535: Mobile Computing Q&A