1. Thuong Hoang Supervisor: Prof. Bruce Thomas Wearable Computer Lab School of Computer and Information Science In-situ Model Refinement and Hands-free Interaction Techniques for Outdoor AR ngocthuong@gmail.comBruce.Thomas@unisa.edu.au

2. Contents Literature review Research question Contributions Conclusion

3. Literature review Surveying current research in the field of Augmented Reality

4. Augmented Reality (AR) Immersively supplement real world with virtual information, using Head-mounted display.

5. Tinmith Wearable outdoor AR system Backpack computer Immersive head mounted display (HMD) State-of-the-art wearable outdoor immersive AR system

6. Menu system Pinch glove menu for command executions

7. Applications ARQuake X-Ray Vision ARWeather

8. Applications Modelling Infinite planes Place existing models

9. Limitations ModellingInteraction Coarse modelling, no support for details Simple model Pinch glove menu system Require both hands Occupied screen space at all times

10. Modelling in AR BenefitsChallenges In-situation contextual information Instantaneous verification and visualisation of models Limitations in input devices Lack of methods for sampling real world artefacts

11. Interaction AimsChallenges Menu system Hands-free Unobstrusive Input devices or interaction techniques Visualisation

12. Research Question What is the most suitable techniques to assist modelling tasks perform hands-free menu interaction in outdoor augmented reality?

13. Contribution Offering the solutions to the research questions

14. Technique for model refinements

15. Laser rangefinder Imaged-based reconstruction (Sequeira et al. 1999) ‘Left: Automatic capture robot Right: Mesh model of environment

16. Virtual pointer Orientation sensor + Laser rangefinder

17. Modelling refinements - Laser Rangefinder Use of laser rangefinder for AR modelling

18. Benefits Other 3D scanner methodsCurrent Tinmith Selective modelling Only model the required part Different density No post processing Models are created using triangulation. No off-site processing Small, high detailed feature. Complex polygonal models Depending on the triangulation algorithm used

19. Technique for hands-free interaction via a menu system

20. 3D Menu Ring menu (Liang & Green 1993) Spin menu (Gerber & Bechmann 2005)

21. Walkin’ Menu 3D menu items placed within the environment Activate by looking down Execute by stepping onto menu item

22. Benefits Hands-free Tracking user position, step on menu to activate Unobtrusive Constructed on demand Part of the environment Multi-purpose Command execution Textual and image display

23. Publications Hoang, TN, and Thomas, BH 2009, “In-situ refinement techniques for outdoor geo- referenced models using mobile AR”, to appear in Proceedings of the 10 th International Symposium on Mixed and Augmented Reality” (ISMAR2009), Orlando, USA, October 2009. Hoang, TN, Porter, SR, Close, B, and Thomas BH 2009, “Web 2.0 meets augmented reality”, in Proceedings of the Thirteenth International Symposium on Wearable Computers (ISWC2009), Linz, Austria, pp 151-152. Hoang, TN, Porter, S, and Thomas, B 2009, “Augmenting image plane AR 3D interactions for wearable computers”, Proceedings of the Tenth Australasian User Interface Conference (AUIC2009), Wellington, New Zealand. Hoang, TN 2009, “Augmented reality in-situation menu of 3D models”, Proceedings of the 3 rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide. Hoang, TN 2009, “Augmenting reality 3D interactions for wearable computers”, Proceedings of the 3 rd Int’l Workshop on Ubiquitous Virtual Reality (IWUVR2009), Adelaide. Hoang, TN and Thomas, B 2008, “Augmented reality In-situ 3D model menu for outdoors”, Proceedings of the 7 th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR2008).

24. Conclusion Techniques for: Model refinements using an orientation-sensed single-point laser rangefinder Hands-free interaction via walkin’ menu

25. Disclaimer The contents of this presentation should only be viewed in conjunction with the minor thesis document to be published online from 26 th October 2009, at http://www.cis.unisa.edu.au/wiki/Hoang-minorthesis