We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byJessica Ortega
Modified over 3 years ago
TEMPLATE DESIGN © 2008 www.PosterPresentations.com The basic model for a trigonometric setup requires that the HID be seen by at least two cameras at any given time for tracking to work. This experiment consisted of two Nintendo Wii remotes aimed at a common area. The remotes would return the pixel value locations of two infrared LEDs fixed in a horizontal plane on the front of a third Wii remote which would return accelerometer values for pitch . Calculations on these return values find where the Wii remote is pointed on a screen. Practical Infrared Object Tracking with Wii Remotes Sage Browning, Phillip Weber, Jürgen Schulze California Institute for Telecommunications and Information Technology University of California San Diego firstname.lastname@example.org email@example.com, firstname.lastname@example.org, email@example.com@soe.ucsd.edu,firstname.lastname@example.org Overview Final Approach Goal: To develop a low cost, high accuracy method of tracking objects in 3D space utilizing infrared LED's and cameras for use as human interface devices (HIDs) when working with large displays. A Trigonometric Approach Problems with a Trigonometric Approach Limited Working Space: With a maximum vertical viewing angle of 27º, and 45º in the horizontal plane, and with the requirement that a point must be in view of at least two cameras, the Wii remote provides a relatively small space to work in. i = Ø max (p i /p max -.5) y = d/(1/tan( 1 + Ø 1 ) + 1/tan( 2 + Ø 2 )) x = y/tan( 1 + Ø 1 ) -.5d z = y/tan( 3 + Ø 3 ) Ø x = tan -1 ((y 1 - y 2 )/(x 1 - x 2 )) x = ytan(Ø x ) z = ytan(Ø pitch ) X = x + x Z = z + z Loss of Tracking: The point of placing two IR LEDs on the front of a Wiimote is to capture rotation in the horizontal plane (yaw), which cannot be tracked by accelerometers (as they only determine the direction of down). However, in rolling the remote 90º so that the IR LEDs are lined up vertically, yaw tracking is lost. In the picture, only the small horizontal movement is perceived POSIT Method The Wii Remote as a Sensor The Nintendo Wii Remote contains, among other things, eleven buttons three accelerometers bluetooth connectivity an infrared camera a basic image processor These components, coupled with a low price and the availability of Wii remote libraries in a variety of programming languages make it an attractive sensor (or toy). Accelerometers: The remotes three accelerometers show the direction of gravity, and determine pitch and roll. Fig. 1: Demonstrates return values for a Wii remote in a continuous roll  Fig 4: View from above. Infrared Camera: The Wii remotes camera reads image data, and an internal processor determines which infrared points are worthy of tracking. Up to four infrared points are tracked, and their radius, and pixel locations in the image plane sized 1024 by 760 pixels are sent via bluetooth. Fig. 2: Wii remote vision  Given the pixel values p i of a single point: i = difference in degrees from the center of the camera to the point being tracked Ø i = difference in degrees from the center of the camera to the plane of the screen (x, y, z) = location in real space, given in units of d, where the origin is the point directly between the two Wii remotes d = distance between the two cameras Given (x, y, z) of two points: Ø x = difference from normal in reference to screen x, z = difference from absolute location, and pointed location X, Z = final location pointed to on screen Fig. 3: Geometric representation of camera setup as seen from above. Finding x 1, y 1 (left) and the horizontal direction pointed (right). z 1 and vertical rotation are found similarly. References  DarwiinRemote  Cwiid Library  Wiiuse Library, Michael Laforrest,  Dementhon, Daniel & Davis, Larry S., Model-Based Object Pose in 25 Lines of Code, 1995, International Journal of Computer Vision, 15, 123 - 131  Oliver Kreylos, Wiimote Hacking In order to achieve complete pose tracking and to increase the area tracked, a new algorithm was used . DeMenthons POSIT code is designed to quickly estimate the location and orientation of a non-coplanar rigid object in 3D space given the objects dimensions, and the camera lens properties. The return values are a rotation matrix and a translation vector. Unfortunately, DeMenthons POSIT algorithm was designed for an object with many more points than is practical for a hand held device, and while his paper indicates a low error, he also uses a cube with eight points. Our handheld device with four points has a much greater error, giving the effect of a jittery object that constantly moves about the screen. Instead of creating our own system, we shifted to extending a pre-existing project  to multiple Wii remotes, in place of a single one as the original project was designed. This allows for a much greater tracked area. Further, this system makes use of both infrared and accelerometer data to achieve a more steady tracking algorithm. Under this setup, a Wii remote with infrared LEDs in a non-coplanar arrangement on the front will be tracked by at least one camera at any given time. Though only one camera is needed in order to compute the position and rotation of the remote, overlap between cameras provides a buffer so that all IR points are visible to at least one camera during any given pose calculation. The program was further extended to include a function to calculate initial camera offsets, as it would be useless to point the cameras straightforward and level. Once calculated, the program takes into account these values when making all subsequent pose calculations. The offsets are found by placing a rigid object on a level plane at the desired origin and finding the pose of the object. Since the objects pose is already known, we are in fact finding the pose of the cameras themselves. The rotation and translation offset vectors are then written to file along with the corresponding Wii remotes unique MAC address so that configuration and identification of the Wii remotes need only be run when camera positions are changed.
Muscle Volume Analysis 3D reconstruction allows for accurate volume calculation Provides methods for monitoring disease progression Measure muscle atrophy.
The Bioloid Robot Project Presenters: Michael Gouzenfeld Alexey Serafimov Supervisor: Ido Cohen Winter Department of Electrical Engineering.
Wii Remote Zibo Zou, Daniel Maertens, Steven Duan 1.
UAV pose estimation using POSIT algorithm
Computer vision: models, learning and inference M Ahad Multiple Cameras
Review on Graphics Basics. Outline Polygon rendering pipeline Affine transformations Projective transformations Lighting and shading From vertices to.
Autonomous Tracking Robot Andy Duong Chris Gurley Nate Klein Wink Barnes Georgia Institute of Technology School of Electrical and Computer Engineering.
Stereoscopic Imaging for Slow-Moving Autonomous Vehicle By: Alex Norton Advisor: Dr. Huggins February 28, 2012 Senior Project Progress Report Bradley University.
Visual Servo Control Tutorial Part 1: Basic Approaches Chayatat Ratanasawanya December 2, 2009 Ref: Article by Francois Chaumette & Seth Hutchinson.
Chayatat Ratanasawanya Min He May 13, Background information The goal Tasks involved in implementation Depth estimation Pitch & yaw correction angle.
Arizona’s First University. Command and Control Wind Tunnel Simulated Camera Design Jacob Gulotta.
Graphics CSCI 343, Fall 2015 Lecture 16 Viewing I
Wii mote interfacing. The product It is a wireless device, using standard Bluetooth technology to communicate The Wii Remote uses the standard Bluetooth.
Honours Graphics 2008 Session 2. Today’s focus Vectors, matrices and associated math Transformations and concatenation 3D space.
Three Dimensional Modeling Transformations
December 9, 2014Computer Vision Lecture 23: Motion Analysis 1 Now we will talk about… Motion Analysis.
Composite 3D Transformations. Example of Composite 3D Transformations Try to transform the line segments P 1 P 2 and P 1 P 3 from their start position.
Geometric Camera Models
The Pinhole Camera Model
© 2017 SlidePlayer.com Inc. All rights reserved.