PortableVision-based HCI A Hand Mouse System on Portable Devices 連矩鋒 (Burt C.F. Lien) Computer Science and Information Engineering Department National.

Slides:



Advertisements
Similar presentations
Working for the future - today
Advertisements

Hand Gesture for Taking Self Portrait Shaowei Chu and Jiro Tanaka University of Tsukuba Japan 12th July 15 minutes talk.
Rapid Object Detection using a Boosted Cascade of Simple Features Paul Viola, Michael Jones Conference on Computer Vision and Pattern Recognition 2001.
Rapid Object Detection using a Boosted Cascade of Simple Features Paul Viola, Michael Jones Conference on Computer Vision and Pattern Recognition 2001.
 Projector .55” x 2.36” x 4.64”  133 g with battery  16:9 and 4:3 aspect ratio  848 x 480 pixels  Laser Pointers  5 mW output power  532 +/- 10.
An automated input peripheral multiplexor for computing systems Jon Bright Dan Quintas Matt Spencer Steven Shropshire ECE 4007 Section L03 Project Advisor.
EyePhone: Activating Mobile Phones With Your Eyes Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell CS Department – Dartmouth College, Hanover, NH, USA.
AdaBoost & Its Applications
Face detection Many slides adapted from P. Viola.
EE462 MLCV Lecture 5-6 Object Detection – Boosting Tae-Kyun Kim.
A Mobile-Cloud Pedestrian Crossing Guide for the Blind
Detecting Pedestrians by Learning Shapelet Features
Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon.
HCI Final Project Robust Real Time Face Detection Paul Viola, Michael Jones, Robust Real-Time Face Detetion, International Journal of Computer Vision,
Stanford hci group / cs376 research topics in human-computer interaction Vision-based Interaction Scott Klemmer 17 November 2005.
Robust Real-time Object Detection by Paul Viola and Michael Jones ICCV 2001 Workshop on Statistical and Computation Theories of Vision Presentation by.
Background S.A.U.V.I.M. Semi - Autonomous Underwater Vehicle for
CS335 Principles of Multimedia Systems Multimedia and Human Computer Interfaces Hao Jiang Computer Science Department Boston College Nov. 20, 2007.
Robust Real-Time Object Detection Paul Viola & Michael Jones.
Viola and Jones Object Detector Ruxandra Paun EE/CS/CNS Presentation
Viewpoint Tracking for 3D Display Systems A look at the system proposed by Yusuf Bediz, Gözde Bozdağı Akar.
Real-Time Face Detection and Tracking Using Multiple Cameras RIT Computer Engineering Senior Design Project John RuppertJustin HnatowJared Holsopple This.
Vision-Based Biometric Authentication System by Padraic o hIarnain Final Year Project Presentation.
Video Surveillance Capturing, Management and Analysis of Security Videos. -Abhinav Goel -Varun Varshney.
MACHINE VISION GROUP Multimodal sensing-based camera applications Miguel Bordallo 1, Jari Hannuksela 1, Olli Silvén 1 and Markku Vehviläinen 2 1 University.
Person Detection and Tracking using Binocular Lucas-Kanade Feature Tracking and K-means Clustering Chris Dunkel Committee: Dr. Stanley Birchfield, Committee.
A Tutorial on Object Detection Using OpenCV
ELECTRONIC CONDUCTING SYSTEM Kenzo Abrahams Supervisor: Mehrdad Ghaziasgar Co-supervisor: James Connan Assisted by: Diego Mushfieldt.
Low Cost Infrared Touch Screen Bezel for POS Systems Rohan Verma, Jeremy Taylor, Freddie Dunn III Georgia Institute of Technology School of Electrical.
Knowledge Systems Lab JN 9/10/2002 Computer Vision: Gesture Recognition from Images Joshua R. New Knowledge Systems Laboratory Jacksonville State University.
Multimedia Specification Design and Production 2013 / Semester 2 / week 8 Lecturer: Dr. Nikos Gazepidis
Trends in Computer Vision Automatic Video Surveillance.
A Method for Hand Gesture Recognition Jaya Shukla Department of Computer Science Shiv Nadar University Gautam Budh Nagar, India Ashutosh Dwivedi.
Submitted by:- Vinay kr. Gupta Computer Sci. & Engg. 4 th year.
Portable Vision-Based HCI A Real-Time Hand Mouse System on Portable Devices 連矩鋒 (Burt C.F. Lien) Department of Computer Science and Information Engineering.
Curtis Kelsey University of Missouri A FINGERPRINTING SYSTEM MOBILE MODEL FOR VIDEO COPY PROTECTION.
Lecture 29: Face Detection Revisited CS4670 / 5670: Computer Vision Noah Snavely.
Face detection Slides adapted Grauman & Liebe’s tutorial
Computer Science Department Pacific University Artificial Intelligence -- Computer Vision.
DIEGO AGUIRRE COMPUTER VISION INTRODUCTION 1. QUESTION What is Computer Vision? 2.
Enabling User Interactions with Video Contents Khalad Hasan, Yang Wang, Wing Kwong and Pourang Irani.
Robust Real-time Face Detection by Paul Viola and Michael Jones, 2002 Presentation by Kostantina Palla & Alfredo Kalaitzis School of Informatics University.
U NIVERSITEIT VAN A MSTERDAM IAS INTELLIGENT AUTONOMOUS SYSTEMS 1 M. Hofmann Prof. Dr. D. M. Gavrila Intelligent Systems Laboratory Informatics Institute,
卓越發展延續計畫分項三 User-Centric Interactive Media ~ 主 持 人 : 傅立成 共同主持人 : 李琳山,歐陽明,洪一平, 陳祝嵩 水美溫泉會館研討會
REAL TIME FACE DETECTION
By: Kenzo Abrahams Supervisor: Mehrdad Ghaziasgar Co-supervisor: James Connan Mentored by: Diego Mushfieldt.
Face Detection Ying Wu Electrical and Computer Engineering Northwestern University, Evanston, IL
Moshe Gutman Michael Mills Nathaniel Troutman. The Idea  Present the participant with a “Glass Box”, a portal to an interactive world where they can.
Final Presentation for EE7700 DVP Shenghua Wan and Kang zhang May, D View Simulation Based on Face Tracking.
TEMPLATE DESIGN © E-Eye : A Multi Media Based Unauthorized Object Identification and Tracking System Tolgahan Cakaloglu.
Virtual Desktop Peephole By Kyle Patience Supervisor: Reginald Dodds Co Supervisor: Mehrdad Ghaziasgar.
Virtual Desktop Peephole By Kyle Patience Supervisor: Reginald Dodds Co Supervisor: Mehrdad Ghaziasgar.
Delivering Business Value through IT Face feature detection using Java and OpenCV 1.
Department of Computer Science,
Virtual Image Peephole By Kyle Patience Supervisor: Reg Dodds Co Supervisor: Mehrdad Ghaziasgar.
Spring 2007 COMP TUI 1 Computer Vision for Tangible User Interfaces.
CONTENT FOCUS FOCUS INTRODUCTION INTRODUCTION COMPONENTS COMPONENTS TYPES OF GESTURES TYPES OF GESTURES ADVANTAGES ADVANTAGES CHALLENGES CHALLENGES REFERENCE.
David Wild Supervisor: James Connan Rhodes University Computer Science Department Eye Tracking Using A Simple Webcamera.
CS-498 Computer Vision Week 9, Class 2 and Week 10, Class 1
Virtual Pointing Device Using Stereo Camera The 6th International Conference on Applications and Principles of Information Science Jan , 2007, Kuala.
Face Recognition and Tracking for Human-Robot Interaction using PeCoFiSH Alex Eisner This material is based upon work supported by the National Science.
Hand Detection with a Cascade of Boosted Classifiers Using Haar-like Features Qing Chen Discover Lab, SITE, University of Ottawa May 2, 2006.
Stanford hci group / cs376 u Scott Klemmer · 28 November 2006 Vision- Based Interacti on.
CS262: Computer Vision Lect 06: Face Detection
StudiDroid: Mobile Android Application
7 INPUT AND OUTPUT CHAPTER
Chapter 1: Image processing and computer vision Introduction
A Tutorial on Object Detection Using OpenCV
AHED Automatic Human Emotion Detection
Lecture 29: Face Detection Revisited
Presentation transcript:

PortableVision-based HCI A Hand Mouse System on Portable Devices 連矩鋒 (Burt C.F. Lien) Computer Science and Information Engineering Department National Taiwan University

Problems A Portable Vision-based HCI –Hand mouse operating on a projected interface –Real-time detection of user hand motion from a user PDA/SmartPhone’s video camera (target platform) A part of “mTeller” project –Natural storytelling support system

Why important Vision-based HCI is a more instinct way to manipulate data Mobility –Steerable interface everywhere

Related Works I A Portable System for Anywhere Interactions –Sukaviriya et al., IBM Research Real-time hand tracking using a set of cooperative classifiers based on Haar-like features –Barczak1 et al., Institute of Information & Mathematical Sciences Massey University

Everywhere Display (IBM) Figure 1: Interactive store application

Related Works II Real-Time Hand-Arm Motion Analysis using a single Video Camera – Hienz et al. MMX-Accelerated Real-Time Hand Tracking System –Liu et al. (2001)

Related Works III Rapid Object Detection Using a Boosted Cascade of Simple Features. –Viola, P., & Jones, M. (2001). Robust real-time object detection. –Viola, P., & Jones, M. Robust real-time face detection –P. Viola and M. Jones. Adaboost-based real-time pedestrian detection –P. Viola, M. Jones, and D. Snow.

Target Devices

System Configuration Hand motion capture and interpretation Wireless projector data transmission Interactive Interface

What is new A portable vision-based HCI on handheld device Design for general data manipulation

System Implementation Platform (prototype) –“Laptop” + “Low Cost Camera (USB)” Software tools –“MS VC++” + “Intel OpenCV library”

Technical Challenges and approaches Real-time hand motion tracking under an intense lighting condition (projector light) –Adaboost Hand position vs. Corresponding programs on host –Comparison between PDA’s screen and the projected screen(??) An efficient algorithm to run detection system on handheld devices (limited computation) –Lower framing rate (2fps?) + fewer classifier Noise filter –A sliding window or a simple filter to filter misbehaving hand motion

Expect Result A generic vision-based HCI software program running on a laptop (1st phase) A user can manipulate the laptop directly on the projected image –Hand mouse (one-click function only)

The End