We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byAnnis Stevens
Modified about 1 year ago
©SIProp Project, Auto Chasing Turtle Hirotaka Niisato Noritsuna Imamura
©SIProp Project, About ourselves Ourselves Hirotaka Noritsuna About SIProp Project Open Source Software Project The world of media (communication medium) is extended.
©SIProp Project, /11 Earthquake Tsunami Nuclear Plant
©SIProp Project, Agenda Summary Part “Software” Detect the face Calculate the course Calculate the distance Part “Hardware” How to control the robot How to process the analog data Need more power supply
©SIProp Project, Summary This product is "Auto Chasing Turtle". By autonomous control, this robot recognizes people's face and approaches to the detected human.
©SIProp Project, Robot behavior 1.Rotate and look for the human who becomes a target. 2.Detect the human with recognizing people's face by using RGB camera of Kinect. 3.If it can detect the human, it calculates the course which it should follow. And It direction is changed. 4.Calculate the distance to target by using Z(depth) camera of Kinect. 5.Walk toward to target are repeated until it becomes a suitable distance. And if losts target, returns to 1. 7.The scene that it is working in real time can be seen by iPad.
©SIProp Project, Movie
©SIProp Project, YouTube Source Code & detail explanation FAutoChasingTurtle Movie
©SIProp Project, complete set parts Robot KONDO Animal 01 Controllers For servo RCB3 For application Beagleboard-xM Linaro-Kernel Android(Embedded Master) Sensors Kinect RGB camera Z(Depth) camera Connect to outside Radio wave Wi-Fi router Viewer iPad Power supply 12V1A output 10V1A output 5V3A output
©SIProp Project, Why this project? DENSUKE project Mobile Internet Device with Cyber-Pet User Interface
©SIProp Project, DENSUKE project OESF(Open Embedded Software Foundation) Future Systems WG’s mission Partners Project leader Mr. Ohtsuki The Father of AIBO
©SIProp Project, Detail of “KINECT Turtle world”
©SIProp Project, Why KINECT and Robot ? Application have changed Game, Motion Controller, Nunchuk Cell Phone, Tablet
©SIProp Project, Why KINECT and Robot ? KINECT show the next future Camera, Depth censor. Recognition of human’s data. Mobility Problem...
©SIProp Project, Why KINECT and Robot ? KINECT on Robot is result of mobility problem. Camera data Depth censor Analyz e Robot movement INPUTOUTPUT
©SIProp Project, Part “Software”
©SIProp Project, openFrameworks x Kinect x Android ofxDroidKinect
©SIProp Project, About ofxDroidKinect
©SIProp Project, About ofxDroidKinect This is the Android Application Framework which runs on openFrameworks & uses Kinect. Using softwares openFrameworks for Android Linaro Android
©SIProp Project, Control Robot and KINECT Linaro Android openFrameworks ofxDroidKinect Robot Kinect iPad Serial USB Wifi
©SIProp Project, Analyze KINECT data Detect the Face Calculate the course Calculate the distance 1. detect 2. course 3. distance
©SIProp Project, Detect the face What’s data ? 640x480 RGB image, using KINECT’s camera, Characteristics of human face. KINECT Image
©SIProp Project, Detect the face Face recognition Characteristics of human face Statistical face detection and machine learning.
©SIProp Project, Detect the face Not all frame, but realtime analyzing. Auto search around people. Chase specified human.
©SIProp Project, Calculate the course Using width. 1.Specify center position of face. 2.Specify position of the face in 4-sections relavive to KINECT’s image.
©SIProp Project, Calculate the course Using height. Change Kinect’s angle. Specify position of the face in image relavive to KINECT’s image.
©SIProp Project, Calculate the distance 1.Mesure the depth of specified point using KINECT. 2.Robots walk forward or back, depending on the mesured distance.
©SIProp Project, Performance problem Data analyze and image processing Face recognition More resource !! GPU, Multi core.
©SIProp Project, Part “Hardware”
©SIProp Project, How to control the robot? Only control servos’ angle. Accuracy Reaction velocity Torque Compact(Size, Weight)
©SIProp Project, How to control a servo? RCB series 24 controls pins Control commands Control all servo at same time !
©SIProp Project, More control Do you know this IC?
©SIProp Project, How to process more sensors? Analog data is stream data! Need powerful processor Need to save power for Mobile Now Solution ARM base Processor dual Cortex A9 MALI 400 GPU Next trend GPGPU FPGA
©SIProp Project, How to optimize for each sensors? Mission Optimize for each SoC & Platform We are committer!
©SIProp Project, Trouble: Need more power supply Don’t run beagleboard-xM by 5V/1A power supply. It needs 5V/2A. Standard USB battery has 5V/1A. Create power supply by myself My battery has 12V/2A. My plan is to create convertor of 12V/2A ⇒ 5V/2A. Can’t get power IC… Using car’s cigarette adapter which convert to USB. 12V ・ 24V/2A ⇒ 5V/2A
©SIProp Project, MAKE:style Hardware beagleboard-xM KONDO Animal Kinect Software ofxDroidKinect Linaro Kernel Android(Embedded Master) Do It Yourself ⇒ Do It With Others!
©SIProp Project, Auto Chasing Turtle Hirotaka Niisato Noritsuna Imamura.
©SIProp Project, Content-Centric Embedded ～ Treasure Hunting Robot ～ Noritsuna Imamura.
Joshua Fabian Tyler Young James C. Peyton Jones Garrett M. Clayton Integrating the Microsoft Kinect With Simulink: Real-Time Object Tracking Example (
INTRODUCTION Generally, after stroke, patient usually has cerebral cortex functional barrier, for example, the impairment in the following capabilities,
Embedded Microcomputer Systems Andrew Karpenko 1 Prepared for Technical Presentation February 25 th, 2011.
VEX Robotics Platform and ROBOTC Software Introduction.
Platform-based Design 5KK70 TU/e 2009 Henk Corporaal Bart Mesman.
Introduction to the VEX ® Robotics Platform and ROBOTC Software © 2012 Project Lead The Way, Inc.Principles of Engineering.
ECE 4007 L01 DK6 1 FAST: Fully Autonomous Sentry Turret Patrick Croom, Kevin Neas, Anthony Ogidi, Joleon Pettway ECE 4007 Dr. David Keezer.
A Brief Overview of Computer Vision Jinxiang Chai.
FINAL ORAL PRESENTATION ROBOT: PACKY ROGER RODRIGUEZ IMDL FALL 2011.
Autonomous Surface Navigation Platform Michael Baxter Angel Berrocal Brandon Groff.
// This is a simple control program Move forward 200 units Turn right 90 Move forward 100 units Turn right 45 Move forward 100 Turn right 45 Move forward.
Robot Project by Ahmad Shtaiyat Supervised by Dr. Salem Al-Agtash.
Graphics on Key by Eyal Sarfati and Eran Gilat Supervised by Prof. Shmuel Wimer, Amnon Stanislavsky and Mike Sumszyk 1.
Introduction to Embedded Development. What is an Embedded System ? An embedded system is a computer system embedded in a device with a dedicated function.
HiTrack Introduction Shanghai Zhuo-Shi Software Technology Co., Ltd Shanghai Zhuo-Shi Software Technology Co., Ltd
Exploration Robot with Stereovision Vladislav Richter Miroslav Skrbek FIT, CTU in Prague
Trends in Embedded Computing The Ubiquitous Computing through Sensor Swarms.
Abstract Design Considerations and Future Plans In this project we focus on integrating sensors into a small electrical vehicle to enable it to navigate.
Electromechanical Systems “Robotic Sorting System” Brent GuyJonathan Penney.
Accelerometer based motion gestures for mobile devices Presented by – Neel Parikh Advisor Committee members Dr. Chris Pollett Dr. Robert Chun Dr. Mark.
Autonomous Robot Project Lauren Mitchell Ashley Francis.
October Robot Wars Andy Shiers Jason Rivers Morten Kromberg Dyalog’13.
Igor Markov Face Detection and Classification on Mobile Devices.
Microsense Webcast Streaming Solutions. Introduction A web stream / webcast is a media presentation distributed over the Internet using streaming media.
MACHINE VISION GROUP Graphics hardware accelerated panorama builder for mobile phones Miguel Bordallo López*, Jari Hannuksela*, Olli Silvén* and Markku.
MACHINE VISION GROUP Accelerating image recognition on mobile devices using GPGPU Miguel Bordallo 1, Henri Nykänen 2, Jari Hannuksela 1, Olli Silvén 1.
By Jocelyn Hepler The difference between the iPad 2 and Galaxy tab.
This information is confidential and is not to be provided to any third party without Vicon Industries Inc.’s prior written consent. 1 Plug and Play NVR.
KinectFusion: Real-Time Dense Surface Mapping and Tracking by Richard.A Newcombe et al. Presenting: Boaz Petersil.
Nvidia Tegra 2 The world's first mobile super chip.
MTA-SZTAKI Roboteyepair an ultra-high speed stereo vision system based on CNN technology.
EIGHTH GRADE ROBOTICS KITTATINNY REGIONAL HIGH SCHOOL MR. SHEA Introduction to Robotics Day4.
COMPUTER CONCEPTS Computer Information Systems. COURSE COMPETENCIES Explain the functions of computer system components. Describe the information processing.
Introduction to Robotics Electronics and Robotics Club.
MACHINE VISION GROUP Head-tracking virtual 3-D display for mobile devices Miguel Bordallo López*, Jari Hannuksela*, Olli Silvén* and Lixin Fan**, * University.
First Person POV RC Car Using WiFi-Direct P2P video streaming and Bluetooth By Shane Langhans.
How the Future of Signal Processing Will Affect Us Gene A Frantz Principal Fellow Texas Instruments.
Controlling Robot Car via Smartphone Supervisor: Dr. Jamal Kharousheh Prepared by : Hamza Qaddara Esmat Hedariya Hareth Hanani Faculty of Engineering Telecommunication.
Android 3.0 for tablet PCs hint: click the Android.
CSE 424 Final Presentation Team Members: Edward Andert Shang Wang Michael Vetrano Thomas Barry Roger Dolan Eric Barber Sponsor: Aviral Shrivastava.
Intelligent Vehicles and Systems Group The Pennsylvania State University 1/9 EDSGN 100 EDSGN 100 Autonomous System Navigation and Driver Augmentation Pramod.
Senior Project Design Review Remote Visual Surveillance Vehicle (RVSV) Manoj Bhambwani Tameka Thomas.
Design and Implementation of Metallic Waste Collection Robot Hesham Alsahafi and Majed Almaleky Robotics, Intelligent Sensing and Control (RISC) Lab School.
Main Components: Sensors Micro controller Motor drivers Chasis.
1 Daniel Micheletti Darren Allen Daniel Mazo Jon Lamb Lyle Johnson Pixel Perfect WiCam: A Wireless Digital Camera Presented by : Kyle Swenson.
By: 1- Aws Al-Nabulsi 2- Ibrahim Wahbeh 3- Odai Abdallah Supervised by: Dr. Kamel Saleh.
© 2017 SlidePlayer.com Inc. All rights reserved.