GRASP University of Pennsylvania NRL logo? Autonomous Network of Aerial and Ground Vehicles Vijay Kumar GRASP Laboratory University of Pennsylvania Ron.

Slides:



Advertisements
Similar presentations
(Multi-model crop yield estimates)
Advertisements

Autonomic Systems Justin Moles, Winter 2006 Enabling autonomic behavior in systems software with hot swapping Paper by: J. Appavoo, et al. Presentation.
COORDINATION and NETWORKING of GROUPS OF MOBILE AUTONOMOUS AGENTS.
AAMAS 2009, Budapest1 Analyzing the Performance of Randomized Information Sharing Prasanna Velagapudi, Katia Sycara and Paul Scerri Robotics Institute,
Context-based Information Sharing and Authorization in Mobile Ad Hoc Networks Incorporating QoS Constraints Sanjay Madria, Missouri University of Science.
Autonomous Robot Navigation Panos Trahanias ΗΥ475 Fall 2007.
Laboratory Overview MIT Humans and Automation Lab February 2006.
Localized Techniques for Power Minimization and Information Gathering in Sensor Networks EE249 Final Presentation David Tong Nguyen Abhijit Davare Mentor:
1 Autonomous Controller Design for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Choong K. Oh and Gregory J. Barlow U.S. Naval Research.
Search-based Path Planning with Homotopy Class Constraints Subhrajit Bhattacharya Vijay Kumar Maxim Likhachev University of Pennsylvania GRASP L ABORATORY.
ASWP – Ad-hoc Routing with Interference Consideration June 28, 2005.
ASWP – Ad-hoc Routing with Interference Consideration Zhanfeng Jia, Rajarshi Gupta, Jean Walrand, Pravin Varaiya Department of EECS University of California,
Automatic Control & Systems Engineering Autonomous Systems Research Mini-UAV for Urban Environments Autonomous Control of Multi-UAV Platforms Future uninhabited.
1 Incremental Evolution of Autonomous Controllers for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow, Choong K. Oh,
8/22/20061 Maintaining a Linked Network Chain Utilizing Decentralized Mobility Control AIAA GNC Conference & Exhibit Aug. 21, 2006 Cory Dixon and Eric.
1 Autonomous Controller Design for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow North Carolina State University.
Vassilios V. Dimakopoulos and Evaggelia Pitoura Distributed Data Management Lab Dept. of Computer Science, Univ. of Ioannina, Greece
Behavior- Based Approaches Behavior- Based Approaches.
Distributed Cooperative Control of Multiple Vehicle Formations Using Structural Potential Functions Reza Olfati-Saber Postdoctoral Scholar Control and.
Robotic Sensor Networks: from theory to practice CSSE Annual Research Review Sameera Poduri.
Hand Signals Recognition from Video Using 3D Motion Capture Archive Tai-Peng Tian Stan Sclaroff Computer Science Department B OSTON U NIVERSITY I. Introduction.
Use of Aerial Views in Remote Ground Vehicle Operations Roger A. Chadwick New Mexico State University Department of Psychology Douglas J. Gillan (PI)
Aeronautics & Astronautics Autonomous Flight Systems Laboratory All slides and material copyright of University of Washington Autonomous Flight Systems.
ITE Vision Adapted and Updated from the background for the Presentation, "Naval Platform Control Systems: 2015 and Beyond,” Eleventh Ship Control Systems.
Controlling and Configuring Large UAV Teams Paul Scerri, Yang Xu, Jumpol Polvichai, Katia Sycara and Mike Lewis Carnegie Mellon University and University.
Computational & Information Science Division Tuesday, May 17, 2005 Randy Zachery, ARO.
Energy Efficient Routing and Self-Configuring Networks Stephen B. Wicker Bart Selman Terrence L. Fine Carla Gomes Bhaskar KrishnamachariDepartment of CS.
Multiple Autonomous Ground/Air Robot Coordination Exploration of AI techniques for implementing incremental learning. Development of a robot controller.
Algorithms for Robot-based Network Deployment, Repair, and Coverage Gaurav S. Sukhatme Center for Robotics and Embedded.
What are the main differences and commonalities between the IS and DA systems? How information is transferred between tasks: (i) IS it may be often achieved.
Adaptive Autonomous Robot Teams for Situational Awareness Gaurav S. Sukhatme, Maja J. Mataric, Andrew Howard, Ashley Tews Robotics Research Laboratory.
GRASP University of Pennsylvania Adaptive Autonomous Robot TEAMS for Situational Awareness GRASP Laboratory University of Pennsylvania PI:Vijay Kumar Senior.
Value of Information 1 st year review. UCLA 2012 Kickoff VOI Kickoff ARO MURI on Value-centered Information Theory for Adaptive Learning, Inference, Tracking,
Introduction to Networked Robotics CS 643 Seminar on Advanced Robotics Wenzhe Li, Graduate Student Texas A&M University.
Intelligent Agents RMIT Prof. Lin Padgham (leader) Ass. Prof. Michael Winikoff Ass. Prof James Harland Dr Lawrence Cavedon Dr Sebastian Sardina.
2007/03/26OPLAB, NTUIM1 A Proactive Tree Recovery Mechanism for Resilient Overlay Network Networking, IEEE/ACM Transactions on Volume 15, Issue 1, Feb.
Cooperative Air and Ground Surveillance Wenzhe Li.
Issues and Challenges for Co-operative UAV Missions Chris Halliday and Tony Dodd.
Distributed Algorithms for Multi-Robot Observation of Multiple Moving Targets Lynne E. Parker Autonomous Robots, 2002 Yousuf Ahmad Distributed Information.
Georgia Tech / Mobile Intelligence 1 Multi-Level Learning in Hybrid Deliberative/Reactive Mobile Robot Architectural Software Systems DARPA MARS Kickoff.
QoS Supported Clustered Query Processing in Large Collaboration of Heterogeneous Sensor Networks Debraj De and Lifeng Sang Ohio State University Workshop.
University of Pennsylvania 7/15/98 Asymmetric Bandwidth Channel (ABC) Architecture Insup Lee University of Pennsylvania July 25, 1998.
December 20, 2015 Decentralized Mission Planning for Heterogeneous Human-Robot Teams Sameera Ponda Prof. Jonathan How Department of Aeronautics and Astronautics.
Performance of Adaptive Beam Nulling in Multihop Ad Hoc Networks Under Jamming Suman Bhunia, Vahid Behzadan, Paulo Alexandre Regis, Shamik Sengupta.
Data Dissemination in Sensor Networks Challenges and Solutions by Sovrin Tolia.
Behavior-based Multirobot Architectures. Why Behavior Based Control for Multi-Robot Teams? Multi-Robot control naturally grew out of single robot control.
Selection of Behavioral Parameters: Integration of Case-Based Reasoning with Learning Momentum Brian Lee, Maxim Likhachev, and Ronald C. Arkin Mobile Robot.
Mine Warfare - A Total Force Approach for the Future
Survey of Tools to Support Safe Adaptation with Validation Alain Esteva-Ramirez School of Computing and Information Sciences Florida International University.
Decentralized Control of Mobile Sensor Networks Kevin M. Lynch Laboratory for Intelligent Mechanical Systems Mechanical Engineering Department Northwestern.
Univ logo Robotics for Nuclear Decommissioning Drone-Arm Cooperative Vision Thomas Burrell C.J. Taylor, S.D. Monk, A. Montazeri Lancaster University –
University of Pennsylvania 1 GRASP Cooperative Control and Coordination of Multiple Robots Vijay Kumar GRASP Laboratory University of Pennsylvania
ESA Harwell Robotics & Autonomy Facility Study Workshop Autonomous Software Verification Presented By: Rick Blake.
Abstract Each July, the Association for Unmanned Vehicle Systems International holds an annual International Aerial Robotics Competition (IARC), with major.
Thrust IIB: Dynamic Task Allocation in Remote Multi-robot HRI Jon How (lead) Nick Roy MURI 8 Kickoff Meeting 2007.
Learning for Physically Diverse Robot Teams Robot Teams - Chapter 7 CS8803 Autonomous Multi-Robot Systems 10/3/02.
SWARMS Scalable sWarms of Autonomous Robots and Mobile Sensors Ali Jadbabaie, Daniel E. Koditchek, Vijay Kumar (PI), and George Pappas l.
MARS 2020 Kick-Off Meeting 13 November 2002 Georgia Tech.
Learning Behavioral Parameterization Using Spatio-Temporal Case-Based Reasoning Maxim Likhachev, Michael Kaess, and Ronald C. Arkin Mobile Robot Laboratory.
Euro-Par, HASTE: An Adaptive Middleware for Supporting Time-Critical Event Handling in Distributed Environments ICAC 2008 Conference June 2 nd,
Wireless sensor and actor networks: research challenges Ian. F. Akyildiz, Ismail H. Kasimoglu
AUTONOMIC COMPUTING B.Akhila Priya 06211A0504. Present-day IT environments are complex, heterogeneous in terms of software and hardware from multiple.
University of Pennsylvania 1 GRASP Control of Multiple Autonomous Robot Systems Vijay Kumar Camillo Taylor Aveek Das Guilherme Pereira John Spletzer GRASP.
2003 National Fire Control Symposium NIST/Raytheon Joint Paper
Enabling Team Supervisory Control for Teams of Unmanned Vehicles
Pursuit-Evasion Games with UGVs and UAVs
Vision Based Motion Estimation for UAV Landing
Distributed Sensing, Control, and Uncertainty
Market-based Dynamic Task Allocation in Mobile Surveillance Systems
Self-Managed Systems: an Architectural Challenge
Presentation transcript:

GRASP University of Pennsylvania NRL logo? Autonomous Network of Aerial and Ground Vehicles Vijay Kumar GRASP Laboratory University of Pennsylvania Ron Arkin College of Computing Georgia Tech Autonomous Operations Future Naval Capability Unmanned Systems Technology Review

GRASP University of Pennsylvania NRL logo? Adaptive Autonomous Robot TEAMS for Situational Awareness Vijay Kumar Univ Penn Gaurav Sukhatme USC Ron Arkin Georgia Tech Jason Redi BBN A MARS 2020 project Autonomous Operations Future Naval Capability Unmanned Systems Technology Review

GRASP University of Pennsylvania NRL logo? Future Combat Systems Creation of a network-centric force of heterogeneous platforms that is strategically responsive and sustainable l Adapt to variations in communication performance and strive to maximize suitably defined network-centric measures for perception, control and communication l Provide situational awareness for remotely- located war fighters in a wide range of conditions l Integrate heterogeneous air-ground assets in support of continuous operations over varying terrain

GRASP University of Pennsylvania NRL logo? Air Ground Coordination GROUND VEHICLES AERIAL VEHICLES C2 VEHICLE

GRASP University of Pennsylvania NRL logo? Motivation U A V

GRASP University of Pennsylvania NRL logo? Motivation U A V

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Motivation

GRASP University of Pennsylvania NRL logo? Context Communication Network l 400 MHz (100Kbs), 2.4 GHz (10Mbs), 38 GHz (100 Mbs) l Affected by foliage, buildings, terrain features, indoor/outdoor l Directionality Small Team of Heterogeneous Robots l UGVs with vision, range finders l UAVs (blimp, helicopter)

GRASP University of Pennsylvania NRL logo? Research Thrusts 1.Localization and Control for the Team of Robots 2. Communication Sensitive Mission Planning 3. Communication Sensitive Reactive Behaviors 4. Verification and Validation

GRASP University of Pennsylvania NRL logo? 1. Localization, Tracking and Control for a (small) Network of Robots Decentralized l Each robot computes the others position relative to its reference frame l Each robot shares information with the rest of the team Assumptions l Noise can be modeled by normal distribution l No dynamics l Ad-hoc network l Robots are easily identified

GRASP University of Pennsylvania NRL logo? Global Estimators for Position and Orientation Finding the optimal solution involves a graph search problem l NP-complete or optimization over 3(N-1) vars. l Local minima Suboptimal solution l Each robot calls out its observations l Solve for orientations l Solve for relative positions O(N 3 ), but closed form Breadth-first search enables O(N) approximation R2R2 R3R3 R4R4 R5R5 R1R1 R9R9 R6R6 Self-organization, adaptation based on the spanning tree [Das, Spletzer, Kumar, Taylor 02]

GRASP University of Pennsylvania NRL logo? 2. Communication Sensitive Planning l Provide support for terrain models and other communications relevant topographic features to MissionLab l Use plans-as-resources as a basis for multiagent robotic communication control (spatial, behavioral, formations, etc.) and integrate within MissionLab

GRASP University of Pennsylvania NRL logo? Preliminary Results: Communication Planning l Additional resources in the form of internalized plans aids team communication. l No difference results when using reactive behaviors vs. communication insensitive plans. l Communication planning in serial and parallel result in significant improvement in communication.

GRASP University of Pennsylvania NRL logo? 3. Communication Sensitive Team Behaviors l Reactive communications preserving and recovery behaviors l Communications recovery and preserving behaviors sensitive to QoS l Behaviors in support of line-of-sight and subterranean operations

GRASP University of Pennsylvania NRL logo? Control for Communication Modeling of Communication Networks l Effect of foliage l Buildings l Dependence on frequency, directionality l Statistical models of delays and “hot spots” from experimental data u Neighbors, path costs (delays, power) u Time of last communication QoS metrics l Control/perception tasks l Individual robots vs. end-to-end l Move to improve reliability and network performance

GRASP University of Pennsylvania NRL logo? Simulation Six robots maintaining communication constraints and avoiding each other

GRASP University of Pennsylvania NRL logo? Communication Sensitive Behaviors: Preliminary Results Using the Nearest Neighbor Recovery behavior approximately 50% of the trials were finished completely autonomously Retrotraverse and Move to Higher Ground were usually not able to finish the trials autonomously by themselves and will require transitions/planning once communications recovered

GRASP University of Pennsylvania NRL logo? Satisfy Constraints Maintain Constraints 4. Verification and Validation Unconstrained Behaviors

GRASP University of Pennsylvania NRL logo? Guarantees for Special Cases Complete Graph Tree l In-degree constraint l Directed [Pereira et al, IROS 03] Hamiltonian Cycle (or Path) l In-degree constraint l Undirected [Pereira et al, NRL MRS 03] 1.Reactive Controllers are Potential Field Controllers 2.Assumptions on “constraint” graph

GRASP University of Pennsylvania NRL logo? Three Robot Experiments: Satisfying Constraints

GRASP University of Pennsylvania NRL logo? Deploying a robot network

GRASP University of Pennsylvania NRL logo? Effect of Robot Failures R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 Control GraphConstraint Graph R3R3 R1R1 R2R2 Formation Graph R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 R3R3 R1R1 R2R2 +=

GRASP University of Pennsylvania NRL logo? Conclusion l A comprehensive model and framework integrating communications, perception, and execution l Automated acquisition of perceptual information for situational awareness l Reactive group behaviors for a team of air and ground based robots that are communications sensitive