Abstract Complex real-time seismic networks often develop an extensive set of dataflow connections, especially when one includes the virtual networks established.

Slides:



Advertisements
Similar presentations
NAGIOS AND CACTI NETWORK MANAGEMENT AND MONITORING SYSTEMS.
Advertisements

Data Grid: Storage Resource Broker Mike Smorul. SRB Overview Developed at San Diego Supercomputing Center. Provides the abstraction mechanisms needed.
Antelope Relational Database Management System A practical introduction.
Automating with Open Source Testing Tools Corey McGarrahan rSmart 01-July-08.
Chapter 2 Database System Concepts and Architecture
IEC Substation Configuration Language and Its Impact on the Engineering of Distribution Substation Systems Notes Dr. Alexander Apostolov.
1 Chapter 12 Working With Access 2000 on the Internet.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
Web-based Control Interface For a model train control system By: Kevin Sendra.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Overview of Database Languages and Architectures.
WISENET Wireless Sensor Network Project Team: J. Dunne D. Patnode Advisors: Dr. Malinowski Dr. Schertz.
CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle and Streams Diagnostics and Monitoring Eva Dafonte Pérez Florbela Tique Aires.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Project Implementation for COSC 5050 Distributed Database Applications Lab1.
Linux Operations and Administration
Potential for Near-real-time Dataflow Monitoring with GeoWall Dr. Kent Lindquist Lindquist Consulting, Inc. May 10, 2004.
ABSTRACT Real-time systems applied to seismic data acquisition, asynchronous processing, and data archiving tasks have clearly demonstrated their utility.
January, 23, 2006 Ilkay Altintas
.. Skytap Better Software Faster Visual Studio Industry Partner Skytap NEXT STEPS Contact us at: Insert your company description here.
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
1 ESnet Network Measurements ESCC Feb Joe Metzger
1 The Problem Do you have: A legacy ABL system with millions of Lines of ABL Code? Years and years of modifications to your ABL code? System documentation.
Workflow Management Chris A. Mattmann OODT Component Working Group.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
Connecting to Network. ♦ Overview ► A network connection is required to communicate with other computers when they are in a network. Network interface.
MARCH 27, Meeting Agenda  Prototype 1 Design Goals  Prototype 1 Demo  Framework Overview  Prototype 2 Design Goals  Timeline Moving Forward.
COMP 410 & Sky.NET May 2 nd, What is COMP 410? Forming an independent company The customer The planning Learning teamwork.
1 1 Local vs. remote intelligence A quick look at two different architecture management systems Copyright Nitrosoft 2010.
San Diego Supercomputer Center SDSC Storage Resource Broker Data Grid Automation Arun Jagatheesan et al., San Diego Supercomputer Center University of.
Performance Monitor for Complex, Distributed ORB Instances Chen Chen, Kaijian Liu, Hui Long, Gabe Plank Aug. 29, 2010 Problem: Assuming massive data flow.
CHEP 2003Stefan Stonjek1 Physics with SAM-Grid Stefan Stonjek University of Oxford CHEP th March 2003 San Diego.
XML Registries Source: Java TM API for XML Registries Specification.
Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore
Network Monitoring Through Mobile (MOBTOP) Developed By : Akanksha Jain. (102199) Deepika Reddy (102210) Team Name: Beans Guided By: Prof. Robert Zhu SUBMITTED.
Students: Anurag Anjaria, Charles Hansen, Jin Bai, Mai Kanchanabal Professors: Dr. Edward J. Delp, Dr. Yung-Hsiang Lu CAM 2 Continuous Analysis of Many.
Rule-Based Programming for VORBs Bertram Ludaescher Arcot Rajasekar Data and Knowledge Systems San Diego Supercomputer Center U.C. San Diego.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Archive for the NSDL Reagan W. Moore Charlie Cowart.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Alternative.
ABone Architecture and Operation ABCd — ABone Control Daemon Server for remote EE management On-demand EE initiation and termination Automatic EE restart.
WHOI and SIO (II): Next Steps Towards Multi-Institution Archiving of Shipboard and Deep Submergence Vehicle Data (IN51A-0306) The Woods Hole Oceanographic.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation Analyzing.
EPICS EPICS Limitations Bob Dalesio Marty Kraimer.
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
Budgeting Tool Brandon Ganch Chris George Paul Perello Mike Schmidt.
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
MySQL and GRID status Gabriele Carcassi 9 September 2002.
Network Computing Services, Inc. Real-Time Visualization of IP Streams over Switched WANs Real-Time Visualization of IP Streams Over Switched WANs Timothy.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
D R A T D R A T ABSTRACT Every semester each department at Iowa State University has to assign its faculty members and teaching assistants (TAs) to the.
1 HPEC'02 Distributed Data Management Architecture for Embedded Computing The Problem: –Integrated real-time management of large, distributed, heterogeneous.
® IBM Software Group © 2007 IBM Corporation Module 3: Creating UML Diagrams Essentials of Modeling with IBM Rational Software Architect, V7.5.
Institute for the Protection and Security of the Citizen HAZAS – Hazard Assessment ECCAIRS Technical Course Provided by the Joint Research Centre - Ispra.
Web development. What is web development? - It is a broad term for the work involved in developing a web site for the Internet - It can range from developing.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
PROJECT SECME Carthik A. Sharma Juan Carlos Vivanco Majid Khan Santhosh Kumar Grandai. Software Engineering Fall 2002.
Oracle 10g Administration Oracle Server Introduction Copyright ©2006, Custom Training Institute.
ISC321 Database Systems I Chapter 2: Overview of Database Languages and Architectures Fall 2015 Dr. Abdullah Almutairi.
6/28/ A global mesh of interconnected networks (internetworks) meets these human communication needs. Some of these interconnected networks are.
DOMAIN SPECIFIC LANGUAGE AND MANAGEMENT ENVIRONMENT FOR EXTENSIBLE CPS Martin Lehofer Siemens Corporate Technology Princeton, NJ, USA Subhav Pradhan Institute.
Databases and DBMSs Todd S. Bacastow January 2005.
Database System Concepts and Architecture
Database System Concepts and Architecture
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Data, Databases, and DBMSs
Distributed Data Management Architecture for Embedded Computing
VORB Virtual Object Ring Buffers
Criteria for rapid prototyping
GGF10 Workflow Workshop Summary
Presentation transcript:

Abstract Complex real-time seismic networks often develop an extensive set of dataflow connections, especially when one includes the virtual networks established by data- sharing. As these systems grow, the task of managing existing connections and adding new ones has the potential to rapidly overwhelm network operators and system architects. This is amplified by data-source deletions and additions and temporary network problems, to say nothing at all of the the changing presence of individual data streams. We have created dynamic status-monitoring tools for Antelope-based seismic networks, expanding on capabilities of the Antelope system, which allow us to monitor the topology of orbserver connectivity and the dynamic dataflow for individual streams. These tools are important for monitoring network health, avoiding common traps such as data loops, and engineering sensible data-flow architectures. Status monitors run on each orbserver, delivering metadata about server connectivity, clients, and data streams to a central site. These metadata are saved in a near-real-time relational database. We generate directed- graphs from this database. From these, using the GraphViz graphical processor, we create interactive overview images of connectivity and dataflow. We present the current status of this technology; challenges we have encountered in its development; and application to multi-signal-domain sensor grids. We discuss the potential for further growth, including more sophisticated analysis algorithms and the possibility of automated, dynamic sensor-network reconfiguration. Dynamic Dataflow Topology Monitoring for Real-time Seismic Networks K.G. Lindquist *, T.S. Hansen ‡, B. Ludäscher ‡, F.L. Vernon † * Lindquist Consulting † Institute of Geophysics and Planetary Physics, UCSD (IGPP) ‡ San Diego Supercomputer Center (SDSC) For more information: The above diagram shows a dynamically generated snapshot of Anza network topology. The main components shown are Antelope orbservers (Antelope is a product of Boulder Real-Time Technologies, Inc.). The orbserver is a near-real-time object ring buffer for packetized data, in this case seismic data. Each one of these connections is created by an instance of the Antelope orb2orb command. Figures like the above are created in near-real-time based on status snapshots of the running ORBs. The pforbstat command creates ORB-packets with parameter-files containing summaries of clients and packet types. This information is distilled and used to create a description file for a directed graph, which is plotted via the open-source AT&T GraphViz application. Application Structure Future Directions The diagram above shows the basic components of the monitoring system. A pforbstat utility runs on each orb of interest. The results are encapsulated as parameter-file orb packets and placed back on the orb, where the new orbpf2db utility puts them into a database in the registry1.0 schema. Starting from the prototypes displayed here, we are currently working on a web-based implementation driven by the new Antelope interface to PHP, the web scripting language. This will allow web-clickable interfaces which can provide much more information about each orb, including available data sources and clients. Registry1.0 database Antelope PP Interface: Clickable, interactive Connectivity map Specific Orbserver Client srcname Connectivity Database… …Interactive Exploration Active Orbservers Real-time Databases Dataflow Latencies Connectivity Status The symbols with single-line outlines are Object Ring Buffers (ORBs), managed by instances of the Antelope orbserver command. Symbols with double-line outlines are near-real- time relational databases. These actually represent the orb2db client programs running on a given orb. As with the orb2orb instances, the orb2db clients are recognized in the pforbstat parameter file packets. The blue lines linking each box represent network connectivity with the dataflow latency (in seconds) above each respective line. Each of these connections is an instance of the Antelope orb2orb command. Change Detection In addition to presenting the current connectivity status, the orb topology-monitoring scripts are able to detect changes in the layout, most notably additions of new orbs or disappearances of existing ones. The diagrams at right are graphical summaries of detected changes that are ed to interested parties. Green objects are new appearances; red objects have disappeared from the pforbstat structures. The figure below shows a hypothetical future application, in which one could select a specific orb source-name from a list, and get a map of the orbs containing that source, with their latencies.