EVLA M&C CDR EVLA Monitor Data Archive System John Benson, Chunai Cai NRAO Dec 6, 2006.

Slides:



Advertisements
Similar presentations
© 2008 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Chapter 8: Monitoring the Network Connecting Networks.
Advertisements

P3- Represent how data flows around a computer system
14-Jun-2004EVLA Software Design Review Transition Plan Bill Sahr 1 EVLA Hybrid Array & Transition Plan.
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
5-6 Dec, 2006EVLA M&C Critical Design ReviewRich Moeser 1 Alerts Rich Moeser.
Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.
Query Manager. QM is a collection of tools you can use to obtain information from the AS/400 database Used to –select, arrange, and analyze information.
Bill SahrEVLA M&C Transition System Software CDR December 5-6, EVLA Monitor & Control Transition System Software Overview.
NLC - The Next Linear Collider Project Lee Ann Yasukawa 05/25/99 NLC Archiving Requirements (Preliminary)
The Prototype Correlator Sonja Vrcic Socorro, 5. December, 2006.
James Robnett EVLA M&C Hardware PDR March EVLA Monitor and Control M&C Network.
EVLA Computing Overview Gareth Hunt EVLA Advisory Committee 2002 June
Systems Integration and Testing EVLA Advisory Committee Meeting, March 19-20, 2009 Jim Jackson Systems Engineer.
5-6 Dec, 2006EVLA M&C Critical Design ReviewRich Moeser 1 User Interfaces Rich Moeser.
Stanford Linear Accelerator Center R. Hall/L. Yasukawa1 EPICS Collaboration Mtg May 21, 2002 Oracle Storage for the Channel Archiver Managing Channel Archiver.
Overall Data Processing Architecture Review EVLA Monitor and Control Interfaces July , 2002EVLA Data Processing PDR Bill Sahr.
Bill SahrEVLA Advisory Committee Meeting May 8-9, EVLA Monitor & Control.
FitHAS, an easy to use assistant tool for FITS data archiving Wen Li, Chenzhou Cui, Ce Yu China-VO team NAOC & Tianjin University.
Bill Sahr EVLA M&C EVLA Advisory Committee Meeting December 14-15, EVLA Monitor & Control.
Pre-OTS Testing in Penticton Sonja Vrcic Socorro, December 11, 2007.
K. Y. LoEVLA Advisory Committee Meeting September 6-7, 2007 Charge to the Committee K. Y. Lo.
Wayne M. KoskiEVLA Front-End CDR – EVLA Receiver Monitor & Control April 24, EVLA Front-End CDR EVLA Receiver Monitor & Control F317 and F320 Modules.
Archive Access Tool Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 John Benson Scientist.
James Robnett EVLA M&C Hardware CDR October 20, EVLA Monitor and Control M&C Network.
Peter NapierEVLA Correlator CoDR Nov 2, EVLA Correlator CoDR P. Napier Overall EVLA Project Plan.
Long Term Transition Plan Gareth Hunt EVLA M&C PDR 2002 May 15.
2007Sep06 EAC Butler - Software Overview 1 Software Overview Bryan Butler.
EVLA Monitor & Control Transition System Software
P.NapierEVLA Advisory Comm, 14 Dec 2004 Project Overview Peter Napier, EVLA Project Manager Status 2003 Committee Response.
14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan.
Introduction to EVLA Software Bryan Butler. 2006Dec05/06EVLA M&C Transition Software CDR2 EVLA Computing (Terse) History The original EVLA Phase I proposal.
Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing Organization/Development.
Observation Preparation Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 David M. Harland SSS Group Lead.
Output Formats Part I Bryan Butler NRAO Oct-31EVLA Correlator f2f2 Overview 2 types of data: –Monitor data - of interest to engineers and system.
Interim Data Capture & Format (IDCAF) Walter Brisken 2006 Dec 6.
EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.
Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing End-to-end (E2e) software.
Author Wayne M. Koski EVLA Monitor & Control Hardware CDR October 20, EVLA Monitor and Control Monitor & Control Slot – ID.
Software Requirements for the Testing of Prototype Correlator Sonja Vrcic Socorro, December 11, 2007.
Bill SahrNSF Review May , EVLA Monitor & Control.
10 January 2006AAS EVLA Town Hall Meeting1 The EVLA: A North American Partnership The EVLA Project on the Web
Computing Introduction Gareth Hunt EVLA System PDR 2001 December 04.
Overall Data Processing Architecture EVLA timeline and priorities.
Author Wayne M. Koski EVLA Monitor & Control Hardware CDR October 20, EVLA Monitor and Control Monitor & Control Transition.
Author Wayne M. Koski EVLA Monitor & Control Hardware PDR March 13, EVLA Monitor and Control Monitor & Control Transition.
Master Correlator Control Computer (MCCC) Requirements & Status Sonja Vrcic Socorro, December 12, 2007.
Hoi Le. Why database? Spreadsheet is not good to: Store very large information Efficiently update data Use in multi-user mode Hoi Le2.
INTRODUCTION TO DATABASES (MICROSOFT ACCESS)
Chapter 11 Designing Effective Output
EVLA Archive The EVLA Archive is the E2E Archive
Committee Charge Fred K.Y. Lo
Monitor and Control Software
Tapping the Power of Your Historical Data
Chapter 8: Monitoring the Network
EVLA System PDR System Overview
Software Requirements
EVLA M/C Software PDR, 14 May 2002
Bryan Butler (for Bill Sahr)
EVLA Computing Reorganization
PDR Guidelines The purpose of the PDR of an EVLA Subsystem is principally to review 3 questions:   Are the top level performance requirements for the subsystem.
Charge to the Review Panel
EVLA Monitor & Control System
Gustaaf van Moorsel September 9, 2003
Software Requirements
Operations Software Bryan Butler.
ENGINEERING REQUIREMENTS FOR BENCH TESTING, SYSTEM INTEGRATION, AND TEST ANTENNA Author George Peck EVLA Software M&C PDR Date May 14 – 15, 2002.
EVLA M&C Components Observation Executor, Interim & Final Obs2script
EVLA Advisory Panel Mtg. System Overview
Requirements Bryan Butler.
Overview of Computer system
Presentation transcript:

EVLA M&C CDR EVLA Monitor Data Archive System John Benson, Chunai Cai NRAO Dec 6, 2006

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 2 Monitor Data Archive System

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 3 Monitor Data System Goals Ingest and store large amounts of monitor data –EVLA telescopes, WIDAR correlator –Other site modules (+AOC) Archived monitor data easily accessible –Accessible in real-time with web-based tools –Provide flexible query tools –Provide user friendly ‘what’s in the archive’ tool –Allow a variety of data output formats

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 4 Current Monitor Archive System Monitor Data Records –Slot_Id, Device Name, Mon Point Name, Time Stamp, Value –About 80 byte records -> Oracle DB tables at EVLA site –Currently 6 EVLA, 20 VLA ants, control room, benches –127 devices, mon points : 300 VLA, 600 EVLA Monitor Archive Data Rate –11.5 M records/day -> 1 GB/day, 10 kB/sec –Typical sample rate 1 per minute, some 1 per sec. –Expect 2000 mon pts per EVLA ant. –EVLA monitor data rate > 50 – 100 M recs/day (1 sample/min)

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 5 Current Monitor Archive System

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 6 Current Monitor Archive System

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 7 Upgrade Monitor Data Archive Enhance user interface – Chunai –New web-based tool providing cascading menus of slot_ids, devices, and monitor points in the archive within a user specified time range. –Query returns monitor points from several antennas –Query can return large numbers of mpts efficiently (10000’s) Reduce ingest data rate –Reset default sample rates on many mpts to minutes –Auto reset to back default rate Increase Oracle storage efficiency

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 8 Upgrade Monitor Data Archive

Dec 5 - 6, 2006EVLA M&C Transition S/W CDRJohn Benson 9 New Interface Tool New monitor data archive interface :