Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.

Slides:



Advertisements
Similar presentations
Implementing Tableau Server in an Enterprise Environment
Advertisements

Remote Visualisation System (RVS) By: Anil Chandra.
Program Management Portal: Overview for the Client
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Bill SahrEVLA M&C Transition System Software CDR December 5-6, EVLA Monitor & Control Transition System Software Overview.
Twelfth Synthesis Imaging Workshop 2010 June 8-15 Observation Preparation Tool (OPT) Loránt Sjouwerman (NRAO/Socorro)
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
NRAO Proposal Tool (PST) Gustaaf van Moorsel NRAO Community Day 1/13/2012.
FHIRFarm – How to build a FHIR Server Farm (quickly)
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
Basics of Web Databases With the advent of Web database technology, Web pages are no longer static, but dynamic with connection to a back-end database.
EXtensible Neuroimaging Archive Toolkit (XNAT) Washington University Neuroinformatics Group.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Emmanuel Momjian (NRAO)
Portal and Proposal Submission Review of SSS Software Readiness for SRO, June 5, 2009 Bryan Butler EVLA Computing Division Head.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting June 13-14, 2002.
Instant Messaging for the Workplace A pure collaborative communication tool that does not distract users from their normal activities.
Overall Design of SSS Software Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 David M. Harland SSS Group Lead.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.
ALMA Software B.E. Glendenning (NRAO). 2 ALMA “High Frequency VLA” in Chile Presently a European/North American Project –Japan is almost certainly joining.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
Overall Data Processing Architecture Review EVLA Monitor and Control Interfaces July , 2002EVLA Data Processing PDR Bill Sahr.
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
Correlator Growth Path EVLA Advisory Committee Meeting, March 19-20, 2009 Michael P. Rupen Project Scientist for WIDAR.
Bill SahrEVLA Advisory Committee Meeting May 8-9, EVLA Monitor & Control.
Software Status Sonja Vrcic Socorro,
Observation Scheduling Review of SSS Software Readiness for SRO, June 5, 2009 Bryan Butler EVLA Computing Division Head.
14 June 2004System-wide Services: User InterfaceRich Moeser 1 EVLA Overall Software Design Final Internal Review System-wide Services: User Interface.
Archive Access Tool Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 John Benson Scientist.
Gustaaf van MoorselEVLA Advisory Committee Meeting May 8-9, 2006 EVLA Computing Software Overview.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.
R MoeserCorrelator f2f Meeting1 MCAF (Metadata Capture and Formatting) Rich Moeser.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
2007Sep06 EAC Butler - Software Overview 1 Software Overview Bryan Butler.
The ATNF Pulsar Data Archive Matthew Whiting (ATNF) Albert Teoh, David Smith, Lucyna Kedziora-Chudczer, Dick Manchester, Vince McIntyre 2nd Gravitational.
Introduction to EVLA Software Bryan Butler. 2006Dec05/06EVLA M&C Transition Software CDR2 EVLA Computing (Terse) History The original EVLA Phase I proposal.
Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing Organization/Development.
How to Deploy and Configure the Smart Net Total Care CSPC Collector
EVLA Computing Software Overview. Gustaaf van MoorselEVLA Advisory Committee Meeting May 8-9, Contents History Organization and staffing Staffing.
Metadata Input Tool for CADIS Scientists and Data Managers by D. Stott August 8, 2007.
Observation Preparation Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 David M. Harland SSS Group Lead.
RupenEVLA Advisory Committee Meeting May 8-9, Software Requirements Michael P. Rupen EVLA Project Scientist for Software rev. 3may06.
EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.
Correlator GUI Sonja Vrcic Socorro, April 3, 2006.
Frazer OwenNSF EVLA Mid-Project Review May 11-12, Transition to EVLA
EVLA Software - Overview Bryan Butler NRAO. Bryan ButlerEVLA NSF Review 2006May History of EVLA Computing (1) EVLA computing consists of three parts:
Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing End-to-end (E2e) software.
This material is based upon work supported by the U.S. Department of Energy Office of Science under Cooperative Agreement DE-SC Michigan State.
Software Requirements for the Testing of Prototype Correlator Sonja Vrcic Socorro, December 11, 2007.
Bill SahrNSF Review May , EVLA Monitor & Control.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
EVLA Data Processing PDR Pipeline design Tim Cornwell, NRAO.
Master Correlator Control Computer (MCCC) Requirements & Status Sonja Vrcic Socorro, December 12, 2007.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Download Manager software Training Workshop Ostend, Belgium, 20 th May 2014 D.M.A. Schaap - Technical Coordinator.
Architecture Review 10/11/2004
Interaction of SSS Software
Bryan Butler EVLA Computing Division Head
EVLA Archive The EVLA Archive is the E2E Archive
EAC Butler - SSS Software
Monitor and Control Software
EVLA Overall Software Design
EVLA Computing Software Overview.
Gustaaf van Moorsel September 9, 2003
Software Requirements
EVLA Advisory Committee Meeting, March 19-20, 2009
Requirements Bryan Butler.
SDMX IT Tools SDMX Registry
Presentation transcript:

Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler

Major Subsystems NRAO OEO –User Portal –Proposal Preparation & Submission EVLA SSS –Source Catalog –Observation Preparation –Array Scheduling –Archive Access 2 of 13 Software for SSS

Development Process Documented build process High and low level software documentation Source code control Suite of unit tests, run during nightly builds Pre-release test machine for user acceptance (URLs to documents on final slide)‏ 3 of 13 Software for SSS

Current Status Interaction with NRAO User Database Fetching Proposals and Creating Projects Source Catalog Tool Resource Catalog Tool Observation Preparation Tool Observation Scheduling Tool Archive Access Tool 4 of 13 Software for SSS

Interaction with NRAO User Database OPT talks to query server, receives user information as XML Authentication: user has valid ID and password –This works now Authorization: user is permitted to perform requested activity –OEO will provide support in user DB –SSS will then update its applications to give: Project author the ability to allow others to view / edit their projects Selected NRAO staff ability to update read-only values 5 of 13 Software for SSS

Fetching Proposals & Creating Projects Goal: fetch newly approved proposals from DB and have software create skeleton projects SSS is working with OEO on XML representation of proposal OEO will have query server for fetching proposals 6 of 13 Software for SSS

Source Catalog Tool Loosely coupled to OPT; can be used on its own Supports text file import / export –Formats: XML, PST, (partial GBT) Beyond 2009: –Ability to call up flux density history –Connection to archive for images –Graphical displays of calibrator positions –Intelligent selection of calibrators 7 of 13 Software for SSS

Resource Catalog Tool Also loosely coupled to OPT Original intent: support only WIDAR –Agreed to support VLA correlator for Ka band Has been used for real science All planned 2009 work will be to support WIDAR –Starting with user interface for experts Experts can fine tune, but will not get much guidance –For OSRO we will have preconfigured standard setups Users will be able to customize tuning, but little else Ultimate plan for non-experts: allow observer to enter science- oriented criteria and have software auto-configure WIDAR –Users can choose to adjust configuration 8 of 13 Software for SSS

Observation Preparation Tool Current version is 0.5.x –Will probably deem OSRO / WIDAR release as 1.0 Major features are in place Is being used now for Ka-band –Can also use for any EVLA receiver band –Is only supported way to access new tuning ranges of EVLA Bulk of 2009 work will be: –Supporting major browsers –Responding to issues found in testing –Improving user experience Eg, bulk updates, easy way to survey hundreds of sources –Need only limited changes for WIDAR Most of the hardware variability is in RCT 9 of 13 Software for SSS

Observation Scheduling Tool Functioning dynamic scheduling system currently used in transition observing, has been used for several years now (derived from the VLBA dynamic scheduling system)‏ All command line Providing us with invaluable information on the practical aspects of dynamic scheduling of a many-element radio interferometer New tool which fits in to the rest of the EVLA software system has been developed GUI – much easier to use than old CLI Provides framework for testing many different heuristic schemes Will be deployed as resources allow 10 of 13 Software for SSS

Archive Access Tool VLA and VLBA data currently accessible via web application (all unprocessed visibility data as well as ~ pipeline-reduced VLA "reference images" from ; images also available via VO)‏ Extensively tested; available since October 2003 Non-proprietary data openly available Proprietary data made available via Portal login or staff-generated “key” Both simple (Project ID, for example), and complex (akin to VO cone search) searches supported More data downloaded via this mechanism than is taken real-time at the VLA (~3 GB/day)‏ Built on the foundation of the ALMA NGAS data storage system EVLA data taken via prototype WIDAR and WIDAR0 automatically handled 11 of 13 Software for SSS

Very Brief Demonstration of OPT Software for SSS 12 of 13

References Observation Preparation Tool (OPT)‏ –Test: –Production: Source Catalog Tool (SCT)‏ –Test: –Production: Archive Access Tool (AAT)‏: SSS Documentation: SSS Wiki (internal): of 13 Software for SSS