S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing Overview Steven T. Myers AIPS++ Project Scientist.

Slides:



Advertisements
Similar presentations
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Advertisements

Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.
EVLA Computing Schedule, Staffing, Testing, Tracking.
Jim UlvestadEVLA Mid-Project Review May 11-12, EVLA Operations Jim Ulvestad Array Science Center Concept (Requirements) Staffing and Cost Plans.
C. ChandlerEVLA Advisory Committee Meeting September 6-7, Scientific Commissioning Plan Claire Chandler.
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
EVLA Computing Overview Gareth Hunt EVLA Advisory Committee 2002 June
EVLA Early Science: Shared Risk Observing EVLA Advisory Committee Meeting, March 19-20, 2009 Claire Chandler Deputy AD for Science, NM Ops.
McMullinEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing: SSG (AIPS++/CASA) Development J. McMullin.
S.T. MyersEVLA Advisory Committee Meeting September 6-7, 2007 EVLA Algorithm Research & Development Steven T. Myers (NRAO) CASA Project Scientist with.
ALMA Software B.E. Glendenning (NRAO). 2 ALMA “High Frequency VLA” in Chile Presently a European/North American Project –Japan is almost certainly joining.
Post-processing Bryan Butler, for Joe McMullin. Bryan ButlerEVLA NSF Review 2006May EVLA Post-processing Mission: Primary purpose is to provide.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASA Progress.
RadioNet First Software Forum, Jodrell Bank – 01Mar05 1 Algorthmic Issues from the First RadioNet Software Forum – a synthesis Steven T. Myers National.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
N. RadziwillEVLA NSF Mid-Project Report May 11-12, 2006 NRAO End to End (e2e) Operations Division Nicole M. Radziwill.
Correlator Growth Path EVLA Advisory Committee Meeting, March 19-20, 2009 Michael P. Rupen Project Scientist for WIDAR.
K. Y. LoEVLA Advisory Committee Meeting September 6-7, 2007 Charge to the Committee K. Y. Lo.
EVLA Transition to Science Operations: An Overview EVLA Advisory Committee Meeting, March 19-20, 2009 Bob Dickman AD, NM Operations.
Gustaaf van MoorselEVLA Advisory Committee Meeting May 8-9, 2006 EVLA Computing Software Overview.
EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.
2007Sep06 EAC Butler - Software Overview 1 Software Overview Bryan Butler.
Sanjay BhatnagarEVLA Advisory Committee Meeting May 8-9, EVLA Algorithm Research & Development Progress & Plans Sanjay Bhatnagar CASA/EVLA.
1 National Radio Astronomy Observatory NRAO Users Committee Meeting – May 20-21, 2008 Common Astronomy Software Applications (CASA) Crystal Brogan and.
1 KFPA Critical Design Review – Fri., Jan. 30, 2009 KFPA Data Pipeline Bob Garwood- NRAO-CV.
SAGE meeting Socorro, May 22-23, 2007 EVLA Science Operations: the Array Science Center Claire Chandler NRAO/Socorro.
P. NapierEVLA Advisory Committee Meeting September 8-9, EVLA Advisory Committee Project Overview P. Napier, Project Manager Management, Schedule,
December2002, Garching ALMA Computing IDR ALMA AIPS++ Audit Steven T. Myers (NRAO)
P.NapierEVLA Advisory Comm, 14 Dec 2004 Project Overview Peter Napier, EVLA Project Manager Status 2003 Committee Response.
RupenEVLA Advisory Committee Meeting May 8-9, Scientific Oversight and Testing of Software Michael P. Rupen EVLA Project Scientist for Software.
Post-processing Overview Bryan Butler, for Joe McMullin.
EVLA Computing Software Overview. Gustaaf van MoorselEVLA Advisory Committee Meeting May 8-9, Contents History Organization and staffing Staffing.
Recent progress in EVLA-specific algorithms EVLA Advisory Committee Meeting, March 19-20, 2009 S. Bhatnagar and U. Rau.
Bryan ButlerEAC meeting 2003-Sep-091 Computing Issues: Scientific Requirements Bryan Butler EVLA Project Scientist for Software (starting 2003-Oct-01)
RupenEVLA Advisory Committee Meeting May 8-9, Software Requirements Michael P. Rupen EVLA Project Scientist for Software rev. 3may06.
N. RadziwillEVLA Advisory Committee Meeting May 8-9, 2006 NRAO End to End (e2e) Operations Division Nicole M. Radziwill.
National Radio Astronomy Observatory May 10, 2006 – EVLA Advisory Committee Meeting Post-processing Overview Bryan Butler (& Joe McMullin) (NRAO-AOC)
UlvestadEVLA Advisory Committee Meeting September 6-7, Future EVLA Operations Jim Ulvestad.
M.P. RupenEVLA Advisory Committee Meeting September 6-7, Correlator Test Plan Michael P. Rupen.
Frazer OwenNSF EVLA Mid-Project Review May 11-12, Transition to EVLA
Gustaaf van MoorselEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Computing End-to-end (E2e) software.
Computing Introduction Gareth Hunt EVLA System PDR 2001 December 04.
Jim UlvestadEVLA Advisory Committee Meeting May 8-9, EVLA Operations Jim Ulvestad Array Science Center Concept Requirements Staffing and Cost Plans.
RupenEVLA Advisory Committee Meeting May 8-9, Software Testing Michael P. Rupen EVLA Project Scientist for Software.
SAGE meeting Socorro, May 22-23, 2007 WIDAR Correlator Overview Michael P. Rupen Project Scientist for WIDAR & Software.
Imaging issues Full beam, full bandwidth, full Stokes noise limited imaging Algorithmic Requirements: –PB corrections: Rotation, Freq. & Poln. dependence,
Bryan Butler EVLA Computing Division Head
NRAO VLA Archive Survey
Imaging and Calibration Challenges
Committee Charge Fred K.Y. Lo
EAC Butler - SSS Software
EVLA Computing Software Overview.
Software Requirements
Scientific Oversight and Testing of Software
VLA to EVLA Transition Plan
NRAO Computing Re-organization
EVLA Advisory Committee Meeting
Science Commissioning
Software Requirements
Gustaaf van Moorsel September 9, 2003
Software Requirements
Shared Risk Science with the EVLA
Mark McKinnon EVLA Project Manager
Observatory Science Operations
EVLA Algorithm Research & Development
EVLA Operations Jim Ulvestad
Observatory Science Operations
Correlator Growth Path
EVLA Postprocessing Algorithms
Post-processing Overview
Presentation transcript:

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing Overview Steven T. Myers AIPS++ Project Scientist

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 Goals Fulfill project requirements –post-processing requirements (Butler, Myers) Meet delivery schedule –management plan (McMullin, Greisen) Functionality, Robustness, Usability –integrated development & testing plan Efficient use of resources –maximize co-development with ALMA

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 AIPS extensively developed & well-tested will be used in commissioning –avoid commissioning both telescope & software! plan: continued support + targeted development –support current VLA users –develop new functionality (e.g. auto-flagging, RFI) –support as much of EVLA processing as is practical

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 aips++/casa primary support for full EVLA processing maximize co-development with ALMA –most core functions are in common –share development team & management merge EVLA and ALMA development plans –EVLA focus on “Delta” problems EVLA testing during development cycles –ALMA tests already use VLA data!

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 Usability & Interface Interface –current focus on CLI and scripting for functionality –necessary special purpose “GUI”s (e.g. viewer) only General GUI development –defer to new Framework development(s) –scheduled for 2007 Usability is key for EVLA user acceptance –rely on scientist input (e.g. NAUG)

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 Problems Difficult EVLA problems –wide-band wide-field full polarization imaging –high dynamic range high-fidelity imaging –also: RFI, pipelines Data rates –2008 spec 25 MB/s max (cf. VLA 0.1 MB/s) –WIDAR can produce much higher rates! –data volumes also (TB datasets)

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 Algorithms Algorithms group –led by Bhatnagar & Myers (formerly Cornwell) –includes AIPS & aips++/casa developers, students –NRAO-wide staff participation (e.g. NAWG) Progress –w-projection, pointing corrections (TC, SB, KG); –autoflagging, RFI (EG, BC); pol. beam (TC,SG,KG); –RFI (TC,RP,SB,KG); MS-clean (TC,SB,KG,EG)

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 Risks & Issues difficult problems (e.g. wide-band MFS) schedule (tight given current resources) data rates & size  cluster computing? user interface (“green hole”) aips++ support for VLA? or EVLA only in 2007? pipelines: afford development & ops support? new frameworks (ACS? general? developer?)

S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 Appendix: Groups NAUG = NRAO Aips++ User Group –aips++/casa programmers and scientific staff –currently ~1 FTE of testers (AOC & CV) –pre-testing for ALMA and EVLA –use cases and development guidance NAWG = NRAO Algorithms Working Group –started Nov 2005, scientific staff NRAO wide –regular forum to discuss algorithm issues