Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASA Progress.

Slides:



Advertisements
Similar presentations
National Radio Astronomy Observatory June 13/14, 2005 EVLA Phase II Proposal Review EVLA Phase II Computing Development Bryan Butler (EVLA System Engineer.
Advertisements

Data Analysis Plan GBT IDL Workshop October 15, 2004.
Alternate Software Development Methodologies
MATLAB Extras Week 16 – 5/12/09 Kate Musgrave
Copyright © 2007 Software Quality Research Laboratory DANSE Software Quality Assurance Tom Swain Software Quality Research Laboratory University of Tennessee.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array.
Confidential 2008 Roadmap. confidential 2008 Solution Roadmap Main Themes The ChallengeOur Approach Actionable Analytics Non effective data analysis with.
What is R By: Wase Siddiqui. Introduction R is a programming language which is used for statistical computing and graphics. “R is a language and environment.
IT – DBMS Concepts Relational Database Theory.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
Chapter 2 The process Process, Methods, and Tools
CCSM Software Engineering Coordination Plan Tony Craig SEWG Meeting Feb 14-15, 2002 NCAR.
1 ANASAC Meeting – May 20, 2015 ALMA Pipeline Brian Glendenning (for Jeff Kern)
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Language(s) We plan to develop CALCOS using Python and C Another programming language?
McMullinEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing: SSG (AIPS++/CASA) Development J. McMullin.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Studies of Star.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Using CASA to Simulate.
OOI CI LCA REVIEW August 2010 Ocean Observatories Initiative OOI Cyberinfrastructure Architecture Overview Michael Meisinger Life Cycle Architecture Review.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Meeting Summary Richard.
Doug Tody E2E Perspective EVLA Advisory Committee Meeting December 14-15, 2004 EVLA Software E2E Perspective.
Mantid Development introduction Nick Draper 11/04/2008.
CRISP & SKA WP19 Status. Overview Staffing SKA Preconstruction phase Tiered Data Delivery Infrastructure Prototype deployment.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASA Parallelization.
EVLA Transition to Science Operations: An Overview EVLA Advisory Committee Meeting, March 19-20, 2009 Bob Dickman AD, NM Operations.
EVLA Software Bryan Butler. 2007May22EVLA SAGE Meeting2 Requirements and Goals of EVLA Software Maximize scientific throughput of the instrument At a.
The North American ALMA Science Center North America’s ALMA Regional Center The North American ALMA Science Center acts as the gateway to ALMA for North.
R MoeserCorrelator f2f Meeting1 MCAF (Metadata Capture and Formatting) Rich Moeser.
Land Ice Verification and Validation (LIVV) Kit Weak scaling behavior for a large dome- shaped test case. It shows that the scaling behavior of a new run.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array GBT Control System.
1 KFPA Critical Design Review – Fri., Jan. 30, 2009 KFPA Data Pipeline Bob Garwood- NRAO-CV.
SAGE meeting Socorro, May 22-23, 2007 EVLA Science Operations: the Array Science Center Claire Chandler NRAO/Socorro.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Data Processing Progress.
1 ANASAC Meeting – May 20, 2015 Mark Lacy ALMA archive status and plans.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Observing Scripts Basic.
ALMA and the Call for Early Science The Atacama Large (Sub)Millimeter Array (ALMA) is now under construction on the Chajnantor plain of the Chilean Andes.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
Development Status and Priorities Jeff Kern NRAO.
Robustness Initiative Jeff Kern NRAO. CASA Robustness and Reliability Number one priority from the CASA User Survey was reliability. – Survey did not.
CASA Users Survey Response and Progress Jeff Kern NRAO.
ESO, 17 April 2007ESAC meeting1 ALMA offline User Test 5 Silvia Leurini, ESO.
1 Alma SMART Collaborative Networks Collaboration Made Simple.
N. RadziwillEVLA Advisory Committee Meeting May 8-9, 2006 NRAO End to End (e2e) Operations Division Nicole M. Radziwill.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array ALMA Pipeline.
UlvestadEVLA Advisory Committee Meeting September 6-7, Future EVLA Operations Jim Ulvestad.
Atacama Large Millimeter/ submillimeter Array - ALMA ASAC Charges For Oct 31 ASAC Report to ALMA Board Al Wootten JAO Interim Project Scientist.
Future plans & strategy for CCP4 (for discussion) Tadeusz Skarzynski, 30 March 2006.
An NSF Facility Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Emmanuel Momjian (NRAO)
WebScan: Implementing QueryServer 2.0 Karl Geiger, Amgen Inc. BRS NA UG August 1999.
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
S.T.MyersEVLA Advisory Committee Meeting December 14-15, 2004 EVLA Data Post-processing Overview Steven T. Myers AIPS++ Project Scientist.
CASA Strategic Plan Subtitle Jeff Kern NRAO. CASA Global Context The CASA strategic plan describes the evolution of CASA over second half of the decade.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Short Spacing.
Documentation Analysis and Proposal Jeff kern NRAO.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Using CASA to Simulate.
Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array ngVLA: Reconfigurability.
VisIt Project Overview
NRAO-SKA Future Collaboration Meeting
Computing Architecture
EAC Butler - SSS Software
SDM workshop Strawman report History and Progress and Goal.
Welcome to ALMA Community Day!
Gustaaf van Moorsel September 9, 2003
Observatory Science Operations
EVLA Algorithm Research & Development
Observatory Science Operations
Presentation transcript:

Atacama Large Millimeter/submillimeter Array Karl G. Jansky Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array CASA Progress and Status ANASAC Face-to-Face Sept 16-17, 2013 Jeff Kern CASA Team Lead

ALMA CASA Status CASA is in routine use at ALMA and the VLA for daily operations. – Many other observatories are also using CASA 25% of NRAO CASA Helpdesk tickets are for non-NRAO telescopes Improvement in performance, ease of use, and robustness are being addressed as well as the development of additional features. Reviewed in March: – Report and response available: – Summary: Remain focused on VLA and ALMA needs Improve fundamentals of software engineering process 2ANASAC Face-to-Face: Sept. 16,

ALMA Organization Changes In the process of organizing a new CASA Users Committee to solicit input from a wider segment of the CASA users community. – Details still in progress – Designed to complement the CASA Science Steering Committee (CSSC) not replace. We are working closely with Science User Support (SUS) to do scientific validation of new CASA features prior to release. – Bi-weekly meeting to review test targets, status and assignments DMSG has added a software testing group focused on ALMA testing, including CASA: – Focused on improving automated software testing, not validation. 3

ALMA CASA Usage CASA Releases are downloaded around 2000 times per release – Widely distributed download sites Weak preference for ALMA partners 4

ALMA Performance CASA performance for most tasks is comparable with other packages. – Historical reputation for performance issues still linger. – Are some known poorly performing capabilities (plotting) Parallel CASA has been demonstrated to significantly improve performance. – User interface issues / learning curve have prevented wide acceptance Moving from home grown cluster management to MPI Working with Scientific Computing Infrastructure group to benchmark pipelines and identify performance bottlenecks. MSTransform task introduced: – Allows multiple actions on data with a single read from disk. – Consolidates duplicate code to single maintainable framework. 5

ALMA Performance: Data Access (Disk I/O) Unlike many other aspects of the processing equation, time alone will not solve the data access problem. 6

ALMA Performance Comparison Very simple imaging to try to minimize package variations All tests run on Socorro cluster node against Lustre CASA Review March – 4000 X 4000 pixels – 3000 Components – No Boxing – 0.5 arcsec – Number of Terms = 1 – Single pointing – No Widefield – No A-Term – Briggs weighting 0 Time to Image ~200 GB data set:

ALMA Performance Comparison CASA Review March CASAMIRIADAIPS 1 Major Cycle Serial Major Cycle Threaded 55 5 Major Cycles Serial Major Cycles Threaded Major Cycles Multi-process 74 All times in Minutes

ALMA Infrastructure Initiatives Continued effort on Parallelization, focused on delivery of capabilities to end users/ MSTransform to standardize I/O and decrease overall I/O volume Imager Update – Major re-architecting to improve interface, normalize options, support for new algorithms, regularization. Region Format: Unification and improvement across the package. Tool Documentation: Image tool is current focus, starting to work our way through the package. Imregrid: Major rework for more intuitive operation. SetJy: Reorganized for more clarity in options, scriptability (pipeline), and improved capabilities. 9

ALMA Recent Developments Support for Linear Polarized Feeds (Required for ALMA Cycle-2) Support for rapidly moving objects (Ephemeris Objects) throughout package Simulation update in support of Cycle-2 CFP Improved primary beam handling – Summer student Kara Kundert has extended her project to understand the effects of heterogeneous primary beams on image dynamic range. Single Dish: – Introduction of CalTable like interface (Pipeline Support) – Performance Improvements Feathering: Capability is undergoing continued enhancements 10

ALMA CASA Viewer Many improvements in the CASA viewer – Histogram generation and fitting – Spectral line display and fitting – Position-Velocity Curves – Interface improvements 11

ALMA CASA Viewer Primary View 12

ALMA CASA Viewer: Spectral Line Fitting 13

ALMA CASA Viewer Histogram fitting 14

ALMA ALMA Development Program CASA was very active in the ALMA Development program Studies: – NRAO PI: Interoperability of AstroPy and CASA Projects: – NRAO PI: [Sub-]Millimeter VLBI support in CASA – NRAO PI: Extended On Demand Computing CASA Execution in external environments XSEDE – NRAO CO-I: Post imaging Analytics Development of “value added” products for the pipeline – NRAO CO-I: Next Generation Viewer Collaborating on a Tera-Pixel viewer 15

16 The National Radio Astronomy Observatory is a facility of the National Science Foundation operated under cooperative agreement by Associated Universities, Inc. science.nrao.edu