1. User Committee, Garching April 30 2010 ALMA Operations interaction with and support to the users Paola Andreani

2. User Committee, Garching April 30 2010 Meaning of ALMA Operations and the Joint ALMA Observatory

3. User Committee, Garching April 30 2010 Science Operations Astronomer ’ s perspective Principles: Non-experts should be able to use ALMA  Dynamic scheduler to match observing conditions  Reliable and consistent calibration  Data public in timely fashion

4. User Committee, Garching April 30 2010 Paola Andreani Operation Support Facility (OSF) ALMA Operations Sites in Chile 60 MB/s (peak) 6 MB/s (average) Antenna Operations Site (AOS) Santiago Central Office (SCO) array scheduling + operations quick-look, maintenance and repair issues of calls PRC process SB checks pipeline data reduction quality assessment Population of the archive

5. User Committee, Garching April 30 2010 High-level concepts for Science Operations Observations only in service observing mode with flexible (dynamic) scheduling. Observations 24h/day interrupted by maintenance periods. All observations executed in the form of scheduling blocks (SBs). Default output: reliable images, calibrated according to the calibration plan. The Joint ALMA Observatory (JAO) is responsible for the data product quality. All science and calibration raw data are captured and archived.

6. User Committee, Garching April 30 2010 Science Deliverables: uv-plane astronomical source and calibration data. Processed images, with supporting information on the data processing and quality assurance. Off-line data reduction software, including user support for installation and basic usage. Software tools for proposal and observation preparation, including user documentation. ALMA users manual. User support: Web pages Phase I and phase II support Helpdesk f2f support Data delivery Archive

7. User Committee, Garching April 30 2010 *Tokyo *Garching *Cvlle *Santiago *ALMA site ALMA Science Operations sites OSF, Santiago and the ARCs

8. User Committee, Garching April 30 2010 Joint ALMA Observatory (JAO) ALMA is operated by the JAO. The ALMA Regional Centres (ARCs) form an integral part of JAO operations. ALMA Director Department of Science Operations Department of Technical Services Department of Administration ARCs (NA, EU, EA) Safety Executives (NA, EU, EA) HREPO

9. User Committee, Garching April 30 2010 The Regional centres

10. User Committee, Garching April 30 2010 ALMA Operations: Three ALMA Regional Centres - ARCs Joint ALMA Observatory NA ARCEU ARC (ESO) EA ARC NAOJ “Satellite” EU ARCs NAASC ARCs provide user interface, archive, software tools data delivery Astronomers on duty Enhanced User Services Enhanced services are needed to provide advanced user support, algorithm development, student programs, EPO, grants DSO provides: Array operations Scheduling of projects Execution of observations Data quality assurance and trend analysis Calibration plan maintenance Delivery of data to the archives Archive operations Pipeline operations

11. User Committee, Garching April 30 2010 The ARCs and their relation to the JAO

12. User Committee, Garching April 30 2010 Work flow of ALMA Operations

13. User Committee, Garching April 30 2010 Getting ALMA time

14. User Committee, Garching April 30 2010 Archive User Interface (User Portal will be based on this)

15. User Committee, Garching April 30 2010 ALMA User Portal Helpdes k Proj.TrackrArchive User Preferences John Hibbard NRAO, 520 Edgemont Rd Charlotesville VA USA Jhibbard@nrao.edu,Jhibbard@nrao.edu, jehibbard@gmail.com, mcboy@hotmail.comjehibbard@gmail.com Affiliated Executive: NAm Preferred ARC: NAm … Proposals User Portal provides access to all on-line end-user ALMA applications. Some applications available only after authentication ALMA User Portal Login Username: Password: Helpdes k Proj.TrackrArchiveProposals User Portal

16. User Committee, Garching April 30 2010 Observers’ affiliation identified on observing proposal P.I. (name, info) Co-I 1 Co-I 2 Co-I 3 Co-I 4 … NA EU EA Chile Non-ALMA member X X X X X X X X X X X X X X X X X X X X … (Default associations filled in from users User Profile preferences) Affiliation

17. User Committee, Garching April 30 2010 Observers’ affiliation identified in User Portal profile Eligible Affiliations Preferred ARC for support NA EU EA Chile Non-ALMA member X X X X X X X X (checkbox; i.e. multiple selections allowed) (radio button; i.e. only single selection allowed)

18. User Committee, Garching April 30 2010 the ALMA software shall offer an easy to use interface to any user and should not assume detailed knowledge of millimetre astronomy and of the ALMA hardware The ALMA observing tool

19. User Committee, Garching April 30 2010 Getting ALMA time  Joint ALMA Observatory issues calls for proposals Register on the ALMA web page Prepare a proposal with the ALMA Observing Tool user can contact their ARC node for assistance  European ARC provides documentation  ALMA Observatory (with ARCs help) coordinates refereeing process  Program Review Committee ranks proposals  Executives approval Phase I MAKE A PROPOSAL! Scientific case Instrument setup: frequency rms S/N source extension spatial resolution

20. User Committee, Garching April 30 2010 The ALMA Observing tool Split Observing Programs in two parts: a Phase I Observing Proposal –emphasis on the scientific justification of the proposed observations. a Phase II Observing Program –submitted only if observing time has been granted. Set of Scheduling Blocks (SBs) –required to drive observing with ALMA. – the SB contains a full description of how the science target and the calibration targets are to be observed sets of SBs can be combined with a description for the post processing of the data, ultimately resulting in an image.

21. User Committee, Garching April 30 2010 Getting ALMA time  Phase I: Proposals are submitted using ALMA Observing Tool  Phase II: Successful PIs submit observing programme using the Observing Tool  Preparation of the scheduling blocks  European ARC helps with observation planning and validates observing schedule Phase II

22. User Committee, Garching April 30 2010 The ALMA observing tool More details in Liz’s presentation

23. User Committee, Garching April 30 2010 ALMA helpdesk (kayako, being evaluated for ALMA)

24. User Committee, Garching April 30 2010 JAO ARCs PS Phase 1 Project PRC PS Phase 2 Technical feasibility Scheduling JAO Medium Term Queue Long Term Queue Archive ALMA DATA FLOW Blocks

25. User Committee, Garching April 30 2010 Getting ALMA data

26. User Committee, Garching April 30 2010 Getting ALMA data  Queue based dynamic scheduling  Programs are composed of 30-60 min scheduling blocks  Raw data pass through multi-tiered quality assurance  Combination of on-site duty astronomer, ARC staff, and automated checks  Data proceeds to pipeline and archiving  Data available from ARC (ESO) within ~2 weeks (TBD, quicker if internet available)  Pipeline products (images and calibrated u-v data), raw data, off-line data processing software made available to Pis  Expert hands-on data reduction help from ARC nodes staff provided on request, helpdesk also available at ESO

27. User Committee, Garching April 30 2010 Main ALMA Archive ALMA Regional Center North America ALMA Regional Center Europe ALMA Regional Center Japan/Asia ALMA Science Archive ALMA Frontend Archive Archive nodes at the OSF, SCO and the ARCs ARC archive nodes delivered, commissioned and activated as soon as possible after SCO archive. During science operations ARC nodes are synchronized with the central archive through internet (small data sets) or via physical media. OSF connected to SCO via high-bandwidth. It MUST be always possible to operate ALMA even if the internet link does not work The ALMA archives and data distribution

28. User Committee, Garching April 30 2010 Data reduction

29. User Committee, Garching April 30 2010 Data Available for download Available data: –Raw UV visibilities –Calibration & flagging tables –Casapy reduction scripts –Imaging products (calibrated cubes & reference images) –Source visibilities with calibration & flagging applied

30. User Committee, Garching April 30 2010 Offline Data Processing Download CASA & CASA documentation/guides/use cases –Interface: JAO & ARC webs –Actors: JAO & ARCs, assembling & posting material Attend CASA tutorial –Interface & Actors: ARCs, including nodes Ask questions –Interface: UP:helpdesk –Actor: ARCs Visit ARC or ARC node for face-to-face support –Interface & Actors: ARCs, including nodes

31. User Committee, Garching April 30 2010 suite of C++ application libraries packaged through a Python scripting interface extensively tested C.A.S.A.: Common Astronomy Software Applications Primary goals: supporting the data post-processing needs of the next generation of radio astronomical telescopes such as ALMA and EVLA projects The ALMA offline reduction package (CASA) See Dirk’s presentation

32. User Committee, Garching April 30 2010 Simulating the data

33. User Committee, Garching April 30 2010 protoplanet

34. User Committee, Garching April 30 2010 In one command, CASA generates o uv data (with thermal noise if desired) o a dirty and cleaned image. o a diagnostic window including your input the simulated image

35. User Committee, Garching April 30 2010 In one command, CASA generates o uv data (with thermal noise if desired) o a dirty and cleaned image. o a diagnostic window including your input the simulated image the difference uv coverage and dirty beam or PSF

36. User Committee, Garching April 30 2010 The ALMA Regional Centres The European ARC

37. User Committee, Garching April 30 2010 The European ARC ARC Department Data Management Operations Division Data Management Operations Division Director of Operations Ondrejov (CZ) Ondrejov (CZ)

38. User Committee, Garching April 30 2010 The ALMA Regional Centres The European ARC network

39. User Committee, Garching April 30 2010    : express interest  : ARC nodes The European ARC network Paola Andreani European Southern Observatory

40. User Committee, Garching April 30 2010 The European ARC Core functions –Scientific support: Proposal & observation preparation user support –Archive Operations: host a copy, data delivery –Astronomer on duty at OSF –Science community activity –User support: f2f help Non-core functions Data reduction –Advanced pipeline –Extended archive support –Support for special projects –Science community activity: training, schools, workshops ESO: ARC Department ARC nodes ESO ARC + nodes ARC nodes ALMA simulators

41. User Committee, Garching April 30 2010 The role of the central node (@ ESO) Support the European users from proposal preparations to data delivery through the helpdesk Validation of the Scheduling Blocks Help in the technical assessment of the proposals Provide help to the proposal handling team Host and maintain a complete mirror of the ALMA archive Provide duties at the OSF during observations Manage the ARC nodes 41

42. User Committee, Garching April 30 2010 The ESO ARC staff ARC Astronomers: Scientific user support (proposal, SB, OSF duties, technical assessment, proposal handling) Help in managing the nodes ARC Astronomers: Scientific user support (proposal, SB, OSF duties, technical assessment, proposal handling) Help in managing the nodes ARC scientists Helpdesk, SW testing and implementation, SW feedback, archive queries ARC scientists Helpdesk, SW testing and implementation, SW feedback, archive queries Archive operations (system administration, data delivery, database) 7 astronomers 5 scientists 5 contractors

43. User Committee, Garching April 30 2010 The role of the ARC nodes Provide one to one user support (proposal, SBs preparation, data reduction, archive research) Participate in the helpdesk New software and techniques Advanced data reduction Scientific community development Public relations and outreach

44. User Committee, Garching April 30 2010 The ARC nodes: staff Bonn-Bochum-Cologne, Germany (F. Bertoldi) Current staff: Bonn: 2 staff astronomers (part-time 25-50%), 1 postdoc, IT support; Cologne: 4 staff astronomers (part time 5-10%); Bochum: 3 staff astronomers (part time 30%) + 2 COFUND Fellows Bologna, Italy, (J. Brand) Current staff: 5 staff astronomers (part-time), 3 postdocs, 1 technician, IT support, 1 staff position advertised + 1 COFUND Fellow Onsala, Denmark, Sweden, Finland (J. Conway) Current staff: 1 staff astronomers (at 30%), 1 astronomer + 1 SW engineer, maybe 1 more position IRAM, Grenoble, France, Spain, Germany (F. Gueth) Current staff: 5 IRAM staff share the task ALMA/PdB support (10-50 %) 1 postdoc, + 3 SW engineer + 1 COFUND Fellows Leiden, The Netherlands, (M. Hogerheijde) Current staff: 2 staff astronomers (part-time) + 2 postdocs, + 1 COFUND Fellow Manchester, United Kingdom (T. Muxlow) Current staff: 4 staff astronomers (10-50%), 1 staff 100%, + 1 COFUND Fellow Ondřejov, Czech Republic (M. Karlický) Current staff: 4 staff astronomers (10-50%), 1 SW engineer, IT support, 2 postdoc

45. User Committee, Garching April 30 2010 List of expertise areas in the EU ARC nodes High-frequency observing NL Wide-field and high-dynamic-range imaging - UK/NL/IRAM (IRAM: short-spacings too) Mosaicing - I Infrastructure for advanced data analysis tools – DE/NL/Nordic (Collaboration between the Netherlands and Nordic Countries exists; ASTRONET funded ARTIST collaboration between Germany and Netherlands) Data handling/GRID-technology- I Molecular spectroscopy, catalogues, models, NL/DE/CZ Coordinating surveys/key-projects- I/UK Polarimetry – DE/IRAM/I/UK Astrometry – Nordic/DE/UK Multi-frequency synthesis - Nordic/UK Array combination imaging- UK (combining ACA and 12m array) Robust self-calibration methods - Nordic/UK Atmospheric phase calibration and use of the WVR data – IRAM/Nordic/UK ALMA imaging simulations – IRAM/UK Interoperability and data publication UK Solar physics CZ

46. User Committee, Garching April 30 2010 Activities of the EU ARC @ESO Preparing user support (SW users testing, SW feedback, helpdesk) ALMA simulations/simulator Participation in Commissioning/Science Verification Tutorials (data reduction, Observing Tool) Promoting ALMA in the community (workshops, community days, public/scientific talks) Participation in schools Archive installation/testing

47. User Committee, Garching April 30 2010 Activities of the EU ARC @ ARC nodes Participation to Commissioning/Science Verification Tutorials (data reduction) Promoting ALMA in the community (workshops, community days, talks) Organisation of schools Applying for funding Advanced algorithms

48. User Committee, Garching April 30 2010 User support and helpdesk ARC nodes: f2f support, helpdesk, SW feedback, community activity

49. User Committee, Garching April 30 2010 Current Timeline Start of CSV (Commissioning and Science Verification): End 2009 (3 antennas at the AOS) ESDP (Early Science Decision Point): Nov 2010 (call for proposals) –Mirror Archives in place –ALMA User Portal activated –ALMA Helpdesk activated Deadline for proposals (Early 2011) –PRC review procedure initiated Deadline for PRC final ranking (Mid 2011) –Preparation of SBs Start Early Science: Autumn 2011 –Take and deliver data Inauguration: September 2012 –More than 50 fully equipped antennas Baseline ALMA Construction Complete 2013

50. User Committee, Garching April 30 2010 Early Science Operations Start Science Operations before the ALMA construction finishes Minimum requirements for Early Science Goals for Early Science Early Science Operations –One year scheduling period –Time shared with commissioning. At least 33% of available time will be used for observations

51. User Committee, Garching April 30 2010 Minimum requirements for Early Science Operations –16 antennas with at least 3 receiver bands –Single field interferometry –Baselines out to 250m –Correlator modes (~20): a mixture of pseudo-continuum (Time Division Mode) and spectral line (Frequency Division Mode) correlator configurations. –Single dish mapping (zero baseline observations) of extended objects in continuum and spectral line mode –Calibration better or comparable with existing mm-arrays

52. User Committee, Garching April 30 2010 Goals for Early Science In addition to the above minimum requirements: Frequency bands: 3, 6, 7 and 9 on all antennas and 4 and 8 on as many as possibleFrequency bands Array configurations: additional spacings out to a maximum baseline of 1 km Observing modes: interferometric pointed mosaics Polarization: linear and circular polarization observations of compact sources Single dish: extended sources mappable in either continuum or spectral lines, including On-The-Fly (continuous scanning) Calibration: to a level better than already achieved on established mm arrays In addition to the above minimum requirements: Frequency bands: 3, 6, 7 and 9 on all antennas and 4 and 8 on as many as possibleFrequency bands Array configurations: additional spacings out to a maximum baseline of 1 km Observing modes: interferometric pointed mosaics Polarization: linear and circular polarization observations of compact sources Single dish: extended sources mappable in either continuum or spectral lines, including On-The-Fly (continuous scanning) Calibration: to a level better than already achieved on established mm arrays The first Call for Proposals will detail exactly what will be available for Early Science. The first Call for Proposals will detail exactly what will be available for Early Science.