1. The future of astronomy and the ALMA Archive Felix Stoehr Subsystem Scientist

2. ADASS 2014, Calgary Success

3. ADASS 2014, Calgary The success of an observatory is measured by the science output of the community We can not make our own success: someone else is responsible for our success The goal for us therefore must be to render the end-to-end user- experience for PIs and archival researchers as perfect as possible Success

4. ADASS 2014, Calgary Future of astronomy

5. ADASS 2014, Calgary What do PIs do? Workload is shifting from PIs to observatories More complex telescopes and more data: pipelines and science- grade data-products will become integral part of the telescope/instrument design (e.g. ALMA pipeline) Next step: first science analysis done at the observatories (e.g. ALMA development program ADMIT) Workload Instrument construction Observation Data-reduction First analysis Scientific analysis Publication time today

6. ADASS 2014, Calgary ALMA will produce about the same amount of data in one year as ESO has produced in its first 50 years. (And ESO will, too!) LSST, LOFAR, SKA, PanStars, Euclid, Gaia, ELTs T. Tyson: “Astronomy is transformed from being a data-starved science to one where data is overabundant” Multi-wavelength science: less time per wavelength regime Astronomers do not scale : bytes/astronomer grow exponentially My prediction: Now: astronomers compete for observing time Future: observatories will compete for astronomers to work with their data Evolution of Astronomy

7. ADASS 2014, Calgary Not yet convinced? – ALMA's goal is to be usable by all astronomers – ALMA received 1380 proposals for Cycle 2, still the oversubscription factor was only 3.8! And ALMA will be offering 4x more hours and 2x more sensitivity – Solar observer: “In our field, the situation is already as you describe. Great data is there, astronomers are missing.” – galaxyzoo.org Evolution of Astronomy

8. ADASS 2014, Calgary All this will have a deep impact on how science is done Astronomers will become consumers of data instead of being co- producers. They can concentrate on the science Good: astronomy makes best use of astronomers Risk: astronomers may not understand data limitations Big challenge: really make the science-grade products Observatories will have a much larger responsibility In some areas: data-mining will gain importance It will be easier to have an archival career Speculation: publication fraction will go down Evolution of Science

9. ADASS 2014, Calgary The future will be even more parallel (even embarrassingly parallel will be too slow) Technical evolution Moore-type law? Hard disksyes I/O soeedno (if not SSD) Bandwidthyes Single TCP streamno CPU poweryes Single-core speedno

10. ADASS 2014, Calgary Science Archive Credits: Current: FS, Mark Lacy, Stéphane Leon, Erik Muller, Akiko Kawamura, Alisdair Manning, Christophe Moins, Dustin Jenkins (CADC) Former: Andreas Wicenec, Gary Fuller, Sandra Etoka, Masao Saito, Holger Meuss, Robert Kurowski, Rodrigo Tobar, Karla Parussel, Paolo Nunes, Stefano Zampieri, Norm Hill, Viola Wang, Stewart Williams, … External: inspiration from HST teams at CADC and ESO

11. ADASS 2014, Calgary 66 antennas at 5000m elevation in the Atacama Desert Interferometry with baselines up to 16km Wavelength range from 3mm to 400mm (84 to 702 GHz) Average data rate in full operations: 200TB/yr=6.6Mbytes/s Built by ESO, NRAO, NAOJ in cooperation with Chile ALMA C. Malin

12. ADASS 2014, Calgary Success? → best possible end-to-end user-experience Creating a Science Archive that allows archival researchers to discover and retrieve the data they can use, helps maximise the scientific return of ALMA Great return-for-investment ratio Science Archive Rationale

13. ADASS 2014, Calgary speak the language of the scientists. Query by physical concepts DANIEL DURAND TEST of science archives: You know have one, when you can find your own data by only giving physical parameter constraints provide only relevant information, keep hurdles small help users to quickly decide whether or not the data returned in a given search is relevant for them Science Archive Design

14. ADASS 2014, Calgary All public data and metadata is accessible anonymously PIs are normal archive users with more access rights Authors are required to acknowledge the use of ALMA data using a standard data tag Science Archive Policies

15. ADASS 2014, Calgary Still very limited (only raw data search, few search fields,...) http://almascience.org/aq

16. ADASS 2014, Calgary Success = maximizing the end-to-end user experience Astronomers not data will be the rare resource More work and responsibility will shift to observatories science-grade data reduction pipelines will be the norm All this will have a deep impact on how we do science Parallelism will be increasingly required The Science Archive follows that paradigm Queries on physical concepts, focus on relevant information, programmatic access, parallel downloads... Future: previews, first science-analysis ADMIT (P2.17), pipeline user-reprocessing (O7.8), visualization (O5.2), VO This will be golden times for astronomers Summary