5-6 February 2007 Brazil VO1 The Origins, Formation, and Scientific Promise of the Virtual Observatory Robert Hanisch Space Telescope Science Institute.

Slides:



Advertisements
Similar presentations
Trying to Use Databases for Science Jim Gray Microsoft Research
Advertisements

VO/IVOA and The Astronomy Community Dave De Young NOAO.
NVO SSC1 NVO Science Overview for the NVO Science Steering Committee Alex Szalay, Dave De Young, Bob Hanisch US NVO Project T HE US N ATIONAL.
NVO Summer School VO Protocols and Jargon Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
9/14/2006NVOSS III1 The Future of the Virtual Observatory Robert Hanisch US NVO Project Manager Space Telescope Science Institute T HE US N ATIONAL V IRTUAL.
Discovery and Exploration in the VO Chris Miller NOAO/CTIO La Serena, Chile T HE US N ATIONAL V IRTUAL O BSERVATORY.
1 Science and the VO – Overview and Discussion Dave De Young NVO Project Scientist NOAO NVOSS Santa Fe September 2008.
Introduction: The Virtual Observatory and Astronomical Data Robert Hanisch Space Telescope Science Institute Baltimore, Maryland USA Project Manager, US.
The NVO Data Discovery Portal Tom McGlynn NASA/GSFC.
1 Science and the NVO – Overview and Discussion Dave De Young NVO Project Scientist NOAO NVOSS Aspen September 2006.
14 Sept 2005NVO Summer School II1 Whats on Tap in the VO? T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US NVO Project Manager Space Telescope.
NVO Study of Super Star Clusters in Nearby Galaxies Ben Chan, Chris Hanley, and Brad Whitmore OUTLINE Science Background and Goals A Feasibility Study.
9 Sept 2005NVO Summer School II1 NVO Science Applications T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US NVO Project Manager Space Telescope.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.
A Web service for Distributed Covariance Computation on Astronomy Catalogs Presented by Haimonti Dutta CMSC 691D.
ADASS, London Sep 23-26, 2007 VOExplorer : Visualising Data Discovery in the Virtual Observatory Jonathan Tedds University of Leicester/AstroGrid/ EuroVO.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.
Virtual Observatory --Architecture and Specifications Chenzhou Cui Chinese Virtual Observatory (China-VO) National Astronomical Observatory of China.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
16 Feb, 2005AAAC meeting1 The National Virtual Observatory Status, Plans & Vision Alex Szalay, JHU and the NVO Team.
Deploying the AstroGrid: Science Use for the Black Hole Census Deploying the AstroGrid: Science Use for the Black Hole Census Nicholas Walton Institute.
National Center for Supercomputing Applications Observational Astronomy NCSA projects radio astronomy: CARMA & SKA optical astronomy: DES & LSST access:
Alex Szalay, Jim Gray Analyzing Large Data Sets in Astronomy.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Hello!. International Virtual Observatory Alliance Ajit Kembhavi, IUCAA, Pune.
25 Jan The Virtual Observatory: Core Capabilities and Support for Statistical Analyses in Astronomy T HE US N ATIONAL V IRTUAL O BSERVATORY Robert.
Science with the Virtual Observatory Brian R. Kent NRAO.
NEON Obs School 11-Aug-2005 Archival Data and Virtual Observatories 1 Virtual Observatories...or how to do your research from a beach in the Bahamas rather.
F. Genova, Berlin 7, Paris, 2 December 2009 The astronomical information network.
July 16, 2004P. Padovani, NEON Archive School Science with multi-wavelength Archival Data Paolo Padovani (ESO) Virtual Observatory Systems Department &
26 October 2005HST Calibration Workshop1 The National Virtual Observatory and HST T HE US N ATIONAL V IRTUAL O BSERVATORY Robert Hanisch US National Virtual.
2 Dec 2004 Technology Open House The National Virtual Observatory T HE US N ATIONAL V IRTUAL O BSERVATORY Bob Hanisch Gretchen Greene Wil O’Mullane.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Wiss. Beirat AIP, ClusterFinder & VO-Methods H. Enke German Astrophysical Virtual Observatory ClusterFinder VO Methods for Astronomical Applications.
Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)
The Astrophysical Virtual Observatory to EURO-VO transition Paolo Padovani ESO Virtual Observatory Systems Department EURO-VO Facility Centre Scientist.
The Virtual Observatory Europe and the VO: the Astrophysical Virtual Observatory and the EURO-VO Astrophysical Virtual Observatory and the EURO-VO Paolo.
The VAO is operated by the VAO, LLC. LSST VAO Meeting Robert Hanisch Space Telescope Science Institute Director, Virtual Astronomical Observatory.
THEORETICAL ASTROPHYSICS AND THE US-NVO INITIATIVE D. S. De Young National Optical Astronomy Observatory.
CMU-CS lunch talk, Gerard Lemson1 Computational and statistical problems for the Virtual Observatory With contributions from/thanks to: GAVO.
EURO-VO Structure Data Centre Alliance (DCA) A collaborative and operational network of European data centres who, by the uptake of new VO technologies.
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Data Archives: Migration and Maintenance Douglas J. Mink Telescope Data Center Smithsonian Astrophysical Observatory NSF
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Web based spectrum databases and utilities László Dobos Tamás Budavári István Csabai MAGPOP kick-off meeting, January Cassis.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Evanthia Hatziminaoglou, ESO - Garching Virtual Observatory Info-Workshop, SOFIA January 2008 VO Tools Overview.
7 Dec 2009R. J. Hanisch: Astronomy Data Standards CERN 1 Data Standards in Astronomy Dr. Robert J. Hanisch Director, US Virtual Astronomical Observatory.
WP4 - VO-enabled services to the science community Euro-VO AIDA – Final review – 5 October 2010 Paolo Padovani, AIDA Project Scientist 1 AIDA WP4 Report.
F. Genova, AstroNET meeting, Poitiers The Astrophysical Virtual Observatory.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
2 March 2006 STScI1 Mining multi-wavelength data in large area surveys with VO tools Yogesh Wadadekar STScI This work is partly supported by a NVO Research.
February 12, 2002Tom McGlynn ADEC Interoperability Technical Working Group Report.
NVO Study of Super Star Clusters in Nearby Galaxies – Proposal and Demo B. Whitmore, C. Hanley, B. Chan, R. Chandar OUTLINE Background and Science Goals.
Moving towards the Virtual Observatory Paolo Padovani, ST-ECF/ESO
Long-Term Preservation of Astronomical Research Results
Grid Application Model and Design and Implementation of Grid Services
Google Sky.
Presentation transcript:

5-6 February 2007 Brazil VO1 The Origins, Formation, and Scientific Promise of the Virtual Observatory Robert Hanisch Space Telescope Science Institute Baltimore, Maryland USA Project Manager, US National Virtual Observatory T HE US N ATIONAL V IRTUAL O BSERVATORY

5-6 February 2007 Brazil VO2 What is [a,the] Virtual Observatory? “A suite of software applications on a set of computers that allows users to uniformly find, access, and use resources (data, software, document, and image products and services using these) from a collection of distributed product and service providers.” [B. Weigel, GMU; ViRBO] “A distributed, scalable education and research environment for searching, integrating, and analyzing observational, experimental, and model databases.” [P. Fox, NCAR; VSTO] “A collection of integrated astronomical data archives and software tools that utilize computer networks to create an environment in which research can be conducted.” [answers.com] “Computers have made it easier to construct and retrieve information from archival data bases. Computer networks are under construction that will make it possible for these archival databases to be made available to other observatories so as to create a virtual observatory, with gains in productivity and cost- effectiveness for the observatories that participate in it. [answers.com]

5-6 February 2007 Brazil VO3 What is [a,the] Virtual Observatory? “The power of the World Wide Web is its transparency_it is as if all the documents in the world are inside your PC. The idea of the Virtual Observatory (VO) is to achieve the same transparency for astronomical data. In the VO all the world's data is available from your desktop. All archives understand the same query language, can be accessed through a uniform interface, and diverse data can be analysed by the same tools. A central goal is democratisation: the power the scientist has at her fingertips should be independent of location. Such an infrastructure will also enable collaboratories: informal distributed research teams sharing data, workflows, and analysis results in a transparent virtual storage system.” [Quinn, Hanisch, & Lawrence] “The Virtual Observatory is an international astronomical community-based initiative. It aims to allow global electronic access to the available astronomical data archives of space and ground-based observatories, sky survey databases. It also aims to enable data analysis techniques through a coordinating entity that will provide common standards, wide-network bandwidth, and state-of-the-art analysis tools.” [euro-vo.org]

5-6 February 2007 Brazil VO4 What is [a,the] Virtual Observatory? Distributed Networkedvirtual organizations Collaborative Uniform interfaces Standards-based Scalable Democratizing Supporting innovation and efficiency in research

5-6 February 2007 Brazil VO5 Origins 1990s: NASA establishes wavelength-oriented science archive centers; multiple large ground-based digital sky survey projects initiated April 1999, Decadal Survey Panel on Theory, Computation, and Data Discovery met in Los Alamos –Szalay, Prince, and Alcock coin the name “National Virtual Observatory” November 1999, NVO organizational workshop at JHU June 2000, conference held at Caltech, “Towards a Virtual Observatory” February 2001, AASC/NAS report “Astronomy and Astrophysics in the New Millennium” released April 2001, proposal submitted to NSF ITR program, 17 collaborating organizations, led by A. Szalay (JHU) and P. Messina (Caltech) September 2001, NSF announces proposal selection June 2002, “Toward an International Virtual Observatory” conference at ESO; International VO Alliance formed January 2003, first NVO science prototypes shown at Seattle AAS January 2003, AVO (EuroVO) “first light”

5-6 February 2007 Brazil VO6 Motivation National Academy of Sciences Decadal Survey recommended NVO as highest priority small (<$100M) project “ Several small initiatives recommended by the committee span both ground and space. The first among them—the National Virtual Observatory (NVO)—is the committee’s top priority among the small initiatives. The NVO will provide a “virtual sky” based on the enormous data sets being created now and the even larger ones proposed for the future. It will enable a new mode of research for professional astronomers and will provide to the public an unparalleled opportunity for education and discovery.” —Astronomy and Astrophysics in the New Millennium, p. 14

5-6 February 2007 Brazil VO7 Toward a “new astronomy” Past: Observations of small, carefully selected samples (often with a priori prejudices) of objects in one or a few wavelength bands

5-6 February 2007 Brazil VO8 Toward a “new astronomy” Future: Multi-wavelength data for millions of objects, allowing us to: –Discover significant patterns from the analysis of statistically rich and unbiased image/catalog databases –Understand complex astrophysical systems via confrontation between data and sophisticated numerical simulation

5-6 February 2007 Brazil VO9 Toward a “new astronomy” Discovering new phenomena and patterns in these datasets will require simultaneous access to multi-wavelength archives, advanced visualization and statistical analysis tools

5-6 February 2007 Brazil VO10 Threads of the the VO Fabric Multiwavelength astrophysics Archival Research Survey astronomy Temporal astronomy NGC3104 Moore’s LawDigital detectorsThe InternetData Standards

5-6 February 2007 Brazil VO11 DataScope Using the NVO DataScope scientists can discover and explore hundreds of data resources available in the Virtual Observatory. DataScope uses the VO registry and VO access protocols to link to archives and catalogs around the world. Users can immediately discover what is known about a given region of the sky: they can view survey images from the radio through the X-ray, explore archived observations from multiple archives, find recent articles describing analysis of data in the region, find known interesting or peculiar Discover and explore data in the Virtual Observatory objects and survey datasets that cover the region. A summary page provides a quick précis of all of the available data. Users can download images and tables for further analysis on their local machines, or they can go directly to a growing set of VO enabled analysis tools, including Aladin, OASIS, VOPlot and VOStat.

5-6 February 2007 Brazil VO12

5-6 February 2007 Brazil VO13

5-6 February 2007 Brazil VO14

5-6 February 2007 Brazil VO15 Open SkyQuery Cross-match your data with numerous catalogs OpenSkyQuery allows you to cross-match astronomical catalogs and select subsets of catalogs with a general and powerful query language. You can also import a personal catalog of objects and cross-match it against selected databases.

5-6 February 2007 Brazil VO16 OpenSkyQuery

5-6 February 2007 Brazil VO17

5-6 February 2007 Brazil VO18

5-6 February 2007 Brazil VO19 Spectrum Services Search, plot, and retrieve SDSS, 2dF, and other spectra The Spectrum Services web site is dedicated to spectrum related VO services. On this site you will find tools and tutorials on how to access close to 500,000 spectra from the Sloan Digital Sky Survey (SDSS DR1) and the 2 degree Field redshift survey (2dFGRS). The services are open to everyone to publish their own spectra in the same framework. Reading the tutorials on XML Web Services, you can learn how to integrate the 45 GB spectrum and passband database with your programs with few lines of code.

5-6 February 2007 Brazil VO20 NVO: Spectrum Services

5-6 February 2007 Brazil VO21 NVO: Spectrum Services Bandpass Functions

5-6 February 2007 Brazil VO22 Web Enabled Source Identification with Cross-Matching (WESIX) Upload images to SExtractor and cross-correlate the objects found with selected survey catalogs. This NVO service does source extraction and cross- matching for any astrometric FITS image. The user uploads a FITS image, and the remote service runs the SExtractor software for source extraction. The resulting catalog can be cross-matched with any of several major surveys, and the results returned as a VOTable. The web page also allows use of Aladin or VOPlot to visualize results.

5-6 February 2007 Brazil VO23 Coverage Maps The NVO Sky Statistics Service generates source counts, coverage maps, and links to downloadable data for catalog holdings available through the NVO protocols, including IRSA, NED and CDS VizieR View catalog coverage maps and source inventories for a position or object of interest.

5-6 February 2007 Brazil VO24 WCS Fixer Repair image coordinates in images with inaccurate or misaligned coordinate systems.

5-6 February 2007 Brazil VO25 VOEvent Net Explore the multiwavelength sky in the vicinity of transient events.

5-6 February 2007 Brazil VO26 Montage Mosaics Make mosaics from 2MASS, DPOSS, or SDSS images.

5-6 February 2007 Brazil VO27 VO Tools VOTable display and analysis –VOPlot, Topcat, Mirage Image display and analysis –Aladin, OASIS –Other standard display tools for downloaded data Spectrum display and analysis –VOSpec, SpecView

5-6 February 2007 Brazil VO28 International collaboration NVO is co-founder of the International Virtual Observatory Alliance IVOA now has 16 member projects Adopted a standards process based on W3C Forum for discussion and sharing of experience IVOA and open archives endorsed by OECD (Organization for Economic Cooperation and Development) Global Science Forum report on “The Management, Storage, and Utilization of Astronomical Data in the 21 st Century” “The Management, Storage, and Utilization of Astronomical Data in the 21 st Century” ?

5-6 February 2007 Brazil VO29 VO Science – New Capabilities Large Scale Surveys: 1-10 Tb --> PB New Facilities: ~ 10 Tb/day High Bandwidth Data Transmission All Imply a New Paradigm for Research –Cross Match of 1-10 Million Objects –New Patterns in Statistics –New Relations; Unseen Physical Processes –Serendipity

5-6 February 2007 Brazil VO30 VO Science and Theory Translate theory results to observational parameters Cross-match theory “surveys” and observational surveys Direct new observations

5-6 February 2007 Brazil VO31 N Body Simulations of Globular Cluster Evolution »

5-6 February 2007 Brazil VO32 N Body Simulations of Globular Cluster Evolution »

5-6 February 2007 Brazil VO33 Collimated Outflows from AGN M873C405 (Cyg A)

5-6 February 2007 Brazil VO34 Electrons Calculated Radio Simulated VLA Compare with radio archives MHD Simulations of Collimated Outflows from AGN – Virtual Observations

5-6 February 2007 Brazil VO35 Inverse Compton-CMB Simulated Chandra Synchrotron Self-Compton Compare with Chandra archives MHD Simulations of Collimated Outflows from AGN – Virtual Observations

5-6 February 2007 Brazil VO36 Perseus Cluster - NGC 1275 Clusters of Galaxies and “Cooling Flows” Can reheating of the intracluster medium by AGN “solve” the cooling flow problem?

5-6 February 2007 Brazil VO37 VO-Enabled Research Radio-loud AGN in the SDSS (Best et al. 2005) –Cross-match SDSS DR2, NVSS, FIRST –SDSS spectral data –2712 radio galaxies –Radio emission due to AGN vs. star bursts

5-6 February 2007 Brazil VO38 VO-Enabled Research Is there an AGN – starburst connection? »(Heckman et al. 2006) –Does a common accretion torus produce both? –Both phenomena produce X-rays –Cross correlate 80,000 X-ray sources with > 500,000 galaxies (with z) from SDSS DR4 –Look for common hosts –Look for evolution with redshift

5-6 February 2007 Brazil VO39 VO-Enabled Research Detecting embedded intermediate mass stars »(Kerton et al. 2006) –Star of 5-10 Mo – at boundary between solar type and very massive stars Hence crossover of different physical processes –Young B stars buried in molecular clouds –Radio + mm spectral line surveys + 2MASS, IRAS –Data cube analysis (x-y- )

5-6 February 2007 Brazil VO40 VO-Enabled Research Merging galaxies »(Allam et al. 2006) –Galaxy mergers: create starbursts, form central CDs in clusters, feed AGN, produce ULIRGS…. –Optical (SDSS) surveys bias toward high SFR –IR traces mass distribution (red stars) –Search 2MASS eXtended Source Catalog (1.6M galaxies) Expect ~ 30,000 merging pairs –Do multi-wavelength follow-up

5-6 February 2007 Brazil VO41 Research results Padovani et al. (2004), “Discovery of optically faint obscured quasars” Richards et al. (2005), “Hunting post-AGB/RSG objects…” Tsalmantza et al. (2006), “Luminous AGB stars in nearby galaxies…” Suchkov et al. (2006), “SDSS AGN with X-ray emission from ROSAT PSPC pointed observations” Wadadekar et al. (2006), “Multiwavelength characterization of faint VLA FIRST radio sources seen in the Spitzer SWIRE survey” dos Santos et al. (2007), “Search for fossil groups…”

5-6 February 2007 Brazil VO42 IAU VO Science Session - Prague Guinazzi, “The origin of soft x-ray emission in obscured AGN.” Volmer, “Determination of radio spectra from catalogues and identification of GHz peaked sources.” Shirasaki, “Environment of z=1.3 QSOs.” Prema, “Galaxy formation and evolution using multiwavelength, multiresolution data.” Solano, “Discovery and characterization of brown dwarfs.” Lucas, “Multiwavelength study of a sample of Texas Radio Survey steep spectrum sources.” Dalla, “Solar active region emergence and flare productivity.” Thuillot, “Physical and dynamical characterization of asteroids.”

5-6 February 2007 Brazil VO43 Summary To date: IVOA establishes infrastructure –Almost done with “Phase 1” Beginning now: VO enables new research The transition is in progress –Infrastructure development concluding, phasing into operational support –Focus changing to implementation of research capabilities –Engaging and informing the astronomical community –Broadening participation of data and service providers through national and international collaboration

5-6 February 2007 Brazil VO44 The VO and Brazil Get more from Brazilian astronomy resources –Comparison with other data –Publication for others to use: relevance, reputation Foster collaboration among Brazilian research institutions Participate in the international standards process –VO is not finished, will evolve