Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division.

Slides:



Advertisements
Similar presentations
A VO experience: Lessons learnt from accessing SIA compliant image servers with the AVO prototype F.Bonnarel on behalf of M.Allen, T.Boch, M.Dolensky,
Advertisements

Viewing and Features ShowSky - a Jini aware Applet/API astronomical archive discovery tool Object Design and Implementation Guide Star Catalog-II Jini.
Overview of Current and Forthcoming GALEX Search Capabilities and Data Products Current Search Options New GALEX Fluxes gPhoton.
Development of China-VO ZHAO Yongheng NAOC, Beijing Nov
Web Design Vocab 3 PNG, JPG, GIF, MP3, MPEG.
MAST-VizieR/NED cross correlation tutorial 1. Introduction Figure 1: Screenshot of the MAST VizieR Catalog Search Form. or enter here as object class:
Web + VO + Database Technologies = HLA Footprints STScI: Gretchen Greene, Steve Lubow, Brian McLean, Rick White and the HLA Team JHU: Alex Szalay and Tamas.
October 12, 2003ADASS NVO Tutorial1 How-To Implement Cone and SIA Services Gretchen Greene Space Telescope Science.
Mercator/Coronelli ArcGIS Server 9.3 Data Management GIS Web Services Mapping Application Developer Tools Spatial Analysis Publishing to Clients Image.
The Montage Image Mosaic Service: Custom Mosaics on Demand ESTO John Good, Bruce Berriman Mihseh Kong and Anastasia Laity IPAC, Caltech
VISTA pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
CEOS System Engineering Toolset (CSET) CSET is a Software Framework + Suite of Tools (Apps) that leverages a Common Architecture, Unified Data Model, Common.
SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.
Sharing imagery and raster data in ArcGIS
Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.
GALEXView Demo T. Rogers, B. Shiao, P. Brown, P. McCauley, A. Conti, M. Smith, S. Tseng, A. Volpicelli StSci/MAST.
Why Build Image Mosaics for Wide Area Surveys? An All-Sky 2MASS Mosaic Constructed on the TeraGrid A. C. Laity, G. B. Berriman, J. C. Good (IPAC, Caltech);
Testing Tools using Visual Studio Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation.
OCLC Online Computer Library Center CONTENTdm ® Digital Collection Management Software Ron Gardner, OCLC Digital Services Consultant ICOLC Meeting April.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
Dec 2, 2014 Hubble Legacy Archive and Hubble Source Catalog Rick White & Brad Whitmore Current teams: HLA: Michael Dulude, Mark Kyprianou, Steve Lubow,
Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.
EdSkyQuery-G Overview Brian Hills, December
U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.
CITGO Corpus Christi Refinery PI Here, PI There, PI Everywhere 1 PI WEB Graphics Application Management Systems, Inc. Outline pApplication Purpose, functional.
Innovations in the Multimission Archive at STScI (MAST) M. Corbin, M. Donahue, C. Imhoff, T. Kimball, K. Levay, P. Padovani, M. Postman, M. Smith, R. Thompson.
Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.
FILES & FOLDERS Organization Computer hard drives hold an enormous amount of data or information. Knowing how a computer's organization system works.
Multimedia Elements II Graphics, Digital Video. UIT - Multimedia Production2 Multimedia Elements Multimedia elements include: Text Graphics Animation.
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
Footprint Service Specification IVOA Interop Meeting Trieste 2008 Gretchen Greene and Tamas Budavari.
AstroWise((G)A)VO Meeting 6 May 2004 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
, Key Components of a Successful Earth Science Subsetter Architecture ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
SOFTWARE TOOLS FOR DATA QUALITY ANALYSIS The Science Data Analysis Tool (SDAT) is the primary tool used by the DQA team. SDAT can access all raw and processed.
Virtual Survey System sept 04 ASTRO-WISE- federation OmegaCEN AstroWise a Virtual Survey System OmegaCAM – Lofar – AstroGrid –((G)A) VO AstroWise a Virtual.
Enhancing Science with the Hubble Legacy Archive Bologna, January 29, 2008 Brad Whitmore OUTLINE The potential for enhanced archival science What is the.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
VAMP will enable access to, and vastly multiply the use of, astronomy image resources by standardizing and linking resource archives worldwide.
MAST Users Group – July 9, 2009 other planned and ongoing projects within MAST.
ASP.NET in Definition: 1.ASP.NET is a web application framework developed and marketed by Microsoft to allow programmers to build dynamic web sites,
Data Archives: Migration and Maintenance Douglas J. Mink Telescope Data Center Smithsonian Astrophysical Observatory NSF
Page Design Issues IWM 14 Information Services for the Web.
Presented by Vishy Grandhi.  Architecture (Week 1) ◦ Development Environments ◦ Model driven architecture ◦ Licensing and configuration  AOT (Week 2)
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Vegetation Index Visualization of individual composite period. The tool provides a color coded grid display of the subset region. The tool provides time.
Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.
Web Design and Development. World Wide Web  World Wide Web (WWW or W3), collection of globally distributed text and multimedia documents and files 
Data Intensive Astronomy Group Talk II ICRAR Con 4 September 2015 Chen Wu.
WEB SERVER SOFTWARE FEATURE SETS
What is Firefly (1) A web UI framework for web applications
Kamel Didan 12*, Armando Barreto 12, Javier Rivera 12, Muluneh Yitayew 2 VIP DATA EXPLORER: 30 Years of Vegetation Index and Phenology Observations 1 VIP.
Terra-Fusion Loads Tiles in real-time while panning Loads Tiles in real-time while panning Improved overall performance via: Improved overall performance.
VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.
HUBBLE LEGACY ARCHIVE STSCI Astronomical Data Tagging Web 2.0 meets Astronomy in the HLA Niall I. Gaffney, W. Warren Miller (STScI)
26th October 2005 HST Calibration Workshop 1 The New GSC-II and it’s Use for HST Brian McLean Archive Sciences Branch.
The CHAI Project: Coordinates for Hubble Astronomical Images Kristen Recine Dickinson College, STScI SASP Advisor: Lisa Frattare STScI.
Introduction to ASP.NET development. Background ASP released in 1996 ASP supported for a minimum 10 years from Windows 8 release ASP.Net 1.0 released.
GeoServer Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Wednesday NI Vision Sessions
Future Data Architecture Cloud Hosting at USGS
Representing Images 2.6 – Data Representation.
Rick, the SkyServer is a website we built to make it easy for professional and armature astronomers to access the terabytes of data gathered by the Sloan.
COMPASS Database SPACE TELESCOPE SCIENCE INSTITUTE Gretchen Greene
Observing with Modern Observatories (the data flow)
ASP.NET Imran Rashid CTO at ManiWeber Technologies.
Presentation transcript:

Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division

DSS Distribution DSS one of the most heavily used MAST services (~175,000+ requests/month) – 9TB image data, 1TB compressed data – Distributed compressed data to 15 data centers – Distributed compressed data to both Google and Microsoft for non-commercial use in visualization projects Accessible via webform, VOservices & scripted url requests – Currently only provides FITS or dynamically created single colour GIF file – Started development project to create colour images from multiple bandpasses (J, F, N).

Increased Interest in Visualization Hubble Legacy Archive (EDR Release 01 August 2007) – Graphical display to visualize HST instrument footprints over DSS for context of observations. ESO Archive Interface (Release Date TBA) – Similar to HLA but front-end to ESO archive of ground-based data. Sky in Google Earth (Released 22 August 2007) – Browse sky using GE engine. – Combine DSS, SDSS and HST images into single layer. Microsoft Research World-Wide Telescope (Release Date TBA) – Sky Chart UI with advanced search, collaborative capabilities and telescope control. – DSS, SDSS, 2MASS, HST, etc as separate layers – VO enabled Increasing number of websites showing colour images constructed from DSS data.

DSS Colour Representation R=IV-N, G=IIIaF, B=IIIaJ R=IIIaF, G=(IIIaJ+IIIaF)/2, B=IIIaJ

DSS Colour Image Construction Current version constructed from J & F bandpass plates. RED (F) plate taken as reference. Field divided into 64x64 grid of tiles each 300x300 pixels. For each tile, the BLUE (J) image was astrometrically registered to the RED image and resampled. A mean of the red/blue image was created for the 3rd channel. The sky and saturation values for the red and blue plates were used to scale the 3 channel images between 0-1 and create a JPG image. JPG image was saved with a FITS header.

Image Pyramid Construction Combine each set of 4 adjacent tiles into a single tile at half the resolution. Repeat till entire plate is a single tile. We have created an image pyramid at multiple scale levels 1x = 4096 tiles 2x = 1024 tiles 4x = 256 tiles 8x = 64 tiles 16x = 16 tiles 32x = 8 tiles 64x = 1 tile 5461 jpegs x 1792 fields = 9,786,112 images Save all JPG images with updated FITS headers.

DSS Colour Image Access Loaded JPG data and FITS WCS information into SQLserver 2005 database (200GB). Index coordinates of each tile at each scale with HTM for fast lookup. HTM functions are compiled into DLL and bound into SQLserver for fast execution within the database. Prototype web interface and VO SIAP service selects tiles and creates image cutout (full resolution). IIS webserver, ASPX pages, C# code running within.NET framework. HLA interface (variable resolution, dynamically resamples DSS JPG to North up to overlay footprints). C# code directly accessing SQLserver database

Real-time demo (Note – DSS DB on my workstation, non-optimized debug code) M1 M3 NGC Coma Cluster – 1x – 4X SMC Plate

DSS Examples PleiedesHorsehead

DSS Examples M51NGC 253

DSS Examples Omega CenM100