OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First.

Slides:

Advertisements

Similar presentations

VODA - A Sampo Project Johan Lindroos – CSC Scientific Computing Ltd, Finland Pekka Järveläinen – CSC Scientific Computing Ltd, Finland Richard Hook -

Advertisements

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server September 2006, Moscow DALToolKit.

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.

2008 NVO Summer School1 Data Access Layer Services Doug Tody (NRAO) T HE US N ATIONAL V IRTUAL O BSERVATORY.

Remote Visualisation System (RVS) By: Anil Chandra.

CASDA Virtual Observatory CSIRO ASTRONOMY AND SPACE SCIENCE Arkadi Kosmynin 11 March 2014.

Software for Science Support Systems EVLA Advisory Committee Meeting, March 19-20, 2009 David M. Harland & Bryan Butler.

Observatorio de Sierra Nevada Susana Martín Ruiz (IAA-CSIC)

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

GRID Activities at ESAC Science Archives and Computer Engineering Unit Science Operations Department ESA/ESAC – Madrid, Spain.

Updated SkyMouse and Suggestions to VO Service Developers HuaPing SUN, Chenzhou CUI China-VO National Astronomical Observatory of China.

NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.

SDSS Web Services Tamás Budavári Johns Hopkins University Coding against the Universe.

Astronomical GRID Applications at ESAC Science Archives and Computer Engineering Unit Science Operations Department ESA/ESAC.

Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.

GAUDI Ground-based Asteroseismology Uniform Database Interface E. Solano Bases de données en spectroscopie stellaire. Paris.

Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.

3D Spectroscopy in the Virtual Observatory: Current Status Igor Chilingarian (Observatoire de Paris, France/SAI MSU, Russia) Ivan Zolotukhin (SAI MSU,

VO & Astro-Wise & others A.Belikov OmegaCEN

MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.

Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.

WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.

Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.

Science with the Virtual Observatory Brian R. Kent NRAO.

Spectroscopy in VO, ESAC Mar Access to Spectroscopic Data In the VO Doug Tody (NRAO/US-NVO ) for the IVOA DAL working group I NTERNATIONAL.

How to Adapt existing Archives to VO: the ISO and XMM-Newton cases Research and Scientific Support Department Science Operations.

Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.

JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),

Event-Based Hybrid Consistency Framework (EBHCF) for Distributed Annotation Records Ahmet Fatih Mustacoglu Advisor: Prof. Geoffrey.

ISpheresImage iSpheresImage Feature Overview and Progress Summary.

Federated Discovery and Access in Astronomy Robert Hanisch (NIST), Ray Plante (NCSA)

Workshop Garching, June 27 – July Statistical Cross-Matching Across Distributed Archives H.-M. Adorf & GAVO Team MPI f. extraterrestrische Physik.

Archive Access Tool Review of SSS Readiness for EVLA Shared Risk Observing, June 5, 2009 John Benson Scientist.

Common Archive Observation Model (CAOM) What is it and why does JWST care?

Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.

Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.

Swift HUG April Swift data archive Lorella Angelini HEASARC.

1 CORE DATA PROCESSING SOFTWARE PLAN REVIEW | SEATTLE, WA | SEPTEMBER 19-20, 2013 Name of Meeting Location Date - Change in Slide Master Data Release Processing.

AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.

SAG Meeting – Postdam – November The XCATDB: run by Saada OAS Contribution The.

06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.

Catalog Data Interface Tool Virtual Observatory-India (VO-I) May 16-20, 2005 Catalog Data Interface.

Science ESAC Cluster Final Archive Pedro Osuna Head of the Science Archives and VO Team Science Operations Department CAA-CFA Review Meeting.

21-jun-2009 IVOA Standards Pedro Osuna ESA-VO Project Science Archives and Computer Support Engineering Unit (SRE-OE) Science Operations Department (SRE-O)

Virtual Observatories, Press Release Images, and Web Services Dr. Frank Summers Space Telescope Science Institute November 3, 2005.

UCL DEPARTMENT OF SPACE AND CLIMATE PHYSICS MULLARD SPACE SCIENCE LABORATORY Taverna Plugin VAMDC and HELIO (part of the ‘taverna-astronomy’ edition) Kevin.

AstroGrid NAM 2001 Andy Lawrence Cambridge NAM 2001 Andy Lawrence Cambridge Belfast Cambridge Edinburgh Jodrell Leicester MSSL.

12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.

System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.

● Link between : – the DALIA tool (Direct Approach to Spectral Line Analysis ) ● Generic Interface for Modelisation Codes – the Basecol database ● Use.

April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.

EVLA Data Processing PDR E2E Data Archive System John Benson, NRAO July 18, 2002.

European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Aurélien Stébé DALToolKit Ingestor & Server January 2008, VODay, Sofia.

Steven Perry Dave Vieglais. W a s a b i Web Applications for the Semantic Architecture of Biodiversity Informatics Overview WASABI is a framework for.

Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.

ESA Scientific Archives and Virtual Observatory Systems Science Archives and VO Team Research and Scientific Support Department.

VO Data Access Layer IVOA Cambridge, UK 12 May 2003 Doug Tody, NRAO.

CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.

NASA Exoplanet Science Institute The Keck Observatory Archive ndex.shtml A collaboration between NExScI and the.

Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.

1 Workflows Access and Massage VO Data José Enrique Ruiz on behalf of the Wf4Ever Team IVOA INTEROP SPRING MEETING 2013 HEIDELBERG, MAY16th 2013.

Science Gateway- 13 th May Science Gateway Use Cases/Interfaces D. Sanchez, N. Neyroud.

Simulation Production System

The INES Archive in the era of Virtual Observatories

EVLA Archive The EVLA Archive is the E2E Archive

Databases, Web Pages and Archives

SVO - ESAVO Use case: Comparison of evolutionary synthesis models

GENIUS CSIC contribution Enrique Solano

X-ray high resolution spectra in the VO: the case of XMM-Newton RGS

Presentation transcript:

OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First SVO Workshop on data publishing in the Virtual Observatory

Outline Observatory Instruments Data Archive Architecture Current status Future implementations Conclusions

Observatory OSN: Observatorio de Sierra Nevada ( Observatory located at the ski resort of Sierra Nevada (2896m), Granada (Spain) Founded in 1981 by IAA-CSIC Instrument Control Systems developed and maintained by IAA staff Optics maintained by IAA staff Remote, In-situ and Service observing Production: ~20 papers/year

Hard working conditions

Instruments T150cm CCD VersArray 2048B - 2k x 2k FOV ~ 8’ x 8’ Filtros: Johnson, Strömgren, Gunn, Molecular, Halpha, Emission, Cometary Albireo Spectrograph (CCD 2kx2k) Slit, Argus (IFU) 5 Diffraction Gratings Under upgrade (GAIA RVS duplicator)

Instruments (II) T90cm CCD VersArray 2048B - 2k x 2k FOV ~ 13’ x 13’ Filtros: Johnson, Strömgren, Gunn, Molecular, Halpha, Emission, Cometary Strömgren photometer simultaneous observations of the bands uvby bands n and w Crawford Hb photo-metric system

Instruments (III) – to be archived T60cm BOOTES-IR (under development) – GRBs alerts T35cm CCD Kodak 4008 x 2672 FOV ~ 30’ x 20’

Data Archive -

Data Archive Architecture Lector Automatically retrieve FITS files from the instruments (daily) Parse headers FITS renamed  YYYYMMDD.HHMMSS..fit Insert data into BD User subscription and notification Generate report GUI Web interface Queries and data download (public & proprietary) Image & header preview

Architecture

E-R Database

ADA project ADA (Archivo de Datos Astronómico) Funded by project P07-FQM2864 of Junta de Andalucía Started March 2008 First release: Sep 2009 Raw data (science & calibrations) Collaboration with company

Main functionalities Raw data (science & calibrations) Easy to add new instruments  Edit XML config file Automatic user subscription  OBSERVER keyword Public & Proprietary data Proprietary period: Metadata (headers): used defined, default to 1.5 year Data (images): used defined, default to 1.5 year Name Resolver (Sesame service) Outputs: html, csv, VOTable Download: Tarball

Development tools Linux OS: Debian 5 MySQL DB Apache Tomcat 6 GUI: Spring Framework v jQuery 1.3.x

Computer system 2 x CPU Xeon GHz (2 x 4 cores) 16 GB RAM 5 TiB RAID 5+1 Linux Debian IAA Radio-link OSN-IAA

Web interface: query

Web interface: results

Current status: numbers 60 users 2013: 210 GB / 68k files Total: 786 GB / 260k files)

Future developments Update OS: migration to Debian 7 Add Strömgren data (photometric tables)  convert to FITS Improvements to Web interface Query optimization Improvement of user data search (by campaign ID) Improvement of file download process (dataset > 3000 files) Astrometric calibration (WCS): Astrometry.net VO services  data publication ConeSearch SIAP (Simple Image Access Protocol) SSAP (Simple Spectrum Access Protocol)

Future++ developments Make available to the community observations taken before September 2009 ( ): CD/DVDs ingestion Reduced data  Pipelines Spectra Image Photometric catalogs VO High level data products

Questions ?

TODO