GENIUS Kick-Off meeting December 4th 2013 WP-620 Simulated catalogue data Francesc Julbe UB – IEEC, Barcelona.

Slides:



Advertisements
Similar presentations
Accelerating The Application Lifecycle. DEPLOY DEFINE DESIGN TEST DEVELOP CHANGE MANAGEMENT Application Lifecycle Management #1 in Java Meta, Giga, Gartner.
Advertisements

Kyoto Interop meeting, 17 May A VOTable application: Solar System objects in the VO J. Berthier 1, F. Vachier 1, V. Lainey 1, W. Thuillot 1, J.-E.
ImageComparer A VO tool for variability searches The Team: Colin Aspin, Oliver Fraser, Nathaniel Paust, Rafael Santos.
GENIUS kick-off - November 2013 GENIUS kick-off meeting The Gaia context: DPAC & CU9 X. Luri.
Gaia simulators, GUMS and GOG F. Figueras (+UB team) GREAT ITN School : Galaxy modelling, Besançon October, 2012.
Rocio Guerra European Space Astronomy Centre 1 Gaia: la Galaxia en un Petabyte Mao- Menorca – 2 nd October 2009 ESAC and the Gaia Catalogue
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
RRFWG. Dresden June 11th GDAAS II Algorithm Implementation Review.
I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=
Compilation of stellar fundamental parameters from literature : high quality observations + primary methods Calibration stars for astrophysical parametrization.
UGDIE KICK-OFF MEETING F-MAN 1 ΑΝΝΕΧ 1-A by UGDIE.
ADASS, London Sep 23-26, 2007 VOExplorer : Visualising Data Discovery in the Virtual Observatory Jonathan Tedds University of Leicester/AstroGrid/ EuroVO.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=
TAP service at ESAC - VOTAP Carlos Rios Diaz Science Archives Team (SAT) ESA-ESAC, Madrid, Spain VOTAP.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
The Gaia mission Data reduction activities in the UK Floor van Leeuwen, IoA.
The NASA/NExScI/IPAC Star and Exoplanet Database 14 May 2009 David R. Ciardi on behalf of the NStED Team.
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
1 Research Groups : KEEL: A Software Tool to Assess Evolutionary Algorithms for Data Mining Problems SCI 2 SMetrology and Models Intelligent.
GENIUS kick-off - November 2013 GENIUS kick-off meeting WP400 – Tools for data exploitation X. Luri.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
GENIUS. WP600 Support Activities Participants: University of Barcelona: 6PM CESCA (Center for Scientific and Academic Services of Catalonia): 24PM University.
Spectral Analysis in the VO Thomas Rauch, Iliya Nickelt and the GAVO and AstroGrid-D Teams.
Strasbourg astronomical Data Centre (DS) Françoise GENOVA.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
The european ITM Task Force data structure F. Imbeaux.
E. Solano, R. Gutiérrez, B. Montesinos, C. Morales, J. García, L. Sanz LAEFF-INTA. P.O. Box 50727, Madrid (Spain) Development of a multi-mission.
SIMO SIMulation and Optimization ”New generation forest planning system” Antti Mäkinen Dept. of Forest Resource Management / University of Helsinki.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
CU5-DU13: Ground-based support observations for Gaia absolute photometric calibration BOLOGNA: C. Cacciari, G. Altavilla, M. Bellazzini, A. Bragaglia,
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Introduction / Context.
E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.
Data Management at Gaia Data Processing Centers GREAT Workshop on Astrostatistics and Data Mining in Astrnomical Databases La Palma, Spain May 30 - June.
MAST Users Group – July 9, 2009 other planned and ongoing projects within MAST.
PhotDM implementation feedback | Jesus Salgado | ESAC | 18 October 2011 | IVOA Pune 2011 | Pag. 1 Photometry DM implementation feedback Jesus.
Science ESAC Cluster Final Archive Pedro Osuna Head of the Science Archives and VO Team Science Operations Department CAA-CFA Review Meeting.
Sharing scientific data: astronomy as a case study for a change in paradigm Présenté par Françoise Genova.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
SVO: The Spanish Virtual Observatory Enrique Solano, LAEFF / SVO Partner’s VO Project  Census of Spanish Data Centres Partner.
Page 1 PACS NHSC Webinar: What’s New in HIPE 13 for SPIRE 19 th May 2015, Pasadena What’s New in HIPE 13 General Topics Bernhard Schulz (NHSC/IPAC) on.
Issue/Revision: 1.0 Reference: Gaia Archive Status: Issued ESA UNCLASSIFIED - Releasable to the Public SourceDM: Some thoughts Jesús Salgado ESAC Science.
Our project main purpose is to develop a tool for a combinatorial game researcher. Given a version of combinatorial puzzle game and few more parameters,
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
JWST Pipeline/Analysis Tools Perry Greenfield Science Software Branch.
Mireille Louys et al., OV-France Theory WG meeting, LYON, June DALIA : an observation vs simulation comparison frame work What could be a Model.
MNP1163/MANP1163 (Software Construction).  Minimizing complexity  Anticipating change  Constructing for verification  Reuse  Standards in software.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
E. Solano. GAIA Meeting, Menorca, Oct 2009 GAIA and the Virtual Observatory Enrique Solano, LAEX/CAB (INTA-CSIC) Spanish VO Principal Investigator.
Open Grid Services for Earth Observation Pedro Gonçalves.
FoV: 0.7 deg x 0.7 deg, pixel (10 µm x 30 µm): 0.059”(AL) x 0.177”(AC) 106 CCD 4500x1966 px (TDI) ~4.4 sec 0.93m 0.42m Skymapper.
Faculty meeting - 13 Dec 2006 The Hubble Legacy Archive Harald Kuntschner & ST-ECF staff 13 December 2006.
ESA Scientific Archives and Virtual Observatory Systems Science Archives and VO Team Research and Scientific Support Department.
RI EGI-InSPIRE RI Astronomy and Astrophysics Dr. Giuliano Taffoni Dr. Claudio Vuerli.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
Gaia DR2/3: Serving Time Series, Spectra, SSOs in the VO
The CSIRO ASKAP Science Data Archive Progress and Plans
aspects of archive system design
Towards a CTA high-level science analysis framework
The INES Archive in the era of Virtual Observatories
Fernando Aguilar, IFCA-CSIC
Institute of Cosmos Sciences - University of Barcelona
ESA Gaia Archive: Architecture & key points
Moving towards the Virtual Observatory Paolo Padovani, ST-ECF/ESO
Crowded Field Photometry Stars, Milky Way, Local Volume
Databases, Web Pages and Archives
Gaia Tomaž Zwitter Gaia: > 1.1 billion objects (V ≤ 20.9),
GENIUS CSIC contribution Enrique Solano
Presentation transcript:

GENIUS Kick-Off meeting December 4th 2013 WP-620 Simulated catalogue data Francesc Julbe UB – IEEC, Barcelona

Simulation activity for CU9 & GENIUS  Simulations on demand for other CUs  Simulations to validate spectral libraries developed by other CUs  Simulations for CU3 (OR#2)  Simulations of specific objects (SN, Exoplanets,..)  Full Sky simulations for the community with GUMS-10 and GOG-11  Simulations are core component for CU9 development work  All development activity based on simulated data:  ESAC archive design  Data Mining, Science Enabling app and validation software development  Data access and VO (Virtual Observatory) Services  … 2

 GOG is a Java tool that generates a simulated GAIA final catalogue.  Astrometric, Photometric, RVS and Astrophysical data (CU3, CU5, CU6 and CU8)  Epoch, BP, RP and RVS  Combined (end-of-mission), BP, RP and RVS  Output format:  Gbin MDB tables according to the MDB definition.  Command line version  Large scale simulations: D istributed environment, scripting needed  Graphical User Interface GOG – Gaia Object Generator 3

Simulations  GUMS 10 –Universe Model sources (UM) and their “nominal” values Robin et al. (2012), 2012A&A...543A.100RRobin et al. (2012), 2012A&A...543A.100R  First Data model One single table (GACS), 2.1 billion rows 4

 GUMS & GOG-11 –Universe Model data (GUMS-11) ~2.1 billion objects –End of mission: Astrometry, Photometry, RVS and Astrophysical parameters. Simulations II 5

 Detailed MDB outputs - Total size: 1.3TB  UM output with ‘nominal values’  MDB/CU3/Agis/Source  MDB/CU5/PhotPipe/Phot/CalPhotSource  MDB/CU6/Source/Source  MDB/CU6/Source/StellarSourceMeanCharacteristics  MDB/CU8/StarParamsPhot Extend (design) a new data model, test technologies available (relational DB?) to coordinate with SAT at ESAC Extend (design) a new data model, test technologies available (relational DB?) to coordinate with SAT at ESAC  Results processed with GAT  Services development  e.g. Data Mining activities Simulations III 6

 Future large Scale simulations:  End of mission –End of Mission with updated MDB and outputs –End of mission with BP/RP/RVS  Epoch –Only Epoch parameters –Epoch + BP/RP & RVS  Complete set (Combined + Epoch XP & RVS)  Future custom simulations  e.g. adding systematic errors for validation purposes Simulations IV 7

 Readiness to perform large/small scale simulations  Well defined simulation process by the testing team  Consolidated team both in development and in testing  Software (GOG) well adapted to Large Scale simulations  Computing resources available at CESCA (Supercomputing Centre of Catalonia Consortium). Simulations V 8