Simulation Databases for the Virtual Observatory Work in progress and application to the StarFormat Project Patrick Hennebelle Franck Le Petit Benjamin Ooghe

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory2 VO Theory – Simulation DataModel SNAP (Simple Numerical Access Protocol)‏  DataBase : SimDB to store  Data Access Protocol to access : SimDAP to access SimDB / Volute Project :  DataModel UML  DMTransformer  DB managing (JPA)‏  Java interface  WebServices (SimDAP)‏ SimDB pipeline

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory3

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory4 SimDB Infrastructure

5

6 DATA MODEL

7

8

9

10

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory11 StarFormat - Integration in the DM Different sorts of computings to store :  MHD Simulations :  Code (RAMSES, ZEUS, …)‏  Target (molecular clouds, …)‏  Physical processes involved (MHD, heating, gravitation, …)‏  Parameters (initial conditions, limits, AMR description, refinement, …)  Description of results :  Multiple time steps (snapshots)‏  Statistics (min/mean/max/rms velocity, density, mass, …)‏  PDF, image files  Clumps identification (Cluster Detection)‏  …

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory12 StarFormat - Integration in the DM FORM_MC_RAMSES2_01 THY3D_grav_mhd (ref. to FORM_MC_RAMSES2_01)‏ Gravitation MHD (ref. to MHD)‏ Cooling (ref. to Gravitation)‏

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory13 StarFormat - Integration in the DM FORM_MC FORM_MC_RAMSES2_01 THY3D_grav_mag_bcl (ref. to FORM_MC_ RAMSES2_01)‏ Time step #12 AMR Cells Number of Cells

14 FORM_MC FORM_MC_RAMSES2_01 THY3D_grav_mag_bcl (ref. to FORM_MC_ RAMSES2_01)‏ TIME STEP #12 AMR Cells P. Hennebelle 17.8 km/s (ref. to Initial Velocity)‏ Initial Velocity Molecular Cloud (MC)‏ 20 (ref. to Number of Cells)‏ (ref. to AMR Cells)‏ (ref. to MC)‏ 5.4 cm -3 (ref. to Mean Density)‏ Number of Cells Mean Density

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory15 StarFormat - Issue with the DM Problem : no way to store table of values Examples :  Number of AMR Cells per level  Statistics dependant on a factor (density threshold)‏  Probability density functions Different solutions imagined with respect to the DM :  Statistics as a PostProcessing : Child Experiments  Multiple Experiments  Multiple Target Objects  Property Groups

16

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory17 StarFormat - Bidimensional data issue DM extension : UML proposition

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory18 StarFormat - Bidimensional data issue Proposition submitted to the group Theory  Waiting for approval  Developing anyway in the mean time :  If approved : good, just need to adapt the code to new SimDB specs  If rejected : external development => lack of interoperability Acceptable considering interoperable projects? Complete and double the results :  Local version with modified DM  External version using original DM and least bad solution  Theory not official itself...

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory19 StarFormat – Pipeline Experimentator :  runs simulations with code and collects results  calculates extra results (statistics, plots,...)‏  generates metadata file (VOTable format) per snapshot Software :  collects and reads VOTable files with SAVOT (CDS)‏  stores snapshot data in an intermediate object model  use SimDB API to store in PostgreSQL database Admin Interface :  metadata files feeding (directory, webform,...)‏  database administration (updating, removal, browsing,...)‏

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory20 StarFormat – Pipeline : VOTable Normalized format of XML  Resource / Table / {Param – Field – Data}

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory21 StarFormat – Pipeline : VOTable Local VOTable architecture constraints :  Resource Project  Tables Project, Protocol, Code, Contact, Representation  Resource Experiment  Tables Experiment, Physics, Parameters, Target  Resource Snapshot  Tables Snapshot, Statistics, Statistics_threshold, Files

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory22 StarFormat – Pipeline : VOTable

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory23

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory24 SimDAP - WebServices Browser, queries, downloads, connect to other data, … SimDB Browser (WebApp) :  Browse resources  Run SQL queries  Validate XML instances with SimDB's Schema Prepared parametered Queries Work in development (SIMDAP)‏

Fri, February 13th, 2009StarFormat Simulation Databases for the Virtual Observatory25 Example of WebService : SIMDB Browser