Presentation is loading. Please wait.

Presentation is loading. Please wait.

Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO.

Similar presentations


Presentation on theme: "Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO."— Presentation transcript:

1 Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO

2 Virtual Sky: Image Federation Xray (ROSAT) theme Change scale Change theme http://virtualsky.org/ from Caltech CACR Caltech Astronomy Microsoft Research Optical (DPOSS) Coma cluster Virtual Sky has 140,000,000 tiles 140 Gbyte

3 VO and Grid Computing Supercomputer center support for Data Pipelines (not just MPI) 12 hr 250 Gb HPSS HP Superdome VS1 Science product HPSS system VS2 Web product Win2000 database Raw data CPU Utilization VirtualSky.org Ingestion Copy raw data and filter (background subtraction) Resampling Write VS1 Build VS2 Write VS2 Today ~ 3 TB 1 TB 140 GB Computation also takes about 12 hrs.

4 VO and database Join RA Dec mag J mag H mag K glon glat flux I flux Q flux U Infrared catalog (indexed by RA) Radio catalog (indexed by glon) Crossmatch engine SQL select Need same sorting for crossmatch Who does it? Or can we impose a standard? order by glon? order by RA? sort here? Sorting 10^9 objects is expensive

5 VO Interoperability Directory white/yellow pages –VO Schema repository How to publish, how to define content action> Document schema for –archive content –web service capability –table/image/spectrum How to publish algorithms Plug and play data services –SOAP, UDDI, WSDL, Jini? Semantic web –“Question and answer in the language of the client” –Topic maps

6 VO and Interoperability Client application (e.g., OASIS) asks for available catalogs then for attributes makes a query then displays the result What is the standard interaction with a catalog service? ClientService Want to be dynamic, be able to add catalogs and the applications still work

7 VO and International Of course there are many astronomy data collections in the UK, Europe, Japan, etc. We intend to collaborate/coordinate with international efforts

8 L aser I nterferometric G ravitational wave O bservatory Listening to Collisions of Black Holes and Neutron Stars LIGO

9 LIGO Pictures

10 Grid LIGO Architecture Clients eg Web, Script, Agent Clients eg Web, Script, Agent Text request Request Manager Request Manager GriPhyNLDAS Gatekeeper (GRAM) Gatekeeper (GRAM) Science Algorithms Software Collaboratory Parallel Computing GridFTP Local Disk Data HPSS GridFTP Replica Catalog Replica Management Transformation Catalog Virtual Data Catalog Virtual Data Request Data Movement Globus RPC other LDAS Condor jobs Objective: Add security & wide-area data services LDAS is Ligo Data Analysis System

11 Grid LIGO Logic VD Request  Request Manager –XML, Key-value, script? –Action> Build document schema for this Do we have it already in data caches –if yes, get from caches, use simple transformations –else build LDAS script Move relevant data to LDAS local disk Queue job to LDAS, get jobID Pass updates, then result pointer back to user Perhaps cache result

12 International GW Grid 50 kbyte/sec GEO

13 International GW Grid Coincidence in Ligo-Virgo data –Not astrophysics data yet…. –Try seismic, electromagnetic data for now Caltech Virgo Electromagnetic Seismic Coincidence events! Currently using rsync LLO LHO Merging 3 streams to 1 Correlate signals (LDAS) ~12 kbyte/sec each way


Download ppt "Some Grid Science California Institute of Technology Roy Williams Paul Messina Grids and Virtual Observatory Grids and and LIGO."

Similar presentations


Ads by Google