Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.

Slides:



Advertisements
Similar presentations
IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
Advertisements

September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
Remote Visualisation System (RVS) By: Anil Chandra.
Database Management Using Microsoft Access Xinhua Chen, Ph.D. Chinese Association of Professionals in Science and Technology March 23, 2003.
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
Distributed Heterogeneous Data Warehouse For Grid Analysis
Towards the Design and Implementation of the DAME prototype: OGSA Compliant Grid Services on the White Rose Grid Sarfraz A Nadeem University of Leeds.
SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
Virtual Observatory Single Sign-on U.S. National Virtual Observatory National Center for Supercomputing Applications Ray Plante, Bill Baker.
SiS Technical Training Development Track Technical Training(s) Day 1 – Day 2.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
11/27/2003IVOA Small Projects Meeting China-VO Data Access Service Based on OGSA Jian Sang National Astronomical Observatory of China Chinese Virtual.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
NAREGI WP4 (Data Grid Environment) Hideo Matsuda Osaka University.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
How Grid Security works in GEO Sciences N. Yamamoto, Y. Tanaka, I. Kojima, S. Sekiguchi AIST Oct. 28, 2009.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
1 Welcome to CSC 301 Web Programming Charles Frank.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
IVOA Interoperalibity JVO Query Language Naoki Yasuda (NAOJ/Japanese VO)
February 20, 2006JVO-AstroGrid Collaboration1 Current Status of JVO, and Goal of Collaboration between JVO and AstroGrid Masatoshi Ohishi / NAOJ & Sokendai.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
PoC Induction 19-April VBrowser (VL-e Toolkit) The single point of access to the grid  Medical use case: functional MRI (fMRI)  VBrowser design  VBrowser.
2003/03/25天文学会春季年会 JVO の研究開発 (2) 全体進捗 大石雅寿 国立天文台 & 総研大
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
The International Virtual Observatory Alliance (IVOA) interoperability in action.
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
2003/11/27CVO Meeting in Beijing Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai.
Microsoft FrontPage 2003 Illustrated Complete Integrating a Database with a Web Site.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
Japanese Virtual Observatory (JVO) National Astronomical Observatory of Japan (NAOJ) Contact Address: Demo 1: GRID-based database federation.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
USGS GRID Exploratory Status Review Stuart Doescher Mike Neiers USGS/EDC May
An approach to Web services Management in OGSA environment By Shobhana Kirtane.
Three color composite image Color-Color diagram SED SED relative to R-band Download FITS Searching for a cosmic string through the gravitational lens effect:
IVOA Small Projects Meeting Application to the science S. Honda, Y. Shirasaki, M. Tanaka and JVO team National Astronomical Observatory of Japan.
OGSA-DAI 简介及其它在 China-VO DAS 系统中的应用 杨阳 中国虚拟天文台研发团队 Chinese Virtual Observatory.
2004/03/08Japan-France Grid Computing Workshop in Paris Japanese Virtual Observatory Project Masatoshi Ohishi National Astronomical Observatory of Japan.
Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,
April 29, 2005ISGC Taipei1 Recent Progress of the Japanese Virtual Observatory Project Masatoshi Ohishi / NAOJ 大石雅寿 / 国立天文台
Data services on the NGS
EVLA Archive The EVLA Archive is the E2E Archive
May 14 (Wed) Masatoshi Ohishi (Japan)
2018/11/23 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Current Status of Japanese Virtual Observatory
2018/11/27 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Progress Report of VOQL WG
Google Sky.
Presentation transcript:

Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project since April JVO utilizes the Grid technology to combine several remote computational resources. We have defined the query language for the JVO to federate multiple astronomical databases and constructed a prototype of the JVO to confirm whether federated databases can be accessed through Grid technology. More information is available at: Masatoshi OHISHI, Yoshihiko MIZUMOTO, Naoki YASUDA, Yuji SHIRASAKI, Masahiro TANAKA, Satoshi HONDA (NAOJ) and Yoshifumi MASUNAGA (Ochanomizu Univ. and NAOJ) in Collaboration with Fujitsu Ltd. Contact Address: Road Map Design for Prototype II JVO Prototype Ver 1. Main Control Window Write JVO QL here or use an editor. Open a JVO QL Editor User’s own service User’s own service Security mngmt Resource mngmt MVC MVCMVC JVO Portal JVO Portal Astronomical Catalog Query Service Astronomical Catalog Query Service Globus Toolkit Catalog DB Service Registry Service Registry Researcher Browser for JVO Browser for JVO Viewer for JVO Viewer for JVO Data Archive Service Data Archive Service Data manage DB Data Virtual Observation execution service Virtual Observation execution service Data Analysis service Data Analysis service Service Registry Service Registry Other VO services Other Catalog services Other Catalog services Globus Toolkit JVO GRID Environment Other GRID Environment UDDI server Web Browser Web ブラウザ Services callable through Grid Globus Toolkit V2 Data management Security mngmt Resource mngmt Data management At the beginning, researchers provide the JVO with simple instructions how they plan to use their own ''Virtual Observation''. The JVO portal interprets them and generates a work flow through consulting the UDDI servers, where available JVO services are registered. Based on the work flow, built-in or user- defined services are called. The GRID framework is used for dynamical assignment of distributed resources according to their availabilities. Execution results of the work flow are transferred through GridFTP and presented to the researchers. Three-Tiered Design of the JVO Prototype I The first version of JVO prototype has been completed. The design of the JVO prototype is shown as a schematic diagram. We adopted to use the Globus Toolkit 2 for our prototype. However, we also take into account the Web Service concept which is included in the Globus Toolkit 3. A main control window provides you to specify a query in JVO Query Language. You can save/load the QL in a file with the Export/Import button. A QL editor is opened by pushing the editor button and provides an easy way to specify search conditions. The JVO system splits the user input query into pieces of queries for each database, then issues search commands to appropriate servers through a “globus-job-submit” command of Globus Toolkit. This example shows a demo doing a cross-matching search between the two databases SDF-i’ and SDF-z’. At first a search command is issued to the SDF-i’ database server, mizu-g, then the result is transferred to the SDF-z’ database server, minazuki-g, where cross-matching search is executed. Image requests are issued at the last two steps.The query results are transferred through GridFTP in a VOTable format for table data and in FITS for image data. The query result is shown up in a result page, which is a kind of VOTable viewer and provides an easy access to both the table and image data. For graphical viewing of the table data, plotting tool is available. You can specify any column or expression for X/Y axis. Column attributes are displayed by pushing the “column_info” button, where you can also control the column layout. We are designing the JVO prototype II, which is an extension of the prototype I and incorporates functions required in the practical system. Followings will be newly implemented or improved on the prototype II: JVO project start Development of Prototype I Development of Prototype II Development of Practical Systems Experimental service start 1. Adoption of Globus Toolkit 3 (OGSA), 2. User management, 3. Simple user interface for making a query, showing the result, and so on.., 4. Federation of the distributed DBs, 5. Integrated data analysis services. The current JVO prototype can communicates with four distributed database, “Subaru Deep Field i’-band” (SDF-i’), SDF-z’, “Subaru XMM Deep Survey” (SXDS), and 2MASS. Linux X match データ検索処理 データ数 count PostgreSQL 画像管理 DB WSDL データベースサーバ2 SUBARU SupCam i-band Globus Toolkit V3 OGSA-DAI Analysis services Query request Gb Ether Solaris8 Web Browser User operation Window Windows, Solaris8, Linux Globus Toolkit V3 Make schedule I JVO-QL parse server Portal Server Solaris8 X match Distributed Resource manager OGSA -DAI DAISGR Results Window Search criteria Window ・ Search DAISGR ・ Parse GWDSL ・ Preparation, Execute ・ Confirmation of results Web Server Make schedule II Data query services Globus Toolkit V3 Data number count PostgreSQL Image management DB Linux Data query services Data number count ORACLE Image management DB Security Manager Resource Manager Globus Tk Portal servlet GWSDL WSDL Data base server N Data Base server 1 SUBARU SupCam z-band 2MASS Query request Registry search Query Results Status monitor Window Status monitor Registry User management Status display Data storage Globus Toolkit V3 OGSA-DAI Globus Toolkit V3 OGSA-DAI Analysis services Query request GT3 user data User DB server Linux Analysis services Analysis server Gb Ether Analysis request Federation of distributed DBs Distributed processing control