Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.

Slides:



Advertisements
Similar presentations
© Copyright 2008 All rights reserved 2 VO-India Project Started in 2002 as a collaboration between IUCAA and Persistent Systems Ltd. Part of International.
Advertisements

IVOA Interoperablity meeting KyotoMasahiro Tanaka (NAOJ) 1 JVO use of Globus Toolkit Masahiro Tanaka (NAOJ)
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
September 13, 2004NVO Summer School1 VO Protocols Overview Tom McGlynn NASA/GSFC T HE US N ATIONAL V IRTUAL O BSERVATORY.
Aus-VO Workshop 2003 International Virtual Observatory Alliance effort on Virtual Observatory Query Language Naoki Yasuda (JVO), VOQL WG.
Remote Visualisation System (RVS) By: Anil Chandra.
AS ICT Finding your way round MS-Access The Home Ribbon This ribbon is automatically displayed when MS-Access is started and when existing tables.
Web Visualization Technology Horner APG Ver 1.0.
Construction of the Japanese Virtual Observatory (JVO) Abstract : The National Astronomical Observatory of Japan (NAOJ) has been operating several large.
Design and Implementation of JVO SkyNode Yuji SHIRASAKI National Astronomical Observatory of Japan IVOA Small Projects Meeting, 2004 Oct 1.
Towards the Design and Implementation of the DAME prototype: OGSA Compliant Grid Services on the White Rose Grid Sarfraz A Nadeem University of Leeds.
SXDS database and Japanese Virtual Observatory Yuji Shirasaki and JVO collaborations National Astronomical Observatory of Japan.
SiS Technical Training Development Track Technical Training(s) Day 1 – Day 2.
Chapter 7 Managing Data Sources. ASP.NET 2.0, Third Edition2.
SQL Reporting Services Overview SSRS includes all the development and management pieces necessary to publish end user reports in  HTML  PDF 
1 Chapter 20 — Creating Web Projects Microsoft Visual Basic.NET, Introduction to Programming.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Digitized Sky Survey Update Brian McLean : Archive Sciences Branch / Operations and Engineering Division.
Database-Driven Web Sites, Second Edition1 Chapter 8 Processing ASP.NET Web Forms and Working With Server Controls.
XHTML Introductory1 Forms Chapter 7. XHTML Introductory2 Objectives In this chapter, you will: Study elements Learn about input fields Use the element.
About Dynamic Sites (Front End / Back End Implementations) by Janssen & Associates Affordable Website Solutions for Individuals and Small Businesses.
16-1 The World Wide Web The Web An infrastructure of distributed information combined with software that uses networks as a vehicle to exchange that information.
CPS120: Introduction to Computer Science The World Wide Web Nell Dale John Lewis.
Supported by the National Science Foundation’s Information Technology Research Program under Cooperative Agreement AST with The Johns Hopkins University.
11/27/2003IVOA Small Projects Meeting China-VO Data Access Service Based on OGSA Jian Sang National Astronomical Observatory of China Chinese Virtual.
The Japanese Virtual Observatory (JVO) Yuji Shirasaki National Astronomical Observatory of Japan.
Astronomical Data Query Language Simple Query Protocol for the Virtual Observatory Naoki Yasuda 1, William O'Mullane 2, Tamas Budavari 2, Vivek Haridas.
The GAVO Cross-Matcher Application Hans-Martin Adorf, Gerard Lemson, Wolfgang Voges GAVO, Max-Planck-Institut für extraterrestrische Physik, Garching b.
Yuji SHIRASAKI National Astronomical Observatory of Japan Current Status of Japanese Virtual Observatory (JVO)
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Tutorial 7 Creating Forms. Objectives Session 7.1 – Create an HTML form – Insert fields for text – Add labels for form elements – Create radio buttons.
Prototype system of the Japanese Virtual Observatory The Japanese Virtual Observatory (JVO) aims at providing easy access to federated astronomical databases.
JVO JVO Portal Japanese Virtual Observatory (JVO) Prototype 2 Masahiro Tanaka, Yuji Shirasaki, Satoshi Honda, Yoshihiko Mizumoto, Masatoshi Ohishi (NAOJ),
May 10, 2006IVOA-GGF Astro-RG WS1 Welcome and Workshop Goal Masatoshi Ohishi / NAOJ & Sokendai Chairman, IVOA 大石雅寿 / 国立天文台 & 総合研究大学院大学
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
1 Welcome to CSC 301 Web Programming Charles Frank.
P Structured Query Language for Virtual Observatory Yuji Shirasaki National Astronomical Observatory of Japan, and Masahiro Tanaka (NAOJ), Satoshi.
Federation and Fusion of astronomical information Daniel Egret & Françoise Genova, CDS, Strasbourg Standards and tools for the Virtual Observatories.
A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
McGraw-Hill/Irwin The O’Leary Series © 2002 The McGraw-Hill Companies, Inc. All rights reserved. Microsoft Access 2002 Lab 3 Analyzing Tables and Creating.
IVOA Interoperalibity JVO Query Language Naoki Yasuda (NAOJ/Japanese VO)
February 20, 2006JVO-AstroGrid Collaboration1 Current Status of JVO, and Goal of Collaboration between JVO and AstroGrid Masatoshi Ohishi / NAOJ & Sokendai.
Oct. 1, 2004IVOA Small Projects Meeting1 Development of JVO prototype system and its application to Astrophysics Portal System : M. Tanaka Data Service.
Solar and space physics datasets within a Virtual Observatory: the AstroGrid experience Silvia Dalla * and Nicholas A Walton  * School of Physics & Astronomy,
Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project.
Progress Report of VOQL WG May 15 (Thu) Masatoshi Ohishi (Japan)
The International Virtual Observatory Alliance (IVOA) interoperability in action.
May 17, 2005Maria Nieto-Santisteban, JHU / IVOA - Kyoto1 VO JHU Open SkyQuery and more … T. Budavari, S. Carliles, L. Dobos, G. Fekete,
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
GRITS 2011: Benny Chan. Browsers as Application GUI  Modern Browsers are basically an HTML and a power JavaScript rendering engine.  As the internet.
Japanese Virtual Observatory (JVO) National Astronomical Observatory of Japan (NAOJ) Contact Address: Demo 1: GRID-based database federation.
©SoftMooreSlide 1 Introduction to HTML: Forms ©SoftMooreSlide 2 Forms Forms provide a simple mechanism for collecting user data and submitting it to.
8 Chapter Eight Server-side Scripts. 8 Chapter Objectives Create dynamic Web pages that retrieve and display database data using Active Server Pages Process.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
JVO portal service Yuji Shirasaki National Astronomical Observatory of Japan.
USGS GRID Exploratory Status Review Stuart Doescher Mike Neiers USGS/EDC May
Publishing Combined Image & Spectral Data Packages Introduction to MEx M. Sierra, J.-C. Malapert, B. Rino VO ESO - Garching Virtual Observatory Info-Workshop.
Three color composite image Color-Color diagram SED SED relative to R-band Download FITS Searching for a cosmic string through the gravitational lens effect:
IVOA Small Projects Meeting Application to the science S. Honda, Y. Shirasaki, M. Tanaka and JVO team National Astronomical Observatory of Japan.
CHAPTER 7 LESSON C Creating Database Reports. Lesson C Objectives  Display image data in a report  Manually create queries and data links  Create summary.
2004/03/08Japan-France Grid Computing Workshop in Paris Japanese Virtual Observatory Project Masatoshi Ohishi National Astronomical Observatory of Japan.
April 29, 2005ISGC Taipei1 Recent Progress of the Japanese Virtual Observatory Project Masatoshi Ohishi / NAOJ 大石雅寿 / 国立天文台
Standard Query Language for VO
PHP / MySQL Introduction
May 14 (Wed) Masatoshi Ohishi (Japan)
2018/11/23 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Current Status of Japanese Virtual Observatory
2018/11/27 An Application for the Data Grid : A Prototype of the Japanese Virtual Observatory System Masatoshi Ohishi National Astronomical Observatory.
Progress Report of VOQL WG
Google Sky.
Presentation transcript:

Japanese Virtual Observatory Project Abstract : The National Astronomical Observatory of Japan (NAOJ) started the Japanese Virtual Observatory (JVO) project since April JVO utilizes the Grid technology to combine several remote computational resources. We have defined the query language for the JVO to federate multiple astronomical databases and constructed a prototype of the JVO to confirm whether federated databases can be accessed through Grid technology. More information is provided at: Masatoshi OHISHI, Yoshihiko MIZUMOTO, Naoki YASUDA, Yuji SHIRASAKI, Masahiro TANAKA, Satoshi HONDA (NAOJ) and Yoshifumi MASUNAGA (Ochanomizu Univ. and NAOJ) in Collaboration with Fujitsu Ltd. Contact Address: Federate with more data: Data of SUBARU open use/Nobeyama Radio Observatory Interoperability with other VOs : Toward International VO CPU intensive analysis tools: Deconvolution, image subtraction…, Run on PC cluster via GRID Data mining / visualization tools: Manage huge amount of data Future Plan The JVO Query Language JVOQL has an ability to query image data without referring to catalogs. This ability is useful for multi-color or multi-epoch analyses. The above JVOQL example shows how to obtain R-band images taken by SUBARU and K-band images by select s.a, t.a,... from SUBARU.R s, 2MASS.K t,... where (s.AREA() OVERLAP t.AREA()) as a create view myEROtable as select s.Bmag, s.Rmag, t.Hmag, t.Kmag,..., sr.BOX(POINT(s.ra,s.dec),w,h) as Rimage, tk.BOX(POINT(s.ra,s.dec),w,h) as Kimage,... from SUBARU s, 2MASS t,..., SUBARU.R sr, 2MASS.K tk,... where XMATCH(s, t,...) < 3 arcsec and (s.Rmag-t.Kmag) > 6 mag and BOX(POINT(ra0,dec0), w0, h0) and... Specify search area with the same syntax as cutout image specification. Create view with the user specified name in JVO system. Select attributes from each catalog server. Column names can be expressed in UCD. Select the catalog server. Select the image data server. Cross-match distributed catalogs. Query condition based on distributed catalog. Select cutout images from each image data server. Image area can be specified by BOX or CIRCLE operand. The JVO Query Language (JVOQL) is used in JVO as a language to specify a variety of user queries. The JVOQL has been designed to have similar grammar with SQL for the relational database with the additional functionalities to handle image data and cross-match among distributed databases. The parser of JVOQL communicates with the registry of available databases and issues a series of queries to distributed databases. JVOQL together with SkyQuery are adopted as a prototype of the query language for IVO. SUBARU.R s2MASS.K t s.AREA()t.AREA() AREA table cutout request OVERLAP s t a1 a2 a3 Partition to small segment 2MASS in an area where both SUBARU and 2MASS observed. The operand "OVERLAP" returns overlapped area of the two data. Similarly the operand "X.AREA()" returns the observed area of server X. JVO Prototype Ver 1. Main Control Window Write JVO QL here or use an editor. Open a JVO QL Editor User’s own service User’s own service Security mngmt Resource mngmt MVC MVCMVC JVO Portal JVO Portal Astronomical Catalog Query Service Astronomical Catalog Query Service Globus Toolkit Catalog DB Service Registry Service Registry Researcher Browser for JVO Browser for JVO Viewer for JVO Viewer for JVO Data Archive Service Data Archive Service Data manage DB Data Virtual Observation execution service Virtual Observation execution service Data Analysis service Data Analysis service Service Registry Service Registry Other VO services Other Catalog services Other Catalog services Globus Toolkit JVO GRID Environment Other GRID Environment UDDI server Web Browser Web ブラウザ Services callable through Grid Globus Toolkit V2 Data management Security mngmt Resource mngmt Data management At the beginning, researchers provide the JVO with simple instructions how they plan to use their own ''Virtual Observation''. The JVO portal interprets them and generates a work flow through consulting the UDDI servers, where available JVO services are registered. Based on the work flow, built-in or user-defined services are called. The GRID framework is used for dynamical assignment of distributed resources according to their availabilities. Execution results of the work flow are transferred through GridFTP and presented to the researchers. Three-Tiered Design of the JVO Prototype The first version of JVO prototype has been completed. The design of the JVO prototype is shown as a schematic diagram. We adopted to use the Globus Toolkit 2 for our prototype. However, we also take into account the Web Service concept which is included in the Globus Toolkit 3. The current JVO prototype can communicates with four distributed database, “Subaru Deep Field i’-band” (SDF-i’), SDF-z’, “Subaru XMM Deep Survey” (SXDS), and 2MASS. A main control window provides you to specify a query in The JVO system splits the user input query into pieces of queries for each database, then issues search commands to appropriate servers through a “globus-job-submit” command of Globus Toolkit. This example shows a demo doing a cross-matching search between the two databases SDF-i’ and SDF-z’. At first a search command is issued to the SDF-i’ database server, mizu-g, then the result is transferred to the SDF-z’ database server, minazuki-g, where cross-matching search is executed. Image requests are issued at the last two steps.The query results are transferred through GridFTP in a VOTable format for table data and in FITS for image data. The query result is shown up in a result page, which is a kind of VOTable viewer and provides an easy access to both the table and image data. For graphical viewing of the table data, plotting tool is available. You can specify any column or expression for X/Y axis. Column attributes are displayed by pushing the “column_info” button, where you can also control the column layout. JVO Query Language. You can save/load the QL in a file with the Export/Import button. A QL editor is opened by pushing the editor button and provides an easy way to specify search conditions.