Presentation is loading. Please wait.

Presentation is loading. Please wait.

JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui.

Similar presentations


Presentation on theme: "JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui."— Presentation transcript:

1 JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui

2 Background JAXA and KEIO Univ are start to try establishing Digital Asia system In Digital Asia, it required to - search and access distributed data - semi-real time data processing JAXA had two of experiments

3 Purpose Extract problems to realize Digital Asia system by developing prototype. Accumulate knowledge, know-how for design of Digital Asia system.

4 Data GRID

5 Search satellite data to each node seamlessly Databases are geographically distributed Each node has different RDB PostgreSQL MySQL Oracle system Search satellite data to each node seamlessly Databases are geographically distributed Each node has different RDB PostgreSQL MySQL Oracle system USER node Nepal node Nepal Assumed scene for Data Grid Node Japan Node Japan PostgreSQL MySQL Oracle Node Chaina Node Chaina

6 GT3 + OGSA- DAI My SQL Metadata for Unified DB SQL Oracle FADGE XQuery Query engine Procesing metadata Unified data view virtual XML adopt XQuery Interface Translate XQuery to appropriate SQL XQuery results SQL PostgreSQL Apply GT3+OGSA-DAI) access DB over Firewall GT3 + OGSA- DAI JDBC GT3 + OGSA- DAI JDBC GT3 + OGSA- DAI JDBC SQL Unified data view Virtual XML Internet FW DataGrid For Digital Asia Access to hetero DBMS Distributed virtual unification Overview

7 metadata #3 metadata #2 unified dataview #2 unified dataview #3 XQuery XML XQuery XML XQuery XML System A System B System C metadata #1 metadata For unified DB unified dataview (virtual XML) #1 Create unified data view by Drag and drop Difference of each DB table colmn will absorbed in the editor Columns of each tables will be collected automatically Data Grid For Digital Asia Allows to built virtual unified system for distributed DB Metadata editor for Unified DB Distributed virtual unification Overview

8 Sample

9

10

11

12 Computing GRID

13 Computing node Management server Processing program sceine 1 2 11 12 1 2 11 12 1 2 11 12 1 2 11 12 1 2 11 12 Systemwalker CyberGRIP Master Systemwalker CyberGRIP Master Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Systemwalker CyberGRIP Agent Processed image [Windows] Windows SV 2003SE/EE Windows 2000 SV/AS/Pro Windows XP Professional [Linux] Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Red Hat Linux 9 Disk MB memory MB [Windows] Windows SV 2003SE/EE Windows 2000 SV/AS/Pro Windows XP Professional [Linux] Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Red Hat Linux 9 Disk MB memory MB Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Disk MB memory MB + User X 13MB) Red Hat Enterprise Linux AS(v. 3)/ES(v. 3) Disk MB memory MB + User X 13MB) Required spec of node Required spec of server Computing GRID Overview image processing image processing Image processing Image processing Image processing Image processing image processing image processing

14 Computing GRID Experiment We estimated following two cases. - submitting 100 dummy* jobs with no data transfer - submitting 100 dummy* jobs with 400MB data transfer * dummy job takes 90sec

15 Results

16 Cyber GRIP OJC(Organic Job Controller) Allows you to automatically generate a great number of computing jobs with simple descriptions using a script language. It also allows you to do parameter search, parameter sweep, and parametric study. GJES(GRID Job Execution System) - Virtually manages dispersed computing resources (computing servers) and equalizes loads on servers. Not only that, if a computer downs during job execution, automatically determines the downed event and executes the relevant job another computer. - Realizing unified job execution in a computing environment with heterogeneous operating systems

17 200 /11

18 Fujitsu plans - To create interface compliant to Globus tool kit

19 Future Plan 1 2 11 12 1 2 11 12 1 2 11 12 1 1 1 2 3 4 5 15 15 16 16 1 2 3 4 5 15 15 16 16 1 2 3 4 5 15 15 16 16 1 2 3 4 5 15 15 16 16 Computing GRID Data GRID ( ) Grid Portal Server Grid 1 2 3 4 5 15 15 16 16 1 2 3 4 5 15 15 16 16 1 2 3 4 5 15 15 16 16 SearchSearch AnalizeAnalize User Data Grid Computing Grid Realize GRID from search to Analize


Download ppt "JAXA GRID Activity JAXA/EORC Kengo Aizawa KEIO UNIVHiromichi Fukui."

Similar presentations


Ads by Google