Grid Programming on Taiwan Unigrid Platform

Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid

Introduction (1) The purpose of grid computing is to integrate various resources within a large network environment. The purpose of the UniGrid project is to build a platform for academic research using grid-related technologies in Taiwan.

Introduction (2) 8 institutes join to develop the system ◦ 國網中心 ◦ 清華大學資工系 ◦ 中研院資科所 ◦ 東華大學資工系 ◦ 東海大學資科系 ◦ 中華大學資工系 ◦ 興國管理學院電子商務學系 ◦ 靜宜大學資訊管理系

Introduction (3) 台灣大學電機系 台灣大學資工系 台灣師大資工系 淡江大學資工系 德明技術學院資科系 交通大學資工系 新竹教育大學資工所 逢甲大學資工系 台中教育大學資科系 國家高速網路與計算中心中 群 修平技術學院資管系 彰化師大資工系 中正大學資工系 成功大學電機系 成功大學資工系 台南大學數位學習科技系 長榮大學資管系 立德管理學院資管系 中山大學電機系 義守大學資工系 高雄大學資工系 台東大學資訊管理學系 Over 20 institutes provides their resource and join the Unigrid platform

Introduction (4) All institutes that participate in the UniGrid project contribute some resources. These resources can be used in collaboration for large scale applications.

Introduction (5)

Portal Demo

Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid ◦ Login ◦ Upload Program/Data ◦ Create Workflow ◦ Submit ◦ Check Job Status

Login Connect to Choose the Workflow Submition tab to login

Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid ◦ Login ◦ Upload Program/Data ◦ Create Workflow ◦ Submit ◦ Check Job Status

Data Storage System Press the Data Storage button ◦ Your computer required to have java runtime environment (jre) installed Choose trust to any prompt window

Data Storage System Your data storage space Your local diskUpload file Download file

When upload, always use 01_iisgridxx_IISAS series Data Storage System

Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid ◦ Login ◦ Upload Program/Data ◦ Create Workflow ◦ Submit ◦ Check Job Status

Structure of a workflow sequential execution parallel execution Workflow

Create Workflow To execute program, first thing is to create the workflow Then create the Stage Then create the Job and fill in proper job description Now we are ready for workflow submission

Edit Workflow Choose EditWorkflow in the left hand site Fill in the workflow name your like and press send

Create Stage A new workflow with the specified name will appear in the bottom of all existing workflows Press the edit this flow, a new text field will appear to create new stage with the specified stage name

Create job Press add new job of the specified stage to fill in the job description

Job Description-1 Scheduler: ◦ Using default ”Condor” JOB name : ◦ The name of this job Job Profile : ◦ This profile determined which machine will be allocated, you can try None, CPU_Bound, or Memory_Bound Run Type : ◦ Choose this wisely according to which kind of your program is Binary Filename : ◦ The filename of your program Argument : ◦ The arguments required by your program

Job Description-2 Data Filename: ◦ The input file name if required Note that the specified binary and data file must exist on date storage system before press the submission button Output filename : ◦ If your program generate output files, specify the output file name tell the grid system to transfer the output file back to date storage system while job complete. Number of processors : ◦ Required number of processors Machine Select: ◦ Select machine manually by specify the cluster name and required number of processors

Job Description-3 SRB Directory : ◦ It tells the grid where the Binary file and data file located ◦ Choose it always while execute your program Note that if you upload your program/date in a specified folder, please also add the relative path to the binary/date filename textfield ◦ EX. You build xxx directory in storage system and put in the file test.exe,then you must fill in the binary filename as./xxx/test.exe and check the SRB directory checkbox

Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid ◦ Login ◦ Upload Program/Data ◦ Create Workflow ◦ Submit ◦ Check Job Status

Submit Workflow Select the function Workflow Find out the workflow by the workflow name then press the submit

Outline Introduction to Taiwan Unigrid How to use Taiwan Unigrid ◦ Login ◦ Upload Program/Data ◦ Create Workflow ◦ Submit ◦ Check Job Status

Check Job Status Choose function Job Status You can see all the submitted workflows as a tree structure in the JobStatus page by ascending order of submit time. The detailed job result will show on the right side.

Job Result Description Job name ◦ The same as you specified in workflow Job ID ◦ A unique ID for each job Executable name ◦ The program name specified in binary filename field of workflow Job Start/Finish Time ◦ The time that this job actually start execution and end execution Machine List ◦ List the cluster name and number of processor used in this cluster Job Result ◦ The screen output of the program Job Log ◦ Used for debug, don’t care

Any Question?