Presentation is loading. Please wait.

Presentation is loading. Please wait.

Workflow Template Generation Haw to. Steps Make proper set of WF examples on Portal Save it to a local directory Decompress it Make a Template Directory.

Similar presentations


Presentation on theme: "Workflow Template Generation Haw to. Steps Make proper set of WF examples on Portal Save it to a local directory Decompress it Make a Template Directory."— Presentation transcript:

1 Workflow Template Generation Haw to

2 Steps Make proper set of WF examples on Portal Save it to a local directory Decompress it Make a Template Directory of it (TD) Define the Table of Actual Parameters TAP Apply the Macro Generator to gain Destination Directory MG( TD,TAP) -> DD Apply the Directory Compress And Upload Program Start the Submit All Command on the Portal Hand Made Preparation

3 What should be parameter? Formal ParameterNameExplanation wfSource Workflow name wf_dest Name of workflow to be generated. Name must be defined in accordance with the automatic visualization system vo Virtual organization of the selected job is integer in the range 1..3 seStorage Element destination host r direct resource with jobmanager of the selected job is integer in the range 1..3 f Logical name of the eventual remote file belonging to the selected port of the selected job is integer in the range 1..3 is integer in the range 1..2 e List of environment variables of the selected job It is just a string following the syntax in the JDL

4 Where are these Parameter? _files.wrk -> _files.wrk,,.grid..desc, /.jdl,,,

5 _files.wrk workflow " >" {"MultipLOC" 2 "MultipRemLoc" 1 OFFLINE"Copyrem" 1 "MultipLOC" 1 OFFLINE} {"Copyrem" SEQ_PORTAL (is_instrumented=false;monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/Copyrem/CopyAndTime" {""}"LINUX" {" >"} 0 "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/Copyrem/0/INPUT" (file_type=local;original_path="D:\A-TEST\I1") PERMANENT INPUT1 " >" (file_type=remote;local_path="/home/krisztian/pgportal/portal_work/users/hermann/ >_files/OUTPUT") PERMANENT OUTPUT"MultipLOC" SEQ_PORTAL (is_instrumented=false;monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/MultipLOC/multiply.exe" {""}"LINUX" {" >"} 0 "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/MultipLOC/0/INPUT1" (file_type=local;original_path="D:\A-TEST\I1") PERMANENT INPUT1 " >" (file_type=remote;local_path="/home/krisztian/pgportal/portal_work/users/hermann/ >_files/INPUT2") PERMANENT INPUT2 "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/MultipLOC/2/OUTPUT" (file_type=local;original_path="OUTPUT") PERMANENT OUTPUT "MultipRemLoc" SEQ_PORTAL (is_instrumented=false;monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/MultipRemLoc/multiply.exe" {""}"LINUX" {" >"} 0 " >" (file_type=remote;local_path="/home/krisztian/pgportal/portal_work/users/hermann/ >_files/INPUT1") PERMANENT INPUT1 "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/MultipRemLoc/1/INPUT2" (file_type=local;original_path="") PERMANENT INPUT2 "/home/krisztian/pgportal/portal_work/users/hermann/ >_files/MultipRemLoc/2/OUTPUT" (file_type=local;original_path="OUTPUT") PERMANENT OUTPUT} ResourceRemoteFile New FW name

6 .grid >

7 .desc hermann Indirect_REMOTE_Template Copyrem > > false

8 /.jdl [VirtualOrganisation = " >"; Executable = "Copyrem.sh"; JobType = "Normal"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"CopyAndTime", "Copyrem.sh","0/INPUT", "info.tar.gz"}; OutputSandbox = {"std.out", "std.err", "std.log"}; OutputData = { [OutputFile = "OUTPUT"; LogicalFileName = " >“ ]}; Environment = { >}; RetryCount = 3; Requirements = other.GlueCEInfoHostname == " >"; ]

9 wfwf_destsevo1r1f11f12e1vo2r2f21f22e2vo3r3f31 Indirect_REMO TE_Templ ateT_CO_SEQ_REM seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobmana ger-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00 "LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.y u" seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobman ager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00 "LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.y u" seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobman ager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00 aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnoooppp Indirect_REMO TE_Templ ate seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobmana ger-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00 "LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.y u" seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobman ager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00 "LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.y u" seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobman ager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00 U_B_C__N_Q seegrid_LCG_ 2_BROK ER gw01.rogrid.pub.ro:/jobmana ger-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00"LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.yu" U_B_C__N_QU_B_C_grid2.cs.bilkent.edu.tr_N_Q seegrid_LCG_ 2_BROK ER grid2.cs.bilkent.edu.tr:/jobma nager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00"LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.yu" U_B_C__S__Q SE_SUBSTI TUTI ON seegrid_LCG_ 2_BROK ER grid2.cs.bilkent.edu.tr:/jobma nager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00"LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.yu" U_B_C__S__Q U_B_C_grid2.cs.bilkent.edu.tr_S_g rid1.cs.bilkent.edu.tr _Q grid1.cs.bilk ent.ed u.tr seegrid_LCG_ 2_BROK ER grid2.cs.bilkent.edu.tr:/jobma nager-lcgpbs-seegrid lfn:/grid/seegrid/hermann/Test _2006_03_29_17_00"LCG_CATALOG_TYPE=lfc", "LFC_HOST=grid02.rcub.bg.ac.yu" Table of Actual Parameters

10 Haw To Generate Tab ? 1.Fill the Excell Table 2.When Save as, select Type : Text(Tab delimited)

11 Haw to call the Macro Generator ? public WorkflowMacroFactory(String templateDirPath, String tapDirPath, String destinationDir, boolean toUNIX) A test main program calls this by default parameters: new WorkflowMacroFactory( "d:\\A_A_WorkflowRepository\\TEMPLATES\\DecompressedTemplates", "d:\\A_A_WorkflowRepository\\TEMPLATES\\TAP_newComplex.txt", "d:\\A_A_WorkflowRepository\\TOM", false); External call: Java – Gener.jar

12 Apply the Directory Compress And Upload Program Under construction Temporary problems: - Zip –Unzip sensitive to OS - Upload should bypass WF Editor, because SAVE operation of WE overwrites /.jdl files


Download ppt "Workflow Template Generation Haw to. Steps Make proper set of WF examples on Portal Save it to a local directory Decompress it Make a Template Directory."

Similar presentations


Ads by Google