Gaël YOUINOU Earth Science demo 1 24 november 2004 CGG is a leading supplier of applied reservoir solutions, geophysical services and products to the worldwide.

Slides:



Advertisements
Similar presentations
EGEE is a project funded by the European Union under contract IST EGEE Tutorial Turin, January Hands on Job Services.
Advertisements

SARA Reken- en NetwerkdienstenToPoS | 3 juni 2007 More efficient job submission Evert Lammerts SARA Computing and Networking Services High Performance.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
Workload management Owen Maroney, Imperial College London (with a little help from David Colling)
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
Gaël YOUINOU EGEE Industry Day 1 Paris, 27th april 2006 EGEE 1st Industry Day Paris, 27th April 2006 EGEE 1st Industry Day Paris, 27th April 2006 Compagnie.
1 Generic logging layer for the distributed computing by Gene Van Buren Valeri Fine Jerome Lauret.
The Grid Constantinos Kourouyiannis Ξ Architecture Group.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Enabling Grids for E-sciencE gLite training at Sinaia '06 Victor Penso Kilian Schwarz GSI Darmstadt Germany.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico.
A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.
Enabling Grids for E-sciencE EGEE-II INFSO-RI BG induction to GRID Computing and EGEE project – Sofia, 2006 Practical: Porting applications.
INFSO-RI Enabling Grids for E-sciencE EGEODE VO « Expanding GEosciences On DEmand » Geocluster©: Generic Seismic Processing Platform.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
GRID Computing: Ifrastructure, Development and Usage in Bulgaria M. Dechev, G. Petrov, E. Atanassov.
Computational grids and grids projects DSS,
E-science grid facility for Europe and Latin America Watchdog: A job monitoring solution inside the EELA-2 Infrastructure Riccardo Bruno,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
CHEP 2003Stefan Stonjek1 Physics with SAM-Grid Stefan Stonjek University of Oxford CHEP th March 2003 San Diego.
Enabling Grids for E-sciencE Workload Management System on gLite middleware Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam)
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
Nadia LAJILI User Interface User Interface 4 Février 2002.
E-science grid facility for Europe and Latin America Marcelo Risk y Juan Francisco García Eijó Laboratorio de Sistemas Complejos Departamento.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
Workflow Template Generation Haw to. Steps Make proper set of WF examples on Portal Save it to a local directory Decompress it Make a Template Directory.
Migrating Desktop The graphical framework for running grid applications Bartek Palak Poznan Supercomputing and Networking Center The.
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Practical: Porting applications to the GILDA grid Slides from Vladimir Dimitrov, IPP-BAS.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives Plovdiv, 2006.
E-science grid facility for Europe and Latin America Using Secure Storage Service inside the EELA-2 Infrastructure Diego Scardaci INFN (Italy)
INFSO-RI Enabling Grids for E-sciencE The gLite Workload Management System Elisabetta Molinari (INFN-Milan) on behalf of the JRA1.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
INFSO-RI Enabling Grids for E-sciencE Earth Sciences: EGEODE « Expanding Geosciences On Demand » EGEE 1 st EU Review – 9 th to 11.
Job Management DIRAC Project. Overview  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you have learned? KEK 10/2012DIRAC Tutorial.
The EDGeS project receives Community research funding 1 Porting Applications to the EDGeS Infrastructure A comparison of the available methods, APIs, and.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.
1 DIRAC Job submission A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán.
SAMPLE IMAGE gLite on the Market – Why and How ir Works 4 th EGEE User Forum Thursday, 05 March 2009 Le Ciminiere, Catania, Sicily, Italy Gaël Youinou.
1 Practical information for the GEMLCA / P-GRADE hands-on Tamas Kiss University of Westminster.
Development of test suites for the certification of EGEE-II Grid middleware Task 2: The development of testing procedures focused on special details of.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Porting an application to the EGEE Grid & Data management for Application Rachel Chen.
INFSO-RI Enabling Grids for E-sciencE Production Demonstrations: Introduction Marc-Elian Bégin – NA1/NA2 - CERN EGEE 1 st EU Review.
EGEODE business model based on gLite Gael Youinou CGGVeritas
User Interface UI TP: UI User Interface installation & configuration.
BE18 – Seismic Processing and Reservoir Simulation Gaël Youinou – CGG
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
Job Management Beijing, 13-15/11/2013. Overview Beijing, /11/2013 DIRAC Tutorial2  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Advanced Job Riccardo Rotondo
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract IST Report from.
INFSO-RI Enabling Grids for E-sciencE Earth Science Applications M. Petitdidier (CNRS/IPSL-Paris)
EO Applications Parallel Session
EGEE tutorial, Job Description Language - more control over your Job Assaf Gottlieb Tel-Aviv University EGEE is a project.
Workload Management System
Earth Sciences: EGEODE « Expanding Geosciences On Demand »
5. Job Submission Grid Computing.
gLite Job Management Christos Theodosiou
GENIUS Grid portal Hands on
Hands on Session: DAG Job Submission
Presentation transcript:

Gaël YOUINOU Earth Science demo 1 24 november 2004 CGG is a leading supplier of applied reservoir solutions, geophysical services and products to the worldwide oil & gas industry Compagnie Générale de Géophysique

Gaël YOUINOU Earth Science demo 2 24 november 2004 Processing (software, site design & services) Reservoir services Spec data Acquisition (equipment & services) CGG in the Oil and Gas industry

Gaël YOUINOU Earth Science demo 3 24 november 2004 Acquisition 1-10 TB/proj (IBM 34/3590) Processing 5-50 TB/proj (SAN) Interpretation << 1 TB/proj Seismic processing Vienna Stavanger Aberdeen London MassyLa Defense Assen Pau Oslo Calgary Maracaibo Caracas Luanda Port Harcourt Cairo Muscat Oslo London Paris Kuala Lumpur Perth Villahermosa Houston Abu Dhabi Jakarta Porto La Cruz

Gaël YOUINOU Earth Science demo 4 24 november 2004 Clusters deployment T Flops CLUSTER NUMA

Gaël YOUINOU Earth Science demo 5 24 november 2004CGEGEE  IT side Create a node of the European grid (April 04) Learn how to install/use/administrate and improve (via EGEE) the middleware (End 04) Evaluate the cost of Managing grid infrastructure (up to End 05) Create an Internal Technology grid: Houston / Massy / Vantage (Q1-05)  Software side Connect an application on top of the middleware Q3-04 Define how to switch resources between EGEE – CGG Q4-04 Link Grid middleware and CGG Job Manager Q1-05 (to allow mix of local and grid activity) Understand and validate new programming models in real situation (robustness, portability, performances, difficulty to develop,..) Explore new ways for end user (web services,…) – 2005  V.O. side EGEODE: Expanding GEosciences On DEmand Dedicated to Research in Geosciences Done

Gaël YOUINOU Earth Science demo 6 24 november 2004 CGG Resource Center (SA1)  CGG operational Resource Center (grid node) in August 2004 Futur cluster (new WNs) Private network Public network x 24 WNs

Gaël YOUINOU Earth Science demo 7 24 november 2004 CGG Resource Center  CGG operational Resource Center (grid node) in August 2004

Gaël YOUINOU Earth Science demo 8 24 november 2004 Geocluster ©  GEOCLUSTER© is CGG's seismic processing software Limited version of the software for test/demonstration purpose Demonstrate the feasibility of running our software on the grid  Components: 1.An executable binary file yuc.exe: GEOCLUSTER© core executable for Linux, takes a GSL (Geocluster Seismic Language) file as input 1.A script file run.sh: Shell script used to launch the seismic job and manage output files. Takes the GSL file as argument 2.The user's seismic job file. Coded in the GSL to be submitted with the JDL 3.Input/Output seismic files Most of Geocluster© jobs will take seismic traces data to be processed in an input file and will save the result of this processing in an output file

Gaël YOUINOU Earth Science demo 9 24 november 2004 Geocluster © on EGEE example file egeode.jdl: # Type = "job"; JobType = "normal"; Executable = "run.sh"; VirtualOrganisation = "dteam"; OutputData={[ OutputFile="gct_job.out.tar.bz2"; LogicalFileName="lfn:gct_job.out.tar.bz2" ]}; StdOutput = "log"; StdError = "err"; OutputSandbox = {"log","err","gct_job.out.tar.bz2"}; InputSandbox = {"run.sh","gct.in.tar.bz2"}; # InputSandbox = {"run.sh","gct.in.tar.bz2"}; gct.in.tar.bz2 : contains the GSL file(s) and yuc.exe OutputSandbox = {"log","err","gct_job.out.tar.bz2"}; gct_job.out.tar.bz2 : contains all the output files produced by the GSL file(s)

Gaël YOUINOU Earth Science demo november 2004 Geocluster © GSL Geocluster Seismic Language (GSL) Brief description (syntax is column sensitive) 1 to 2: '* ' a star followed by a space means a module name is to be read in column 3 to 7; '**' 2 stars mean this line is a comment line; ' ' 2 spaces mean this is a continuation line for current module's parameters. 2 to 7: Geocluster seismic module name 9 to 10: seismic module option 15 to 16: seismic module input buffer 23 to 24: seismic module output buffer 31 to 80: seismic module parameters; May continue on next line starting at column 3.

Gaël YOUINOU Earth Science demo november 2004 Geocluster © GSL The GSL file is divided in 2 parts: 1.The 1rst part provide auxiliary data for the job (LIBRI) velocity laws, water bottom data, mute data; 2.The 2nd part contains the seismic modules within a loop Module DAGEN Generates synthetic seismic traces that are delivered into EA buffer Module FANMO (Hyperbolic, non-hyperbolic or linear move out) Takes the seismic trace as input in EA buffer and output the processed seismic traces in EB buffer Linear interpolation is used to obtain velocity for all points in time Module LISTE Print the contents of trace EB in the job output listing file "list$$“

Gaël YOUINOU Earth Science demo november 2004 Geocluster © Job

Gaël YOUINOU Earth Science demo november 2004 Geocluster © tests + EGEE Genius portal Geocluster edg-job-submit–vodteam-oStatus.1egeode.jdl edg-job-status–i $HOME/EGEODE/Status.1 edg-job-get-output–i $HOME/EGEODE/Status.1 edg-job-submit–vodteam-oStatus.1egeode.jdl edg-job-status–i $HOME/EGEODE/Status.1 edg-job-get-output–i $HOME/EGEODE/Status.1 +GSLEdg commandsJDL

Gaël YOUINOU Earth Science demo november 2004 Genius portal – Job submission

Gaël YOUINOU Earth Science demo november 2004 Genius portal – Job queue

Gaël YOUINOU Earth Science demo november 2004 Genius portal – Job results

Gaël YOUINOU Earth Science demo november 2004 Tests on EGEE nodes JDL + GSL edg-job-xxx commands

Gaël YOUINOU Earth Science demo november 2004 CGG is a leading supplier of applied reservoir solutions, geophysical services and products to the worldwide oil & gas industry Compagnie Générale de Géophysique