Satellital Image Clasification with neural networks Step implemented – Final Report Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR.

Slides:



Advertisements
Similar presentations
EGEE is a project funded by the European Union under contract IST EGEE Tutorial Turin, January Hands on Job Services.
Advertisements

INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
SEE-GRID-SCI User Interface (UI) Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Supporting MPI Applications on EGEE Grids Zoltán Farkas MTA SZTAKI.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
Special Jobs Claudio Cherubino INFN - Catania. 2 MPI jobs on gLite DAG Job Collection Parametric jobs Outline.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio COMETA
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Special Jobs Matias Zabaljauregui UNLP.
E-science grid facility for Europe and Latin America WAM Final Report Yassine LASSOUED & Ali Al Othman Coastal and Marine Resources Centre.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico.
EGEE is a project funded by the European Union under contract IST Input from Generic and Testing Roberto Barbera NA4 Generic Applications Coordinator.
Enabling Grids for E-sciencE EGEE-II INFSO-RI BG induction to GRID Computing and EGEE project – Sofia, 2006 Practical: Porting applications.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
E-science grid facility for Europe and Latin America OurGrid E2GRIS1 Rafael Silva Universidade Federal de Campina.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania ICTP/INFM-Democritos Workshop on Porting Scientific.
Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
Compiled Matlab on Condor: a recipe 30 th October 2007 Clare Giacomantonio.
1 HeMoLab - Porting HeMoLab's SolverGP to EELA glite Grid Environment FINAL REPORT Ramon Gomes Costa - Paulo Ziemer.
Sharif University of technology, Parallel Processing course, MPI & ADA Server Introduction By Shervin Daneshpajouh.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
Nadia LAJILI User Interface User Interface 4 Février 2002.
E-science grid facility for Europe and Latin America Marcelo Risk y Juan Francisco García Eijó Laboratorio de Sistemas Complejos Departamento.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) GISELA Additional Services Diego Scardaci
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Practical: Porting applications to the GILDA grid Slides from Vladimir Dimitrov, IPP-BAS.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives Plovdiv, 2006.
E-science grid facility for Europe and Latin America E2GRIS1 Gustavo Miranda Teixeira Ricardo Silva Campos Laboratório de Fisiologia Computacional.
E-science grid facility for Europe and Latin America Using Secure Storage Service inside the EELA-2 Infrastructure Diego Scardaci INFN (Italy)
E-science grid facility for Europe and Latin America gLite MPI Tutorial for Grid School Daniel Alberto Burbano Sefair, Universidad de Los.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
Job Management DIRAC Project. Overview  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you have learned? KEK 10/2012DIRAC Tutorial.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
E-science grid facility for Europe and Latin America MAVs-Study Biologically Inspired, Super Maneuverable, Flapping Wing Micro-Air-Vehicles.
Chapter 1 Computers, Compilers, & Unix. Overview u Computer hardware u Unix u Computer Languages u Compilers.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán.
1 Running MPI on “Gridfarm” Bryan Carpenter February, 2005.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals Giuseppe La Rocca INFN – Catania gLite Tutorial at the EGEE User Forum CERN.
OPTIMIZATION OF DIESEL INJECTION USING GRID COMPUTING Miguel Caballer Universidad Politécnica de Valencia.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA Special Jobs Valeria Ardizzone INFN - Catania.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
The Development Process Compilation. Compilation - Dr. Craig A. Struble 2 Programming Process Problem Solving Phase We will spend significant time on.
User Interface UI TP: UI User Interface installation & configuration.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Satellital Image Clasification with neural networks Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR
Presentation of the results khiat abdelhamid
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Advanced Job Riccardo Rotondo
Introduction to Computing Element HsiKai Wang Academia Sinica Grid Computing Center, Taiwan.
FESR Consorzio COMETA - Progetto PI2S2 Using MPI to run parallel jobs on the Grid Marcello Iacono Manno Consorzio Cometa
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
Hands on training session for core skills
Stephen Childs Trinity College Dublin
Advanced Topics: MPI jobs
gLite MPI Job Amina KHEDIMI CERIST
Special jobs with the gLite WMS
EGEE tutorial, Job Description Language - more control over your Job Assaf Gottlieb Tel-Aviv University EGEE is a project.
Alexandre Duarte CERN Fifth EELA Tutorial Santiago, 06/09-07/09,2006
5. Job Submission Grid Computing.
Special Jobs: MPI Alessandro Costa INAF Catania
Job Management with DATA
GENIUS Grid portal Hands on
Topali Lombardo Alessandro
Presentation transcript:

Satellital Image Clasification with neural networks Step implemented – Final Report Susana Arias, Héctor Gómez UNIVERSIDAD TÉCNICA PARTICULAR DE LOJA ECUADOR Itacuruça – Brazil, november 2 -15, 2008

Final Report Satellital Image Clasification use a neural network for clasification the percentage of land use of a satellite image. Itacuruça – Brazil, november 2 -15, 2008

Final Report First Solution ● We decide to compiler the windows's application in Linux, for that We use a mono's program (C# interface for Linux). 1. Create info about mono repository: cd /etc/yum.repos.d 2. Download and install: wget mono.com/download-stable/rhel-4-i386/mono.repo 3. We sure Linux kernel can run Mono applications "natively" (like Windows), without using "mono" every time. Following these directions, We create a script. Itacuruça – Brazil, november 2 -15, 2008

Final Report Problems encountered: Execute the commands only like root. rn]$./monos./monos: line 18: /proc/sys/fs/binfmt_misc/register: Permission denied rn]$ sudo./monos –Solution Install mono´s program in the worker node Itacuruça – Brazil, november 2 -15, 2008

Final Report Second Solution We translate the application from.net to C language with MPI libraries. Itacuruça – Brazil, november 2 -15, 2008

Final Report Second Solution Itacuruça – Brazil, november 2 -15, 2008 #include #include "mpi.h" /********** M A I N ******************************************************************************/ int numprocesses, procnum; int main(int nargs, char* argv[]) { NET Net; BOOL Stop; int result=MPI_Init(&nargs, &argv); MPI_ Comm_size(MPI_COMM_WORLD, &numprocesses); // get total number of processes MPI_ Comm_rank(MPI_COMM_WORLD, &procnum); // get process number for this process file bf.c

Final Report ● Then we compiler MPI en UI, $ mpiCC ● Compiler our application, $ mpiCC -o bf bf.c ● Then create a.jdl Type = “Job”; JobType = “MPICH”; Executable = “bf”; CPUNumber = 10 ; StdOutput = “output”; StdError = “error”; InputSandbox = {“bf”}; OutputSandbox = {“BPN.txt”}; Itacuruça – Brazil, november 2 -15, 2008

Final Report We compiler bf.c ONLY in the 64 bits machine, do not compiler the machine in 32 bits because do not have installed MPI. BF]$ glite-wms-job-submit -a -o jid bf.jdl BF]$ glite-wms-job-status -i jid BF]$ cd /tmp/jobOutput/app01_776TAA4JvsR-NP2gRkgamA/ BPN.txt NMSE is on Training Set and on Test Set NMSE is on Training Set and on Test Set NMSE is on Training Set and on Test Set Itacuruça – Brazil, november 2 -15, 2008

Final Report Then the application use a Storage Element for read the input files (Satellital Image) and run in the worker nodes. Itacuruça – Brazil, november 2 -15, 2008 JOB GET OUTPUT OUTCOME Output sandbox files for the job: ftNkvfdG3MGA have been successfully retrieved and stored in the directory: /tmp/jobOutput/app01_aUZWfM3V6- ftNkvfdG3MGA app01_aUZWfM3V6- ftNkvfdG3MGA]$ ls BPN.txt error output watchdog.log

Final Report Finally We use a GENIUS portal for submit the jobs, not with MPI. Itacuruça – Brazil, november 2 -15, 2008

Final Report: MrBayes As the same time, We worked in another application like Mrbayes (bionformatics), We install mrbayes at the UI, and We try to run mrbayes with condor, but it was not possible because there was not condor in the CE, finally We saw how to mrbyes runs with mpi and find out how to put some directives to run in the WN. Itacuruça – Brazil, november 2 -15, 2008

Final Report: MrBayes We send MrBayes application to GENIUS portal. Normally the time for run is 2 weeks, in 1 CPU, and the output files is a string sequence of 360GB Itacuruça – Brazil, november 2 -15, 2008

Itacuruça – Brazil, november 2 -15, 2008

Itacuruça – Brazil, november 2 -15, 2008 Thanks!

Itacuruça – Brazil, november 2 -15, 2008 Questions?

Itacuruça – Brazil, november 2 -15, 2008 Questions?

Thanks! Itacuruça – Brazil, november 2 -15, 2008