The gLite information system: Top BDII

Slides:



Advertisements
Similar presentations
Tecnologia dei Servizi Grid e cloud computing - Lezione 8 0 Lezione Dicembre 2009 Il materiale didattico usato in questo corso è stato mutuato da.
Advertisements

EGEE-II INFSO-RI Enabling Grids for E-sciencE Information System Gonçalo Borges, Jorge Gomes, Mário David
EGEE-II INFSO-RI Enabling Grids for E-sciencE Information System Gonçalo Borges, Jorge Gomes, Mário David LIP Lisboa EGEE & Int.EU.Grid.
EDG Resource Broker for the Glue Schema Sergio Andreozzi INFN-CNAF Bologna (Italy)
The Information service Alessandro Costa INAF Catania Corso di Calcolo Parallelo Grid Computing Catania - ITALY September 2006.
INFSO-RI Enabling Grids for E-sciencE Information System : a detailed overview Giuseppe La Rocca INFN – Catania ICTP/INFM-Democritos.
Africa & Arabia ROC tutorial The GSTAT2 Grid Monitoring tool Mario Reale GARR - Italy ASREN-JUNET Grid School - 24 November 2011 Africa & Arabia ROC Tutorial.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Middleware: gLite Information Systems (IS) EGEE Tutorial 23 rd APAN Meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
LCG Information and Monitoring System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
Klaster obliczeniowy WLCG – cz.I Alice::WTU::LCG - skład: VOBOX  alicluster.if.pw.edu.plVM: saturn.if.pw.edu.pl CREAM-CE  aligrid.if.pw.edu.pl VM: saturn.if.pw.edu.pl.
Mar 28, 20071/18 The OSG Resource Selection Service (ReSS) Gabriele Garzoglio OSG Resource Selection Service (ReSS) Don Petravick for Gabriele Garzoglio.
GLUE Schema: LDIF to old classad mapping Gabriele Garzoglio Computing Division, Fermilab May 31, 2006.
EGEE is a project funded by the European Union under contract IST Job Description Language - more control over your Job Assaf Gottlieb University.
July 25, 20071/21 OSG Information Services Gabriele Garzoglio, Rob Quick, Chris Green OSG Information Services, VO Monitoring Services and Resource Selection.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
gLite Information System UNIANDES OOD Team Daniel Alberto Burbano Sefair, Michael Angel.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
E-infrastructure shared between Europe and Latin America gLite Information System(s) Manuel Rubio del Solar CETA-CIEMAT EELA Tutorial, Mérida,
Site-BDII Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical: The Information Systems.
EGEE is a project funded by the European Union under contract IST Job Description Language – How to control your Job Nadav Grossaug IsraGrid.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Storage Element Model and Proposal for Glue 1.3 Flavia Donno,
Computing for HEP in the Czech Republic Jiří Chudoba Institute of Physics, AS CR, Prague.
FESR Trinacria Grid Virtual Laboratory gLite Information System Muoio Annamaria INFN - Catania gLite 3.0 Tutorial Trigrid Catania,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
E-science grid facility for Europe and Latin America Updates on Information System Annamaria Muoio - INFN Tutorials for trainers 01/07/2008.
Information System Evolution Enabling Grids for E-sciencE EGEE-III INFSO-RI LDAP LDAP_ADD LDAP_MODIFY Query Merge Update Provider Plugin LDIF.
gLite Information System: General Information, GRIS, GIIS, BDII, Info provider, Sensors, Configuration and Debugging.
YAIM Giuseppe Platania INFN Catania EMBRACE Tutorial
Brief introduction about “Grid at LNS”
Gri2Win: Porting gLite to run under Windows XP Platform
Grid2Win: Porting of gLite middleware to Windows platform
Grid2Win Porting of gLite middleware to Windows XP platform
Information System testing for LCG-1
The Information System in gLite middleware
Practicals on gLite Information Systems
gLite Information System
Classic Storage Element
Information System: Hands On
Installation and configuration of a top BDII
gLite Information System(s)
Day-to-day testing & troubleshooting
Practical: The Information Systems
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
Towards GLUE Schema v Sergio Andreozzi – INFN/CNAF sergio
The Information System in gLite
Grid2Win: Porting of gLite middleware to Windows XP platform
Sergio Fantinel, INFN LNL/PD
Information System Virginia Martín-Rubio Pascual
gLite Information System
Practicals on gLite Information System
Job Description Language
Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, April 2006.
Gri2Win: Porting gLite to run under Windows XP Platform
Hands-on on Information System
Tutorial Grille (LCG/EGEE)
gLite Information System(s)
gLite Information System Practicals
EGEE Middleware: gLite Information Systems (IS)
Information and Monitoring System
Information System in gLite
gLite Information System
The gLite Information System
Hands-on on the gLite Information System
Information System (BDII)
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

The gLite information system: Top BDII Giuseppe Platania INFN Catania Tutorial per gli Insegnanti degli Istituti Tecnici Industriali Acireale, 4-7-11-13.05.2007

Outline Top BDII overview Differents between Top BDII and Site BDII The GLUE Schema Overview Core entities Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

BDII overview It's entirely based on LDAP Every node (except UI,BDII and Wns) has a GRIS service in order to publish its informations A node in every site collects all site GRISes and publishes them using a site BDII, usually installed on the CE The top BDII collects all site BDIIs From the UI a user can run a set of commands to query the top BDII. Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

Top BDII vs Site BDII Site BDII Top BDII By default it is installed on the CE It collects all site GRISes* (for example SE,RB,LFC,etc..) The name of the service is bdii Top BDII It collects all site BDIIs** (CE1,CE2 ..... CEn) It's contacted by the RB to match and dispatch user's jobs It can run in the same machine where the RB is running (it's more fast in answer) *GRIS=Grid Resource Information Service **BDII=Berkely Database Infomatin Index Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

The GLUE Schema Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

GLUE: Grid Laboratory Uniform Environment GLUE: overview GLUE: Grid Laboratory Uniform Environment It’s an information model that describe all those resources that partecipate in the Grid system and that are requested to be discoverable and monitored The same information can be retrieved from different GISs relying on different technology (e.g. R-GMA) Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

Site Element Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006 7

GLUE: site GlueSiteUniqueID: TRIGRID-INFN-CATANIA GlueSiteName: TRIGRID-INFN-CATANIA GlueSiteDescription: LCG Site GlueSiteUserSupportContact: mailto: grid-prod@ct.infn.it GlueSiteSysAdminContact: mailto: grid-prod@ct.infn.it GlueSiteSecurityContact: mailto: grid-prod@ct.infn.it GlueSiteLocation: Catania, Italy GlueSiteLatitude: 37.54866 GlueSiteLongitude: 15.036076 GlueSiteWeb: http://www.trigrid.it GlueSiteOtherInfo: TIER 1 GlueSiteOtherInfo: Trigrid Team Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

GLUE: service GlueServiceUniqueID: infn-rb-01.ct.trigrid.it:7772 GlueServiceName: INFN-CATANIA-rb GlueServiceType: ResourceBroker GlueServiceVersion: 1.2.0 GlueServiceEndpoint: infn-rb-01.ct.trigrid.it:7772 GlueServiceURI: unset GlueServiceAccessPointURL: not_used GlueServiceStatus: OK GlueServiceStatusInfo: No Problems GlueServiceWSDL: unset GlueServiceSemantics: unset GlueServiceStartTime: 1970-01-01T00:00:00Z GlueServiceOwner: trigrid GlueServiceOwner: cometa GlueServiceOwner: inaf GlueServiceOwner: alice GlueServiceAccessControlRule: trigrid GlueServiceAccessControlRule: cometa GlueServiceAccessControlRule: inaf GlueServiceAccessControlRule: alice GlueForeignKey: GlueSiteUniqueID=INFN-CATANIA Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

Cluster Element Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006 10

GLUE: cluster and subcluster GlueClusterName: infn-ce-01.ct.trigrid.it GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-short GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-long GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-infinite GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-cert GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-cometa GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-inaf GlueClusterService: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-alice [..] GlueSubClusterPhysicalCPUs: 4 GlueSubClusterLogicalCPUs: 4 GlueSubClusterTmpDir: /tmp GlueSubClusterWNTmpDir: /tmp Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

GLUE: Host GlueHostApplicationSoftwareRunTimeEnvironment: GLITE-3_0_0 GlueHostApplicationSoftwareRunTimeEnvironment: INFN-CATANIA GlueHostApplicationSoftwareRunTimeEnvironment: MPICH [..] GlueHostArchitectureSMPSize: 4 GlueHostBenchmarkSF00: 1937 GlueHostBenchmarkSI00: 1483 GlueHostMainMemoryRAMSize: 4096 GlueHostMainMemoryVirtualSize: 8192 GlueHostNetworkAdapterInboundIP: TRUE GlueHostNetworkAdapterOutboundIP: TRUE GlueHostOperatingSystemName: Scientific Linux CERN GlueHostOperatingSystemRelease: 3.0.6 GlueHostOperatingSystemVersion: SLC GlueHostProcessorClockSpeed: 2392 GlueHostProcessorModel: Dual Core Opteron 280 GlueHostProcessorVendor: AMD Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

Computing Element Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006 13

GLUE: Host Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006 GlueCEName: cometa GlueCEUniqueID: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-cometa GlueCEInfoGatekeeperPort: 2119 GlueCEInfoHostName: infn-ce-01.ct.trigrid.it GlueCEInfoLRMSType: lsf GlueCEInfoLRMSVersion: 6.1 GlueCEInfoTotalCPUs: 98 GlueCEInfoJobManager: lcglsf GlueCEInfoContactString: infn-ce-01.ct.trigrid.it:2119/jobmanager-lcglsf-cometa GlueCEInfoApplicationDir: /opt/exp_soft GlueCEInfoDataDir: unset GlueCEInfoDefaultSE: infn-se-01.ct.trigrid.it GlueCEStateEstimatedResponseTime: 61713 GlueCEStateFreeCPUs: 26 GlueCEStateRunningJobs: 70 GlueCEStateStatus: Production GlueCEStateTotalJobs: 70 GlueCEStateWaitingJobs: 0 GlueCEStateWorstResponseTime: 123427 GlueCEStateFreeJobSlots: 26 GlueCEPolicyMaxCPUTime: 2880 GlueCEPolicyMaxRunningJobs: 98 GlueCEPolicyMaxTotalJobs: 0 GlueCEPolicyMaxWallClockTime: 2880 GlueCEPolicyPriority: -10 GlueCEPolicyAssignedJobSlots: 98 GlueCEAccessControlBaseRule: VO:cometa Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

Computing Element Storage Element Storage Area Access protocols Information about the service (like Name,Port,URL) Storage Area Contains info of available and used disk space,file policies, access rules,etc. Access protocols Contains info about the protocols used to transfer files Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006 15

GLUE: Storage Element GlueSEUniqueID: infn-se-01.ct.trigrid.it GlueSEName: TRIGRID-INFN-CATANIA:srm_v1 GlueSEPort: 2811 GlueSESizeTotal: 16350 GlueSESizeFree: 16350 GlueSEArchitecture: multidisk GlueInformationServiceURL: ldap://infn-se-01.ct.trigrid.it:2135/mds-vo-name=lo cal,o=grid Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

GLUE: Storage Area GlueSARoot: cometa:/dpm/ct.trigrid.it/home/cometa GlueSAPath: /dpm/ct.trigrid.it/home/cometa GlueSAType: permanent GlueSALocalID: cometa GlueSAPolicyMaxFileSize: 10000 GlueSAPolicyMinFileSize: 1 GlueSAPolicyMaxData: 100 GlueSAPolicyMaxNumFiles: 10 GlueSAPolicyMaxPinDuration: 10 GlueSAPolicyQuota: 0 GlueSAPolicyFileLifeTime: permanent GlueSAStateAvailableSpace: 16350000000 GlueSAStateUsedSpace: 0 GlueSAAccessControlBaseRule: cometa Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

GLUE: Access Protocols GlueSEAccessProtocolLocalID: gsiftp GlueSEAccessProtocolType: gsiftp GlueSEAccessProtocolEndpoint: gsiftp://infn-se-01.ct.trigrid.it GlueSEAccessProtocolCapability: file transfer GlueSEAccessProtocolVersion: 1.0.0 GlueSEAccessProtocolPort: 2811 GlueSEAccessProtocolSupportedSecurity: GSI GlueSEAccessProtocolLocalID: rfio GlueSEAccessProtocolType: rfio GlueSEAccessProtocolEndpoint: httpg://infn-se-01.ct.trigrid.it GlueSEAccessProtocolCapability: byte access GlueSEAccessProtocolPort: 5001 GlueSEAccessProtocolSupportedSecurity: RFIO Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

LCG Information System Hierarchy Top BDII RB Site BDII A SE GRIS CE GRIS Site A Site BDII C SE GRIS CE GRIS Site C Site BDII B SE GRIS CE GRIS Site B Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006

https://grid.ct.infn.it/twiki/bin/view/ GILDA/InformationSystems Praticals https://grid.ct.infn.it/twiki/bin/view/ GILDA/InformationSystems Embrace Tutorial, Clermont-Ferrand, 9-13.10.2006