Presentation is loading. Please wait.

Presentation is loading. Please wait.

LGI Leiden Grid Infrastructure Dr. M. F. Somers Theoretical Chemistry Leiden Institute of Chemistry University of Leiden

Published byMaximillian Booth Modified over 7 years ago

Similar presentations

Presentation on theme: "LGI Leiden Grid Infrastructure Dr. M. F. Somers Theoretical Chemistry Leiden Institute of Chemistry University of Leiden"— Presentation transcript:

1 LGI Leiden Grid Infrastructure Dr. M. F. Somers Theoretical Chemistry Leiden Institute of Chemistry University of Leiden m.somers@chem.leidenuniv.nl http://fwnc7003.leidenuniv.nl/LGI July 2010.

2 Outline Why LGI? Design of LGI. Current setup & example session. Scalability & performance. LGI as pilot job framework. Possible storage applications.

3 Why LGI? - Bundle clusters, supercomputers, grids, BOINC project & workstations behind firewalls, routers & outside our administrative domain. - Only few (high-performance) applications hard to install (some licensed, binary only or very system specific). - Easy to setup, administrate, manage & scale. - Easy interface for users.

4 Design of LGI

5 - Use x509 certificates for XML over https & LAMP stack as project server. NO PROXY's! - Project is nothing more than a database & single server can run multiple projects. - User management on project server & on resources: a global LGI user namespace per project & in x509 certs. - Scheduling & QoS possible on project server. Currently FIFO & FCFS & heartbeat. - Three general interfaces: web, CLI & Python. Other specific interfaces use API.

6 Design of LGI - Each job in DB has 'input' & 'output' blobs with application specific content. - Each job has repository (URL on a server) to upload & download big files. - Each job has application specific XML field 'JobSpecifics' for references to repository & possible restart data in other repositories. - Each job can be scheduled / submitted to specific / 'any' resource that reported back support for application.

7 Design of LGI - Daemon in C++ with libcURL & STL runs as non- root. If run as root: automatic sand boxing. - Daemon caches on disk & several daemons can run concurrently on resource. - Daemon monitors project server for jobs & 'abort' signals / rescheduling of jobs due to lost heartbeats / errors. Reports capabilities. - Implement applications through back-end scripts: Torque/PBS, LoadLeveler, BOINC, gLite, forking, SGE...

8 Example daemon config /home/mark/LGI/certificates/LGI+CA.crt /home/mark/LGI/certificates/mark@fwnc7003.crt /home/mark/LGI/certificates/mark@fwnc7003.key /home/mark/LGI/daemon/runhere 20 1 LGI https://fwnc7003.leidenuniv.nl/LGI 10 1 hello_world 2 4 4096 /proc/cpuinfo /home/mark/LGI/daemon/hello_world_scripts/check_system_limits_script /home/mark/LGI/daemon/hello_world_scripts/job_check_limits_script /home/mark/LGI/daemon/hello_world_scripts/job_check_running_script /home/mark/LGI/daemon/hello_world_scripts/job_check_finished_script /home/mark/LGI/daemon/hello_world_scripts/job_prologue_script /home/mark/LGI/daemon/hello_world_scripts/job_run_script /home/mark/LGI/daemon/hello_world_scripts/job_epilogue_script /home/mark/LGI/daemon/hello_world_scripts/job_abort_script

9 Current setup in Leiden - Applications: SA-DVR, SPO-DVR, CPMD, Gaussian, MolPro, ADF, VASP, nonmem, Classical & hello_world. - Resources: Huygens, Lisa, Boeddha, Nocona, Woodcrest, Harpertown, Nehalem, Gainestown, DAS3, gLite/globus through gridui & gliteui & our own BOINC-project.

10 Example session Demonstration of CLI & WEB interface: …students run Gaussian on grid within minutes...

11 Performance 2 CPU 3.0 GHz Xeon EM64T Nocona with HT, 4 GB DDRII 400MHz RAM, 74 GB 10k rpm HD, 100Mb Ethernet on SL 4.3: 100k jobs in database, 100 concurrent resources using '-ft 5' & 4 KB RSA keys. load of 30 (84% user, 15% system), MySQL 15% to 50% CPU with 300 MB RAM & 2.6 GB virtual, DB 250 MB on disk, no swapping, 1s, no queries >5s.

12 Possible Should be possible to have >1M jobs & ~10k resources on ~3k euro hardware in a single server setup under normal conditions. Have not tested this... yet !

13 Scalability Several project servers as slaves with each a separate MySQL & storage back-end. or Load balance a single 'project server' with firewall / DNS round robin to several Apache+PHP servers, run MySQL cluster across servers & use GlusterFS to scale storage for repository.

14 LGI as pilot job framework - Use a resource daemon as pilot job manager to schedule pilot jobs on grid. - Each pilot job on grid is a resource daemon with application binaries & configuration polling a project server. - If no work for some time pilot jobs stop automatically but some pilot jobs are kept alive for fast response on grid. - Under development by Willem v. Engen & JanJust Keijser at NIKHEF. - Testing & reporting fase.

15 Possible storage applications 1) Resource accepts 'file_storage' job. 2) Resource stores data from repository or other URL part of input any way it likes. 3) Resource creates link / reference to new storage location. Reference could be web interface using x509 & https. 4) Resource finished job with reference as job output. 5) Resource prunes storage / keeps track of storage job by checking job repository existence.

16 Support LGI is supported by NWO/NCF & NIKHEF... Thanks... http://fwnc7003.leidenuniv.nl/LGI

Download ppt "LGI Leiden Grid Infrastructure Dr. M. F. Somers Theoretical Chemistry Leiden Institute of Chemistry University of Leiden"

Similar presentations

1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.

1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.

Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.
Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.

Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance

DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
Nikolay Tomitov Technical Trainer SoftAcad.bg.  What are Amazon Web services (AWS) ?  What’s cool when developing with AWS ?  Architecture of AWS 

Nikolay Tomitov Technical Trainer SoftAcad.bg.  What are Amazon Web services (AWS) ?  What’s cool when developing with AWS ?  Architecture of AWS 
Introduction to DoC Private Cloud

Introduction to DoC Private Cloud
1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu 2010-8-27.

1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu
Understanding and Managing WebSphere V5

Understanding and Managing WebSphere V5
Google AppEngine. Google App Engine enables you to build and host web apps on the same systems that power Google applications. App Engine offers fast.

Google AppEngine. Google App Engine enables you to build and host web apps on the same systems that power Google applications. App Engine offers fast.
SEEM4570: XAMPP, Eclipse, Summary of Html Kangfei Zhao Room 711,ERB

SEEM4570: XAMPP, Eclipse, Summary of Html Kangfei Zhao Room 711,ERB
22-Aug-15 | 1 |1 | Help! I need more servers! What do I do? Scaling a PHP application.

22-Aug-15 | 1 |1 | Help! I need more servers! What do I do? Scaling a PHP application.
Barracuda Load Balancer Server Availability and Scalability.

Barracuda Load Balancer Server Availability and Scalability.
Report ： Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.

Report ： Zhen Ming Wu 2008 IEEE 9th Grid Computing Conference.
GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/2006 - 29/09/2006.

GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/ /09/2006.
Sakai/OSP Portfolio UvA Bas Toeter Universiteit van Amsterdam

Sakai/OSP Portfolio UvA Bas Toeter Universiteit van Amsterdam
1 Overview of the Application Hosting Environment Stefan Zasada University College London.

1 Overview of the Application Hosting Environment Stefan Zasada University College London.
Designing and Deploying a Scalable EPM Solution Ken Toole Platform Test Manager MS Project Microsoft.

Designing and Deploying a Scalable EPM Solution Ken Toole Platform Test Manager MS Project Microsoft.
1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.

1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.

The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
June 6, 2007TeraGrid '071 Clustering the Reliable File Transfer Service Jim Basney and Patrick Duda NCSA, University of Illinois This material is based.

June 6, 2007TeraGrid '071 Clustering the Reliable File Transfer Service Jim Basney and Patrick Duda NCSA, University of Illinois This material is based.

Similar presentations

Ads by Google