Presentation is loading. Please wait.

Presentation is loading. Please wait.

BQS Update Architecture Scheduling Job Types New Users Needs More users & machines, Scalability issues Needs for more sophisticated monitoring and control.

Similar presentations


Presentation on theme: "BQS Update Architecture Scheduling Job Types New Users Needs More users & machines, Scalability issues Needs for more sophisticated monitoring and control."— Presentation transcript:

1 BQS Update Architecture Scheduling Job Types New Users Needs More users & machines, Scalability issues Needs for more sophisticated monitoring and control over the system Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

2 Architecture Update Client Worker MySQL DB BQS Scheduler Worker DB Agent results spawn report submit query DB Agent Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

3 Scheduler Resources Quasi Interactive Jobs Scheduling Update Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

4 More Control for Operation and Administration: Weight of Past Resource Usage And Group Objectives Max Job Duration Small Jobs Bias Scheduler Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

5 Beyond Traditional Resources E.G. Disk, Time, Memory Logical Resources Name Max Available Restricted Flag Admin Defined Resources E.G. HPSS Logical Resources Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

6 Created & managed by Users: Decide of the Name: u_XXX Receive Privilege bqs.u_XXXadmin Set Max Available and Restricted Flag Grant/deny bqs.u_XXXusage privilege Logical U_Resource Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

7 A General Service, APIs, Commands To: Grant, Deny, Check & List Privileges Given to Users, Groups and Machines EG in BQS applid: bqs.admin, bqs.oper, bqs.spawn_forbidden Privilege Management Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

8 Parallel Jobs Arborescent Jobs GRID Jobs New Job Types Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

9 2 new submit options: proc, ptype proc: Number of WorkPoints ptype: PVM, MPICH, LAM-MPI Parallel Jobs Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

10 Parallel Jobs Client Worker MySQL DB BQS Master Worker BQS DB Agent results spawn parallel job report submit … query spawn task DB DB Agent global report Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

11 SNOVAE: many related small tasks need short global response time Schedule and spawn as one Job to reduce BQS latency Runs on a number of WorkPoints User must describe tasks dependencies Arborescent Job Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

12 Real and Generic Accounts AFS Tokens and Certificates Specific RH 7.3 + LCG Soft Full Production Farm (Currently a Specific lcg Logical Test Farm for Validation) GRID Jobs Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

13 BIO: Quasi Interactives Jobs Installation and documentation for LCG Other Projects Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04


Download ppt "BQS Update Architecture Scheduling Job Types New Users Needs More users & machines, Scalability issues Needs for more sophisticated monitoring and control."

Similar presentations


Ads by Google