Grid Activity in China Sun Gongxing, IHEP, Beijing.

Slides:



Advertisements
Similar presentations
Grid Computing and Applications in China Kai Nan Computer Network Information Center (CNIC) Chinese Academy of Sciences (CAS) 17 Mar 2008.
Advertisements

Inetrconnection of CNGrid and European Grid Infrastructure Depei Qian Beihang University Feb. 20, 2006.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
Distributed Systems basics
1 The EU e-Infrastructure Programme EUROCRIS Conference, Brussels, 17 th July 2007 Mário Campolargo European Commission - DG INFSO Head of Unit “GÉANT.
SALSA HPC Group School of Informatics and Computing Indiana University.
Introduction to Grids and Grid applications Gergely Sipos MTA SZTAKI
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
Seminar Grid Computing ‘05 Hui Li Sep 19, Overview Brief Introduction Presentations Projects Remarks.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Sergey Belov, LIT JINR 15 September, NEC’2011, Varna, Bulgaria.
Grid Status and Perspective in China Sun Gongxing IHEP, Beijing.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
The Architecture of Transaction Processing Systems
National Institute of Advanced Industrial Science and Technology Introduction to Grid Activities in the Asia Pacific Region jointly presented by Yoshio.
Grids and Globus at BNL Presented by John Scott Leita.
Introduction to Scientific Data Grid Kai Nan Computer Network Information Center, CAS
HPC and e-Infrastructure Development in China’s High- tech R&D Program Danfeng Zhu Sino-German Joint Software Institute (JSI), Beihang University Dec.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
Wireless Grid Computing A Prototype Wireless Grid Grant Gifford Mark Hempstead April 30, 2003.
CNGI Applications in CSTNET QingHua Zhang CSTNET January 2007.
Scientific Data Grid on NGI Kai Nan Computer Network Information Center Chinese Academy of Sciences CANS 2004, Miami.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
ALICE-USA Grid-Deployment Plans (By the way, ALICE is an LHC Experiment, TOO!) Or (We Sometimes Feel Like and “AliEn” in our own Home…) Larry Pinsky—Computing.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
The ILC And the Grid Andreas Gellrich DESY LCWS2007 DESY, Hamburg, Germany
The II SAS Testbed Site Jan Astalos - Institute of Informatics Slovak Academy of Sciences.
Distributed Computing Systems CSCI 4780/6780. Distributed System A distributed system is: A collection of independent computers that appears to its users.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Tools for collaboration How to share your duck tales…
Distributed Computing Systems CSCI 4780/6780. Geographical Scalability Challenges Synchronous communication –Waiting for a reply does not scale well!!
Grid Middleware Tutorial / Grid Technologies IntroSlide 1 /14 Grid Technologies Intro Ivan Degtyarenko ivan.degtyarenko dog csc dot fi CSC – The Finnish.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
Scientific Data Grid & China-VO Kai Nan Computer Network Information Center Chinese Academy of Sciences November 27, 2003.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,
7. Grid Computing Systems and Resource Management
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Applications of the Globus Toolkit Butterfly Grid ( Applications of the Globus Toolkit Butterfly Grid (
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
CSTNET and Its Applications Computer Network Info. Center, CAS.
Networking: Applications and Services Antonia Ghiselli, INFN Stu Loken, LBNL Chairs.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
The Globus Toolkit The Globus project was started by Ian Foster and Carl Kesselman from Argonne National Labs and USC respectively. The Globus toolkit.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
Northwest Indiana Computational Grid Preston Smith Rosen Center for Advanced Computing Purdue University - West Lafayette West Lafayette Calumet.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
European and Chinese Cooperation on Grid Virtual Laboratory: Exploring e-Science in CAS CNIC,CAS Jianjun Yu
ChinaGrid: National Education and Research Infrastructure Hai Jin Huazhong University of Science and Technology
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
XtreemOS IP project is funded by the European Commission under contract IST-FP Scientific coordinator Christine Morin, INRIA Presented by Ana.
Accessing the VI-SEEM infrastructure
Sun Gongxing, IHEP, Beijing
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Clouds , Grids and Clusters
Grid Computing.
University of Technology
Distributed Systems Bina Ramamurthy 4/22/2019 B.Ramamurthy.
Presentation transcript:

Grid Activity in China Sun Gongxing, IHEP, Beijing

The Grid Projects in China Vega Grid Project ( ICT, MOST) National High Performance Computing Environment funded by 863 program (Many participants, MOST) Scientific Data Grid. (CAS, MOST) HEP data grid.(IHEP) Grid infrastructure building (MOE)

Overview of China ’ s Grid Project Build a superserver for major grid sites. Build a few of HPC centers. Develop system software for the Grid system. Develop demo applications on the Grid. Build 2Gbps interconnection among 100 university.

The Vega Project 1. Design goals: Design and implement Grid-level software. Build a national-scale infrastructure supporting HPC. Develop application running on testbed. 2. Grid-oriented superservers — Dawning 4000, 5000,etc. 3. Service Grid

Stress Distribution of 3800TEU

500hPa Contours in Weather Forecasting

The Vega Grid Topology It is Router-centered structure:

The Vega Grid Computing Protocol

The Vega OS Vega OS overview 1, A user-level middleware running on client machine Vega GOS constructed by 2 components: GOS and gnetd - GOS is a daemon running on client machine. - gnetd is a daemon on grid server response to client commands.

Grid process and Grid thread - Grid process is a unit for managing the whole resource of the Grid. - Grid thread is a unit for executing computation on the Grid.

2, Vega APIs introduction Vega GOS APIs - GOS APIs for application developers grid(): constructs a Grid process on client machine. gridcon(): grid process connects to Grid system. gridclose(): close a connected grid. ……

gnetd APIs for service developer on Grid servers - grid_register(): register a service to Grid. - grid_unregister(): unregister a service. …….

- A GOS-based application. - No central control - shell commands: > gsub > gstat > gkill, …… The Vega Grid Batch System

- All kinds of resources registered in Grid. > Computational resources: cycles, mem, disk, networks …… > software: DB, CAD …… > services: ftp, http, mail ……

Global Batch System in Vega Grid

Travel-An Online Transaction system An online transaction system----travel in China - GOS-based application - 4 different basic services registered in the Grid. * Wheather forecasting * airline ticket booking * sight spot ticket booking * charging - Putting these 4 services into an application

The National HPC Project Overview - Set up 9 HPC sites across China - Interconnected these 9 sites with available networks ( Cernet & NSTTet) - equipped each site with Dawning 2000/3000, Galaxy 3(20Gflops), Sunway 1(460Gflops), PC-cluster(8Gflops)

Overview of the Grid System Software A function layer on top of node OSs. Management of resources, users and tasks. Authentication and authorization. Hardware-enhanced encryption. Web – based user interface.

The Grid System Software

User Management

Job Management(submit)

Resource Management (Find a User)

The Grid System Monitoring

The Grid Utilities

The Grid Applications Weather forecasting. Petroleum reservoir simulation. Bio-information database and applications. Numerical wind tunnel simulation. Automobile collision simulation. Ship structure analysis. National scientific databases and applications. Digital library.

Audio Notebook HPC BP, Mobile phone Video Camera Tel. Game TV DVD PC Internet Gigabit IP Network Node DB Info lib. Instr. NHPCE

International Cooperation Joint research supported by European and China. Source sharing - Computing power - Database - Software tools - Application software

The Scientific Data Grid Project Build on the top of scientific databases. Belong to CAS, but open to the world. Plan to provide service in

Scientific Database(SDB) SDB funded by CAS since SDB is a collection of multiple disciplinary databases, including chemistry, biology, geography, astronomy, ecology, etc. By 2005, there are member institutions across China databases which is distributed and heterogeneous. - 10TB+ data volume size.

Why do SDG? Resource level — sharing and development. - make data more accessible. - data integration - and more easy to do: data->information->knowledge. Application level — emerging applications - can do what we can not do before. - cross multiple databases/multiple disciplines. - require more resources ( cycles, bandwidth, instrument, etc.)

Tasks Build testbed - one data center - and three sub data center. Middleware - information service - security - user interface Applications - Chemistry/Geo- science/astronomy/biology …

Bio Center Cluster 8 nodes 1-2TB Beijing Data Center (CNIC) Cluster 16 nodes 15TB Geo Center Cluster 8 nodes 1-2TB Beijing 1000M Chemistry Center Cluster 8 nodes 1-2TB Shanghai SDG Resources: 20 TB 4 PC Clusters CSTNET 155M 1000M

Mass Storage Database Application Server MDS Server CA Server Portal Server SDG Data Center Supercomputers at CNIC ~2 TFLOPS

Grid Middleware Application GAPI DRB UAI Local DBMS databases local data management system, could be DBMS or file system universal access interface to single data resource coordinated access to multiple data resources app-oriented, unified program interface applications GSI xMDS

Projects CAS The tenth five-year program (2001 — 2005) (37MRMB). 863 program (MOST) A special program (proposed).

Collaboration PRAGMA APGrid SDSC KISTI ASCC Texas A&M Univ.

HEP Data Grid Currently funded by IHEP, CAS. Build a BES VO in IHEP campus network environment for BES experiment. Probably Add to CMS and Atlas Vos in the future for CMS and Atlas collaborations. ARGO-YBJ VO for ARGO-YBJ experiment.

The HEP Grid Testbed Topology GIIS GRIS CondorPBS Two 6 CPUs PC-FARM

Current Main Tasks Large Scale Linux Configuration and maintenance — LCFG. Authentication/authority — GSI. Resource Information Management — MDS. Grid Resource Allocation Management — GRAM. Data Replication Management — GDMP. HEP analysis software gridifying — Appln.

The Future Work Build IHEP campus Grid computing environment sharing about ten PC-Farms. Promote collaboration with National Grid Projects and international Grid communities Make effort to propose Regional Center 2 project in China.