1. International e-Infrastructure
Mike Mineter
Footer

2. Overview The view from the European Commission
GEANT – European network
DEISA – for when HPC is just not HP enough!
EGEE – establishing grid e-Infrastructure
WHY?!
HOW?!
With whom?
International e-Infrastructure
Footer

3. View from European Commission
Entering the “knowledge society” from the “industrial society”
Industrial society = Transportation Infrastructure
Knowledge society = Communications infrastructure
Lisbon strategy: Research and Innovation will be the most important factors in determining Europe’s success through the next decades
THE GOAL: “UNLEASH CREATIVITY”- by investment in
Human skills
Infrastructures
Demands in growth of e-infrastructure
International e-Infrastructure
Footer

4. HOW . . . . . . . operational Digital support Libraries Biomedics
e-Infrastructure - Implementation blocks
High
Energy
Physics
Digital
Libraries
Biomedics
global filing
system
security
middleware
operational
support
certification
one stop
shop
networking
specific services
joint research activities
GRID .
INFRASTRUCTURE
networking
specific services
joint research activities
GÉANT .
INFRASTRUCTURE
Technology
testbeds
User
research results
EU policies
Mário Campolargo DG INFSO F3, Pisa 24th October 2005
Footer

5. HOW Market Research IST e-Infrastructure - Strategic building blocks …
EGEE
DEISA …
+ 18 proposals international, policies,
user communities
GRID .
INFRASTRUCTURE
Research
Market
e-Infrastructure
IST
GÉANT .
INFRASTRUCTURE
GÉANT2
Mário Campolargo DG INFSO F3, Pisa 24th October 2005
Footer

6. DEISA
“integration of existing national high-end platforms, tightly coupled by a dedicated network and supported by innovative system and grid software”
Initial scientific applications include
Material Sciences
Cosmology
Plasma Physics
Life Sciences
International e-Infrastructure
Footer

7. GEANT
Interconnects 34 National Research & Education Networks-NRENs of the extended European Research Area (ERA)
Connects more than 3500 Research & Education Institutions
Serves millions of end-users + eScience Projects (e.g. Grids) under Accepted Usage Policy (AUP) rules
3-tier Federal Architecture, partially subsidized by National and EU Research & Education funds:
The Campus Network (LAN/MAN)
The NREN (MAN/WAN)
The Pan-European Interconnection
GEANT2 en route
International e-Infrastructure
Footer

8. EGEE- building grid infrastructure
To underpin collaboration
Link with and build on national, regional and international initiatives
Foster world-wide international cooperation both in the creation and the use of the e-infrastructure
Collaboration
Grid
Operations, Support and training
In Europe we use the term e-infrastructure to refer to the goal of integrating networks, grids and the operations in support of collaborations that are in the “service of society” …. not only research, but also commerce and public service. The GEANT network, the EGEE grid and a couple of VOs are shown in the figure. The e-Infrastructure includes the organisational, support and training inherent in providing services.
In Europe the GEANT initiative shows the way, in that researchers enjoy high bandwidth connections – and few even know that GEANT exists. That is the sign of a good infrastructure.
Linking with other initiatives world-wide is vital. The GGF recognises this; economy of effort, the Grid goal of collaboration, the quest for open standards all these lead to these links being vital. There is also the basic fact that so much of science is multi-national.
Grid computing exists to serve virtual organisations – these often bridge cultures, between organisations, across research disciplines as well as between nations. (Perhaps - One of the hardest to bridge may prove to be academic cultures of competition??)
International cooperation is more than an incidental benefit of European investment in research and technology: it is a goal of the EU investment. The EU has recently expanded; not that long ago an iron curtain split Europe, even more recently there were wars in former Yugoslavia: EGEE crosses many political, historical and racial borders. Building cooperation across these perceived borders is necessary for EGEE to succeed, is intrinsic to Grid computing, as well as being a consequence of its success.
GEANT achievements:
Pan-European coverage (43 countries)
Interconnecting 33+ NRENs
Linking more than 3900 Universities, i.e. virtually all the researchers in Europe in all disciplines
16 international circuits operating at 10 Gbps while 17 other run at 2,5 Gbps
Network infrastructure(GÉANT )
International e-Infrastructure
Footer

9. In the first 2 years EGEE is
Establishing production quality sustained Grid services
3000 users from at least 5 disciplines
integrate 50 sites into a common infrastructure
offer 5 Petabytes (1015) storage
Demonstrating a viable general process to bring other scientific communities on board
Proposed a second phase to take over EGEE in April 2006
Pilot
New
Production quality = reliable, secure, with comprehensive operational support
Sustainable = a research community can rely on this grid lasting longer than their research initiatives…, in the case of high energy physics that’s in the order of 20 years.
A relatively small but growing number of VOs use Grids.
The eInfrastructure goal is to support a very wide range of research; public service and ultimately commerce too.
International e-Infrastructure
Footer

10. EGEE Organisation
70 leading institutions in 27 countries, federated in regional Grids
~32 M Euros EU funding for first 2 years starting April (matching funds from partners)
Leveraging national and regional grid activities
Promoting scientific partnership outside EU
International e-Infrastructure
Footer

11. EGEE Activities
48 % service activities (Grid Operations, Support and Management, Network Resource Provision)
24 % middleware re-engineering (Quality Assurance, Security, Network Services Development)
28 % networking (Management, Dissemination and Outreach, User Training and Education, Application Identification and Support, Policy and International Cooperation)
Emphasis in EGEE is on operating a production
grid and supporting the end-users
International e-Infrastructure
Footer

12. gLite: Guiding Principles
Service oriented approach
Allow for multiple interoperable implementations
Lightweight (existing) services
Easily and quickly deployable
Use existing services where possible
Condor, EDG, Globus, LCG, …
Portable
Being built on Scientific Linux and Windows
Security
Sites and Applications
Performance/Scalability & Resilience/Fault Tolerance
Comparable to deployed infrastructure
EDG
VDT
. . .
LCG
AliEn
Co-existence with deployed infrastructure
Co-existence with LCG-2 and OSG (US) are essential for the EGEE Grid services
Site autonomy
Reduce dependence on ‘global, central’ services
Open source license
International e-Infrastructure
Footer

13. EGEE Middleware
Intended to replace present middleware with production quality services
Developed from existing components
Aims to address present shortcomings and advanced needs from applications
Prototyping short development cycles for fast user feedback
Initial web-services based prototypes being tested
LCG-1
LCG-2
gLite-1
gLite-2
Globus 2 based
Web services based
Application requirements
International e-Infrastructure
Footer

14. LCG and EGEE LCG : Large Hadron Collider Compute Grid
EGEE committed to “hit the ground running”
EGEE profits from the resources - no funded computing/data resources in EGEE
Provided by the VOs
LCG obtains additional production and operation efforts
LCG experiments now comprise several of the many VOs in EGEE
Current service (“LCG-2”) based on work done in LCG
Middleware components to be upgraded by “gLite” services as they are proven
“gLite 3” will be forged from LCG gLite services
LCG : Large Hadron Collider Compute Grid
International e-Infrastructure
Footer

15. Grid Operations CIC The grid is flat, but Hierarchy of responsibility
ROC
OMC
The grid is flat, but
Hierarchy of responsibility
Essential to scale the operation
CICs act as a single Operations Centre
Operational oversight (grid operator) responsibility
rotates weekly between CICs
Report problems to ROC/RC
ROC is responsible for ensuring problem is resolved
ROC oversees regional RCs
ROCs responsible for organising the operations in a region
Coordinate deployment of middleware, etc
CERN coordinates sites not associated with a ROC
RC = Resource Centre
ROC = Regional Operations Centre
CIC = Core Infrastructure Centre
OMC = Operations Management Centre
International e-Infrastructure
Footer

16. The GGUS Portal Global Grid User Support - first contact for users
You need to register
in order to be able
To use this portal
(GSI or password based)
You can register
as User or as
Supporter.
Supporter ?
If you think you
have a good
knowledge in Grid
and have time
to provide support,
please contact
your ROC or directly
ESC at:
International e-Infrastructure
Footer

17. EGEE pilot applications
High-Energy Physics (HEP)
Provides computing infrastructure (LCG)
Challenging:
thousands of processors world-wide
generating petabytes of data
‘chaotic’ use of grid with individual user analysis (thousands of users interactively operating within experiment VOs)
Biomedical Applications
Similar computing and data storage requirements
Major additional challenge:
security & privacy
Chemistry, Earth Observation,
Astronomy, Geophysics, ...
EGEE tutorial, Seoul
Footer

18. EGEE is running… … the largest multi-VO production grid in the world!
What’s happening now?
What resources are connected?
International e-Infrastructure
Footer

19. GILDA demonstrator and testbed (https://gilda.ct.infn.it)
Marc-Elian Bégin - Demos - 1st EU review
Footer

20. Policy and International Cooperation
To foster cooperation between EGEE and other Grid activities around the world
Globus Alliance, Condor
Training/workshop events (International Grid Summer School, Italy, July)
To participate in an eInfrastructure reflection group in Europe
To play a leading role in standard setting through attendance at global standard bodies such as the Global Grid Forum.
Grid Storage Management GGF working group -
Security, Authentication: US – EU cooperation
Mutual recognition of CA’s
Requires collaboration to establish policy - and mutuality
International e-Infrastructure
Footer

21. Related Projects Change Existing Project to Active Projects
Change In Negotiation to New Projects
Change Submitted to September 2005 Proposals
SSA: Specific support actions complement the implementation of the Framework Programme and may be used to help in preparations for future Community research and technological
development policy activities including monitoring and assessment activities. In particular, they involve conferences, seminars, studies and analyses, high level scientific awards and
competitions, working groups and expert groups, operational support and dissemination, information and communication activities, or a combination of these, as appropriate in each
case. Specific support actions are also implemented to stimulate, encourage and facilitate the participation of SMEs, small research teams, newly developed and remote research
centres, as well as those organisations from the candidate countries in the activities of the Communication Network Development scheme. The implementation of these actions rely on
the specific information and assistance structures, including the network of national contact points, established by the Member States and the associated countries at local, regional and national level and aim at ensuring a smooth transition from the Fifth to the Sixth Framework Programme.
International e-Infrastructure
Footer

22. Market Research IST Summary … DEISA EGEE GÉANT2
+ 18 proposals international, policies,
user communities
GRID .
INFRASTRUCTURE
Research
Market
e-Infrastructure
IST
GÉANT .
INFRASTRUCTURE
GÉANT2
Mário Campolargo DG INFSO F3, Pisa 24th October 2005
International e-Infrastructure
Footer

23. Further information EGEE Website How to join EGEE Project Office
How to join
EGEE Project Office
Global Grid Forum
Globus Alliance
Condor
VDT
Open Science Grid
Grid Center
LCG
International e-Infrastructure
Footer