Presentation is loading. Please wait.

Presentation is loading. Please wait.

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1.

Published byLetitia Richard Modified over 8 years ago

Similar presentations

Presentation on theme: "July-2008Fabrizio Furano - The Scalla suite and the Xrootd1."— Presentation transcript:

1

2 July-2008Fabrizio Furano - The Scalla suite and the Xrootd1

3 July-2008Fabrizio Furano - The Scalla suite and the Xrootd2

4 July-2008Fabrizio Furano - The Scalla suite and the Xrootd lfn2pfn prefix encoding Storage System (oss, drm/srm, etc) authentication (gsi, krb5, etc) Clustering (cmsd) authorization (name based) File System (ofs, sfs, alice, etc) Protocol (1 of n) (xrootd) Protocol Driver (XRD) 3

5 July-2008Fabrizio Furano - The Scalla suite and the Xrootd4

6 July-2008Fabrizio Furano - The Scalla suite and the Xrootd5

7 July-2008Fabrizio Furano - The Scalla suite and the Xrootd6 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can hold Up to 64 servers P2P-like

8 July-2008Fabrizio Furano - The Scalla suite and the Xrootd7 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Simple cluster Up to 64 data servers 1-2 mgr redirectors Simple cluster Up to 64 data servers 1-2 mgr redirectors cmsd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Advanced cluster Up to 4096 (2 lvls) or 262K (3 lvls) data servers Advanced cluster Up to 4096 (2 lvls) or 262K (3 lvls) data servers Everything can have hot spares

9 July-2008Fabrizio Furano - The Scalla suite and the Xrootd8

10 July-2008Fabrizio Furano - The Scalla suite and the Xrootd9

11 July-2008Fabrizio Furano - The Scalla suite and the Xrootd10 Courtesy of Gerardo Ganis (CERN PH-SFT)

12 July-2008Fabrizio Furano - The Scalla suite and the Xrootd11

13 July-2008Fabrizio Furano - The Scalla suite and the Xrootd12

14 July-2008Fabrizio Furano - The Scalla suite and the Xrootd13 Pre-xfer data “locally” Pre-xfer data “locally” Remote access Remote access Remote access+ Remote access+ Data Processing Data access Interesting! Efficient practical Interesting! Efficient practical

15 July-2008Fabrizio Furano - The Scalla suite and the Xrootd14 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007

16 July-2008Fabrizio Furano - The Scalla suite and the Xrootd15 *Federico Carminati, The ALICE Computing Status and Readiness, LHCC, November 2007

17 July-2008Fabrizio Furano - The Scalla suite and the Xrootd16

18 July-2008Fabrizio Furano - The Scalla suite and the Xrootd17

19 July-2008Fabrizio Furano - The Scalla suite and the Xrootd18 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector (alirdr) all.role meta manager all.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/Includes CERN, GSI, and others xroot clusters Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing Meta Managers can be geographically replicated Can have several in different places for region- aware load balancing cmsd xrootd GSI all.manager meta alirdr.cern.ch:1312 all.role manager

20 July-2008Fabrizio Furano - The Scalla suite and the Xrootd19

21 cmsd xrootd GSI July-2008Fabrizio Furano - The Scalla suite and the Xrootd20 cmsd xrootd Prague NIHAM … any other cmsd xrootd CERN cmsd xrootd ALICE global redirector all.role meta manager all.manager meta alirdr.cern.ch:1312 all.role manager But missing a file? Ask to the global metamgr Get it from any other collaborating cluster all.manager meta alirdr.cern.ch:1312 Local clients work normally

22 July-2008Fabrizio Furano - The Scalla suite and the Xrootd21

23 July-2008Fabrizio Furano - The Scalla suite and the Xrootd22

24 July-2008Fabrizio Furano - The Scalla suite and the Xrootd23

25 July-2008Fabrizio Furano - The Scalla suite and the Xrootd24

26 July-2008Fabrizio Furano - The Scalla suite and the Xrootd25 Redirector xrootd:1094 Name Space xrootd:2094RedirectorHost ClientHost opendir create mkdir mv rm rmdir xrootd POSIX Client Kernel User Space Appl POSIX File System Interface FUSE FUSE/Xroot Interface Should run cnsd on servers to capture non-FUSE events And keep the FS namespace!

27 July-2008Fabrizio Furano - The Scalla suite and the Xrootd26

28 July-2008Fabrizio Furano - The Scalla suite and the Xrootd27

29 July-2008Fabrizio Furano - The Scalla suite and the Xrootd28

30 July-2008Fabrizio Furano - The Scalla suite and the Xrootd Client Redirector (Head Node) Data Servers open file X A B C go to C open file X Who has file X? I have Cluster Client sees all servers as xrootd data servers 2 nd open X go to C Redirectors Cache file location 29

Download ppt "July-2008Fabrizio Furano - The Scalla suite and the Xrootd1."

Similar presentations

Potential Data Access Architectures using xrootd OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC

Potential Data Access Architectures using xrootd OSG All Hands Meeting Harvard University March 7-11, 2011 Andrew Hanushevsky, SLAC
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.
GSIAF CAF experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.

GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.
Distributed File Systems Chapter 11

Distributed File Systems Chapter 11
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved. 0-13-239227-5 DISTRIBUTED SYSTEMS.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP 2009 - Prague.

1 Status of the ALICE CERN Analysis Facility Marco MEONI – CERN/ALICE Jan Fiete GROSSE-OETRINGHAUS - CERN /ALICE CHEP Prague.
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.

PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t XROOTD news Status and strategic directions ALICE-GridKa operations meeting 03 July 2009.

CERN IT Department CH-1211 Genève 23 Switzerland t XROOTD news Status and strategic directions ALICE-GridKa operations meeting 03 July 2009.
Scalla Back Through The Future Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 8-April-10

Scalla Back Through The Future Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 8-April-10
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong

1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Scalla/xrootd Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 29-October-09 ATLAS Tier 3 Meeting at ANL

Scalla/xrootd Andrew Hanushevsky SLAC National Accelerator Laboratory Stanford University 29-October-09 ATLAS Tier 3 Meeting at ANL
Scalable Web Server on Heterogeneous Cluster CHEN Ge.

Scalable Web Server on Heterogeneous Cluster CHEN Ge.
Xrootd, XrootdFS and BeStMan Wei Yang 2009-10-30 US ATALS Tier 3 meeting, ANL 1.

Xrootd, XrootdFS and BeStMan Wei Yang US ATALS Tier 3 meeting, ANL 1.
Scalla/xrootd Introduction Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 6-April-09 ATLAS Western Tier 2 User’s Forum.

Scalla/xrootd Introduction Andrew Hanushevsky, SLAC SLAC National Accelerator Laboratory Stanford University 6-April-09 ATLAS Western Tier 2 User’s Forum.
July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can.

July-2008Fabrizio Furano - The Scalla suite and the Xrootd1 cmsd xrootd cmsd xrootd cmsd xrootd cmsd xrootd Client Client A small 2-level cluster. Can.
11-July-2008Fabrizio Furano - Data access and Storage: new directions1.

11-July-2008Fabrizio Furano - Data access and Storage: new directions1.
D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.

D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.
FAX Redirection Topology Wei Yang 7/16/121. Redirector hardware at CERN Redundant redirectors for EU, UK, DE, FR – Redundant (the “+” sign below) VMs.

FAX Redirection Topology Wei Yang 7/16/121. Redirector hardware at CERN Redundant redirectors for EU, UK, DE, FR – Redundant (the “+” sign below) VMs.
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Xrootd setup An introduction/tutorial for ALICE sysadmins.

CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd setup An introduction/tutorial for ALICE sysadmins.
 CASTORFS web page - https://lbtwiki.cern.ch/bin/view/Online/CastorFS CASTOR web site - FUSE web site -

 CASTORFS web page - CASTOR web site - FUSE web site -

Similar presentations

Ads by Google