Prospects for the use of remote real time computing over long distances in the ATLAS Trigger/DAQ system R. W. Dobinson (CERN), J. Hansen (NBI), K. Korcyl.

Slides:



Advertisements
Similar presentations
The International Grid Testbed: a 10 Gigabit Ethernet success story in memoriam Bob Dobinson GNEW 2004, Geneva Catalin Meirosu on behalf of the IGT collaboration.
Advertisements

BTT 101 / 2O1 Lesson 10 Dundas Valley Secondary Mr. Young.
Copyright© 2000 OPNET Technologies, Inc. R.W. Dobinson, S. Haas, K. Korcyl, M.J. LeVine, J. Lokier, B. Martin, C. Meirosu, F. Saka, K. Vella Testing and.
1 K. Salah Module 2.1: QA – Putting it all together What is the max number of users/connections/sessions a particular network can support for handling.
Slide: 1 Richard Hughes-Jones T2UK, October 06 R. Hughes-Jones Manchester 1 Update on Remote Real-Time Computing Farms For ATLAS Trigger DAQ. Richard Hughes-Jones.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
I/O Channels I/O devices getting more sophisticated e.g. 3D graphics cards CPU instructs I/O controller to do transfer I/O controller does entire transfer.
1 Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall.
11 Networks The Great Information Exchange. 2 Networking Fundamentals Computer network: Two or more computers connected together Each is a Node Benefits.
Review on Networking Technologies Linda Wu (CMPT )
Introduction to Computer Networking. Wireless Network.
Storage area network and System area network (SAN)
1 Wide Area Network. 2 What is a WAN? A wide area network (WAN ) is a data communications network that covers a relatively broad geographic area and that.
Questionaire answers D. Petravick P. Demar FNAL. 7/14/05 DLP -- GDB2 FNAL/T1 issues In interpreting the T0/T1 document how do the T1s foresee to connect.
Virtual Organization Approach for Running HEP Applications in Grid Environment Łukasz Skitał 1, Łukasz Dutka 1, Renata Słota 2, Krzysztof Korcyl 3, Maciej.
K. Honscheid RT-2003 The BTeV Data Acquisition System RT-2003 May 22, 2002 Klaus Honscheid, OSU  The BTeV Challenge  The Project  Readout and Controls.
Lecture 2 TCP/IP Protocol Suite Reference: TCP/IP Protocol Suite, 4 th Edition (chapter 2) 1.
Worldwide event filter processing for calibration Calorimeter Calibration Workshop Sander Klous September 2006.
CSCI-235 Micro-Computer in Science The Network. © Prentice-Hall, Inc Communications  Communication is the process of sending and receiving messages 
Networking Basics Lesson 1 Introduction to Networks.
Module 2: Information Technology Infrastructure
Networking LAN (Local Area Network)  A network is a collection of computers that communicate with each other through a shared network medium.  LANs.
Communication Networks Fourth Meeting. Types of Networks  What is a circuit network?  Two people are connected and allocated them their own physical.
Copyright © 2000 OPNET Technologies, Inc. Title – 1 Distributed Trigger System for the LHC experiments Krzysztof Korcyl ATLAS experiment laboratory H.
Network-on-Chip Energy-Efficient Design Techniques for Interconnects Suhail Basit.
Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.
1 CHAPTER 8 TELECOMMUNICATIONSANDNETWORKS. 2 TELECOMMUNICATIONS Telecommunications: Communication of all types of information, including digital data,
Srihari Makineni & Ravi Iyer Communications Technology Lab
1 Network Emulation Mihai Ivanovici Dr. Razvan Beuran Dr. Neil Davies.
Network Performance for ATLAS Real-Time Remote Computing Farm Study Alberta, CERN Cracow, Manchester, NBI MOTIVATION Several experiments, including ATLAS.
Online-Offsite Connectivity Experiments Catalin Meirosu *, Richard Hughes-Jones ** * CERN and Politehnica University of Bucuresti ** University of Manchester.
Network to and at CERN Getting ready for LHC networking Jean-Michel Jouanigot and Paolo Moroni CERN/IT/CS.
Summary - Part 2 - Objectives The purpose of this basic IP technology training is to explain video over IP network. This training describes how video can.
TCP Offload Through Connection Handoff Hyong-youb Kim and Scott Rixner Rice University April 20, 2006.
Geneva – Kraków network measurements for the ATLAS Real-Time Remote Computing Farm Studies R. Hughes-Jones (Univ. of Manchester), K. Korcyl (IFJ-PAN),
HUBS & SWITCHES: WHAT FOR ART THOU? By Wayne Sheppard ETEC 562.
2003 Conference for Computing in High Energy and Nuclear Physics La Jolla, California Giovanna Lehmann - CERN EP/ATD The DataFlow of the ATLAS Trigger.
LHCb DAQ system LHCb SFC review Nov. 26 th 2004 Niko Neufeld, CERN.
Kraków4FutureDaQ Institute of Physics & Nowoczesna Elektronika P.Salabura,A.Misiak,S.Kistryn,R.Tębacz,K.Korcyl & M.Kajetanowicz Discrete event simulations.
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester 1 ATLAS TDAQ Networking, Remote Compute Farms & Evaluating SFOs Richard Hughes-Jones The.
CSCI-235 Micro-Computer Applications The Network.
Interconnect Networks Basics. Generic parallel/distributed system architecture On-chip interconnects (manycore processor) Off-chip interconnects (clusters.
Interactive European Grid Environment for HEP Application with Real Time Requirements Lukasz Dutka 1, Krzysztof Korcyl 2, Krzysztof Zielinski 1,3, Jacek.
Networking update and plans (see also chapter 10 of TP) Bob Dobinson, CERN, June 2000.
GridPP Meeting Jan 2003 R. Hughes-Jones Manchester ATLAS Trigger/DAQ Real-time use of the Grid Network Richard Hughes-Jones The University of Manchester.
MC Production in Canada Pierre Savard University of Toronto and TRIUMF IFC Meeting October 2003.
TCP Traffic Characteristics—Deep buffer Switch
Lecture 11 B-ISDN. Broadband ISDN In 1988, CCITT issued the first two recommendations relating to the broadband ISDN called B-ISDN. This system is defined.
CODA Graham Heyes Computer Center Director Data Acquisition Support group leader.
Data Communication Networks Lec 13 and 14. Network Core- Packet Switching.
1 Network related topics Bartosz Belter, Wojbor Bogacki, Marcin Garstka, Maciej Głowiak, Radosław Krzywania, Roman Łapacz FABRIC meeting Poznań, 25 September.
CHAPTER 8 Communication and Network Copyright © Cengage Learning. All rights reserved.
1 The Latency/Bandwidth Tradeoff in Gigabit Networks UBI 527 Data Communications Ozan TEKDUR , Fall.
The Evaluation Tool for the LHCb Event Builder Network Upgrade Guoming Liu, Niko Neufeld CERN, Switzerland 18 th Real-Time Conference June 13, 2012.
Computer Networks CSC September 23,
UNM SCIENCE DMZ Sean Taylor Senior Network Engineer.
High Speed Interconnect Project May08-06
High Speed Interconnect Project May08-06
Architecture and Algorithms for an IEEE 802
RT2003, Montreal Niko Neufeld, CERN-EP & Univ. de Lausanne
Wide Area Network.
VIRTUAL SERVERS Presented By: Ravi Joshi IV Year (IT)
Introduction to Networks
The LHCb Event Building Strategy
Storage Networking Protocols
Event Building With Smart NICs
LHCb Trigger, Online and related Electronics
GCSE ICT Setting up a Network.
GCSE ICT Setting up a Network.
Presentation transcript:

Prospects for the use of remote real time computing over long distances in the ATLAS Trigger/DAQ system R. W. Dobinson (CERN), J. Hansen (NBI), K. Korcyl (INP), J.Pinfold (UofA), M. Turala (INP) MOTIVATION ATLAS Trigger/DAQ system uses a three-level architecture to reduce an initial rate of 10 9 particle interactions per second down to 100 Hz of events of size 2 MB – the throughput acceptable for mass storage. At the final, the third level (Event Filter) a massive processing power of O (2000) CPUs is required to analyze data and achieve the required reduction factor. A large processing farm will be built at CERN, where the experiment will take place. However, there are number of advantages in situating some of this capacity in the member states: it is easier to fund computing equipment at home, as opposed to CERN it is easier to involve existing staff, in particular IT professionals computing equipment can be shared with other users To use remote, home based, computing capacity efficiently will require very high performance networking at an affordable price. For example, if half the ATLAS event farms were situated off the CERN site, then several 10s of Gigabits per second of long haul traffic would be needed to flow to remote farms. EQUIPMENT We have developed and used custom measuring equipment to determine the quality of service for connections between CERN and locations in Europe and Canada. The equipment is based on an Alteon Gigabit Ethernet (GE) network interface card (NIC) reprogrammed to act as an IP traffic generator, a custom clock card and commercial Global Positioning System equipment. We can measure one-way latency, loss and reordering on a packet-by-packet basis, as a function of load, up to Gigabit Ethernet speed. CONCLUSIONS We have shown that long distance error-free Gbps connections can be established now over packet switching networks or dedicated light-paths. Data transfers rates using the TCP/IP protocol have been achieved up to 800 Mbps (further optimizations are possible including the use of alternative TCP/IP protocol stacks). We plan to use the present trans-Atlantic connection to support ATLAS test-beam activities. We plan to test a 10 GE connection later this year. CRACOW EDMONTON (CANADA) CERN GEANT + Polish National RESULTS – summary: We have measured packet latency, loss and reordering as a function of throughput up to GE line speed between CERN and NBI and between CERN and the University of Alberta. The connections are error-free up to line speed with a small percentage of out-of-order packets for the highest loads We have achieved 800 Mbps streaming rate with the TCP/IP by tuning protocol parameters. The hardware setup (number of PC CPUs, their speed and type of NIC card) was not optimal. This, together with an extra processing needed for handling the out-of-oder packets, limited the throughput from approaching more closely to line speed. The connection to Cracow was limited to 100 Mbps with an allocated channel. The line was not error-free (we measured a few percent of packet loss for all loads). The achieved throughput for streaming with TCP/IP was only 25% of the allocated bandwidth showing the sensivity of the TCP/IP to packet loss. Dedicated ligth-path COPENHAGEN ROB L2PU SFI PF Local Event Processing Farms PF Remote Event Processing Farms Dedicated light paths 10 GE Packet switched WAN (GEANT) Front End Network Back End Network ATLAS Detectors ATLAS TRIGGER/DAQ SYSTEM GEANT + Danish National