Presentation is loading. Please wait.

Presentation is loading. Please wait.

CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 New Experiences with the ALICE High Level Trigger Data Transport.

Published by Modified over 8 years ago

Similar presentations

Presentation on theme: "CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 New Experiences with the ALICE High Level Trigger Data Transport."— Presentation transcript:

1 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 New Experiences with the ALICE High Level Trigger Data Transport Framework Timm M. Steinbeck Computer Science/Computer Engineering Kirchhoff Institute of Physics Ruprecht-Karls-University Heidelberg, Germany

2 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Outline – Overview ALICE / High Level Trigger (HLT) – Overview Framework / Components – Benchmarks & Tests ● Framework Interface Benchmark ● HLT Data Challenge ● TPC Beamtest Experience – Summary & Conclusion

3 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Overview - ALICE ALICE High Level Trigger – ALICE: A Large Ion Collider Experiment – Heavy-Ion Mode: ● Up to 15000 particles in event ● Max. event size >70 MB ● Max. input rate from TPC: 200 Hz ● Input data stream:  25 GB/s ● Output data stream:  1.2GB/s – Proton-Proton Mode: ● Max. input rate from TPC: 1kHz ● Event size  3 MB See also Talk by M. Richter

4 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Overview - HLT ALICE High Level Trigger – Processing in several steps from raw detector data to full event reconstruction – Large PC cluster ● Initially  400-500 nodes ● Arranged in hierarchy levels (HL) that match detector layout and analysis steps – Exact processing sequence and hierarchy not known – Flexible and efficient software needed to transport data through cluster – Framework consisting of independant, communicating components

5 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Outline – Overview ALICE / High Level Trigger (HLT) – Overview Framework / Components – Benchmarks & Tests ● Framework Interface Benchmark ● HLT Data Challenge ● TPC Beamtest Experience – Summary & Conclusion

6 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Overview of the Framework – Framework consisting of independant components – Communicating via publisher-subscriber interface ● Data driven architecture ● Components receive data from other components ● Process received data ● Forward own output data to next component – Named pipes used to exchange small messages and descriptors – Data is exchanged via shared memory Major design criteria ● Efficiency: CPU Cycles used for analysis ● Flexibility: Different configurations needed ● Fault-Tolerance: PCs are unreliable Subscriber Processing Publisher Subscriber Processing Publisher Shared Memory Data Named Pipe

7 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Application Components Templates for application specific components Data Source Addressing & Handling Buffer Management Data Announcing Data Analysis & Processing Output Buffer Mgt. Output Data Announcing Accepting Input Data Input Data Addressing Data Sink Addressing & Writing Accepting Input Data Input Data Addressing ● Read data from source and publish it (Data Source Template) ● Accept data, process it, publish results (Analysis Template) ● Accept data and process it, e.g. storing (Data Sink Template)

8 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Framework contains components to shape the flow of data in a cluster All components use publisher-subscriber interface Data Flow Components Subscriber Publisher 1.2; 2.2;... 1; 2;... Subscriber 1.1; 2.1;... Subscriber 1.3; 2.3;... Subscriber Publisher 1; 2;... Subscriber Publisher Subscriber 1; 2;... Publisher Subscriber Communication Node A Node B Network Merge parts of events Transparently connect components on different nodes (bridges) Split and rejoin a data stream (e.g. for load-balancing) (scatter/gather)

9 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Outline – Overview ALICE / High Level Trigger (HLT) – Overview Framework / Components – Benchmarks & Tests ● Framework Interface Benchmark ● HLT Data Challenge ● TPC Beamtest Experience – Summary & Conclusion

10 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Interface Benchmarks Benchmark of only Publisher-Subscriber Interface No shared memory access or anything else Benchmarks sensitive to L1 cache size (P4 family only 8 kB) Maximum rate achieved: >110 kHz (Dual Opteron) Time overhead f. event round-trip: < 18  s

11 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Outline – Overview ALICE / High Level Trigger (HLT) – Overview Framework / Components – Benchmarks & Tests ● Framework Interface Benchmark ● HLT Data Challenge ● TPC Beamtest Experience – Summary & Conclusion

12 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 HLT Data Challenge Long time test of framework running on 7 nodes 800 MHz Dual Pentium 3 nodes No real analysis done, dummy data and dummy processing components used All dataflow components utilised Simulated reduced TPC sector setup (only 4 "readouts" instead of 6, 2 trackers, and 1 global merger) 13 dummy processing components active Setup running for one month More than 2*10 9 events Achieved rate: > 780 Hz CF 0 AU 0 CF 1 AU 1 CF 2 AU 2 CF 3 AU 3 ST GM Patch 0Patch 1Patch 2Patch 3 ADC Unpacker Clusterfinder 4*SectorTracker Global Merger

13 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 HLT Data Challenge Event Rate on final merger node measured during runtime of HLT data challenge

14 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Outline – Overview ALICE / High Level Trigger (HLT) – Overview Framework / Components – Benchmarks & Tests ● Framework Interface Benchmark ● HLT Data Challenge ● TPC Beamtest Experience – Summary & Conclusion

15 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 TPC Sector Beamtest HLT being used during beamtest of TPC sector prototype Main goals: ● Test interfaces between DAQ and HLT ● Obtain some real world operation experience for HLT PCI Card DAQ PC 1 PCI Card DAQ PC 2 Fast Ethernet DAQ PC 3 3x 250 GB disk 10 MB/s Optical Link Optical Link Optical Link HLT (3 PCs) Detector Prototype Optical Link Mass Storage 1 MB/s

16 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 HLT PC 1 Optical Link (from DAQ) PCI Card HLT PC 2 PCI Card HLT PC 3 PCI Card Switch Gigabit Ethernet TPC Sector Beamtest 3 Node Mini HLT Cluster used 933 MHz Dual Pentium 3 PCs Optical Link (from DAQ) Optical Link (to DAQ)

17 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 TPC Sector Beamtest Optical Link Switched off due to technical issues w. optical link HLT Software Setup ● EventRateSubscriber used to measure event rate ● StorageWriter used to save data locally on disc HLT PC 1 RORC Publisher Subscriber BridgeHead HLT PC 3 Publisher BridgeHead Publisher BridgeHead Event Merger Storage Writer HLT-Out Subscriber EventRate Subscriber HDD HLT PC 2 RORC Publisher Subscriber BridgeHead Storage Writer HDD Optical Link

18 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 TPC Sector Beamtest Beamtest HLT Summary ● Software contained only “data flow” components in order to test the interfaces from/to DAQ ● No online analysis done ● Interfaces to DAQ successfully tested, works Other Issues (outside HLT scope) ● Event rate < 5 Hz due to trigger system ● Event merging not possible due to technical issues w. optical link during HLT active time

19 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 Outline – Overview ALICE / High Level Trigger (HLT) – Overview Framework / Components – Benchmarks & Tests ● Framework Interface Benchmark ● HLT Data Challenge ● TPC Beamtest Experience – Summary & Conclusion

20 CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 HLT Summary HLT Framework is maturing Can already be used in projects/testbeams/... Has been used in real beamtest Stable Has been running for a month continously Performance has improved significantly Enough for Alice HLT already now Component approach has already been useful Easy to create configurations for short tests Flexible configuration changes during testbeam

Download ppt "CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 New Experiences with the ALICE High Level Trigger Data Transport."

Similar presentations

Jochen Thäder – Kirchhoff Institute of Physics - University of Heidelberg 1 HLT Data Challenge - PC² - - Setup / Results – - Clusterfinder Benchmarks –

Jochen Thäder – Kirchhoff Institute of Physics - University of Heidelberg 1 HLT Data Challenge - PC² - - Setup / Results – - Clusterfinder Benchmarks –
HLT Collaboration; www.ti.uni-hd.de/HLT High Level Trigger HLT PRR Computer Architecture Volker Lindenstruth Kirchhoff Institute for Physics Chair of Computer.

HLT Collaboration; High Level Trigger HLT PRR Computer Architecture Volker Lindenstruth Kirchhoff Institute for Physics Chair of Computer.
Clara Gaspar on behalf of the LHCb Collaboration, “Physics at the LHC and Beyond”, Quy Nhon, Vietnam, August 2014 Challenges and lessons learnt LHCb Operations.

Clara Gaspar on behalf of the LHCb Collaboration, “Physics at the LHC and Beyond”, Quy Nhon, Vietnam, August 2014 Challenges and lessons learnt LHCb Operations.
CHEP 2012 – New York City 1.  LHC Delivers bunch crossing at 40MHz  LHCb reduces the rate with a two level trigger system: ◦ First Level (L0) – Hardware.

CHEP 2012 – New York City 1.  LHC Delivers bunch crossing at 40MHz  LHCb reduces the rate with a two level trigger system: ◦ First Level (L0) – Hardware.
Torsten Alt - KIP Heidelberg IRTG 28/02/2007 1 ALICE High Level Trigger The ALICE High-Level-Trigger.

Torsten Alt - KIP Heidelberg IRTG 28/02/ ALICE High Level Trigger The ALICE High-Level-Trigger.
Timm Morten Steinbeck, Computer Science/Computer Engineering Group Kirchhoff Institute f. Physics, Ruprecht-Karls-University Heidelberg A Framework for.

Timm Morten Steinbeck, Computer Science/Computer Engineering Group Kirchhoff Institute f. Physics, Ruprecht-Karls-University Heidelberg A Framework for.
CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/27 A Control Software for the ALICE High Level Trigger Timm.

CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/27 A Control Software for the ALICE High Level Trigger Timm.
> IRTG – Heidelberg 2007 < Jochen Thäder – University of Heidelberg 1/18 ALICE HLT in the TPC Commissioning IRTG Seminar Heidelberg – January 2008 Jochen.

> IRTG – Heidelberg 2007 < Jochen Thäder – University of Heidelberg 1/18 ALICE HLT in the TPC Commissioning IRTG Seminar Heidelberg – January 2008 Jochen.
HLT Online Monitoring Environment incl. ROOT - Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 HOMER - HLT Online Monitoring.

HLT Online Monitoring Environment incl. ROOT - Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 HOMER - HLT Online Monitoring.
Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg - DPG 2005 – HK 41.2 1 New Test Results for the ALICE High Level Trigger.

Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg - DPG 2005 – HK New Test Results for the ALICE High Level Trigger.
HLT Collaboration (23-Jun-15) 1 High Level Trigger HLT PRR Planning Volker Lindenstruth Kirchhoff Institute for Physics Chair of Computer Science University.

HLT Collaboration (23-Jun-15) 1 High Level Trigger HLT PRR Planning Volker Lindenstruth Kirchhoff Institute for Physics Chair of Computer Science University.
The Publisher-Subscriber Interface Timm Morten Steinbeck, KIP, University Heidelberg Timm Morten Steinbeck Technical Computer Science Kirchhoff Institute.

The Publisher-Subscriber Interface Timm Morten Steinbeck, KIP, University Heidelberg Timm Morten Steinbeck Technical Computer Science Kirchhoff Institute.
Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 Tag Database for HLT Micro-ESDs.

Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 Tag Database for HLT Micro-ESDs.
Matthias Richter, University of Bergen & Timm M. Steinbeck, University of Heidelberg 1 AliRoot - Pub/Sub Framework Analysis Component Interface.

Matthias Richter, University of Bergen & Timm M. Steinbeck, University of Heidelberg 1 AliRoot - Pub/Sub Framework Analysis Component Interface.
CHEP03 - UCSD - March 24th-28th 2003 T. M. Steinbeck, V. Lindenstruth, H. Tilsner, for the Alice Collaboration Timm Morten Steinbeck, Computer Science.

CHEP03 - UCSD - March 24th-28th 2003 T. M. Steinbeck, V. Lindenstruth, H. Tilsner, for the Alice Collaboration Timm Morten Steinbeck, Computer Science.
M. Richter, University of Bergen & S. Kalcher, J. Thäder, T. M. Steinbeck, University of Heidelberg 1 AliRoot - Pub/Sub Framework Analysis Component Interface.

M. Richter, University of Bergen & S. Kalcher, J. Thäder, T. M. Steinbeck, University of Heidelberg 1 AliRoot - Pub/Sub Framework Analysis Component Interface.
Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 Timm M. Steinbeck HLT Data Transport Framework.

Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 Timm M. Steinbeck HLT Data Transport Framework.
Timm Morten Steinbeck, Computer Science/Computer Engineering Group Kirchhoff Institute f. Physics, Ruprecht-Karls-University Heidelberg Alice High Level.

Timm Morten Steinbeck, Computer Science/Computer Engineering Group Kirchhoff Institute f. Physics, Ruprecht-Karls-University Heidelberg Alice High Level.
Jochen Thäder – Kirchhoff Institute of Physics - University of Heidelberg 1 HLT for TPC commissioning - Setup - - Status - - Experience -

Jochen Thäder – Kirchhoff Institute of Physics - University of Heidelberg 1 HLT for TPC commissioning - Setup - - Status - - Experience -
Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 HLT and the Alignment & Calibration DB.

Timm M. Steinbeck - Kirchhoff Institute of Physics - University Heidelberg 1 HLT and the Alignment & Calibration DB.

Similar presentations

Ads by Google