1. CALICE TDAQ Application Network Protocols 10 Gigabit Lab
Richard Hughes-Jones The University of Manchester then “Talks”
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester

2. Collecting Data over the Network
Planks
Concentrator
Ethernet Switches
Output link
Bottleneck
Queue
●●●
Suggested to trigger the planks to send all the data, though concentrators to one processing node
Emulate this using two racks from the Tier2 farm
Classic bottleneck problem for the switch
Processing Nodes
1 Burst / Node
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester

3. Measurements with two flows
Constant rate flow 790 Mbit/s
Second flow with bursts of 50 packets at 790 Mbit/s every 4 ms or 2 ms
Measure the one-way delay of the constant rate flow
Bursts of 50 packets 2 ms apart
Bursts of 50 packets 4 ms apart
With 2ms burst spacing loose packets at the end of each burst
With 2ms burst spacing Switch queue has time to empty.
~128k byte memory per port in Dell powerconnect 5324 switch
Better to use a request-response protocol to transfer the data
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester

4. Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester
10 Gigabit Ethernet Lab
Cisco 7600 switch installed
PCs
Boston/Supermicro X7DBE
Two Dual Core Intel Xeon Woodcrest 5130 CPUs 2 GHz
8 lane PCI-e
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester

5. Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester
10 Gigabit Ethernet Lab
PC with 10 Gig Ethernet NIC
Myricom Fibre 10 Gig Ethernet NIC
Myricom CX4 copper 10 Gig Ethernet NIC
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester

6. Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester
Any Questions?
Xmas Meeting, Manchester, Dec 2006, R. Hughes-Jones Manchester