Networking update and plans (see also chapter 10 of TP) Bob Dobinson, CERN, June 2000

GE Ethernet Prices dropping see following graph GE twisted pair available (RAL) As GE is getting so cheap Why not equip everywhere for GE? Run some areas initially at 100 MBPS –Nice up grade path later To be looked at in more detail

An all optical network solution? Optical fibre now very cheap –Total installation cost is 20-50% more than CAT 5 TP same price as CAT 6 –“VF-45 connector joins 2 fibres in less than 2 mins for less than $5 per connector” A more reliable better total system, says 3M, (especially for raw packets) –No interference –Lighter, more robust, easier to install –20 year guarantee! To be looked at further –Think a 20 year timescale

Programmable NICs (Alteon) Nice results obtained recently ( see later) Applications Switch testing at line speed (Gigabit) RoI and event building Pre processing Protocol processing

Alteon ACENIC PCI BUS PCI interface RISC2 RISC1 MAC Ext Mem 0.5/1 Mbyte Mem DMA1 DMA2 Phy GE TIGON CHIP

SEND ONLY Data payload % of 1 Gbps (efficiency)

SEND PLUS CONCURRENT RECEIVE SINGLE PROCESSOR % of 1Gbps (efficiency) Data payload

Alteon contacts Meeting next Tuesday with the company New chips? Would make a nice ROB component? New NICs? Future of PCI?

Tests with Foundry Big Iron Tests with 16 port switch at CERN High throughput, but some flow control problems This model switch can support 64 ports, we need about 128 So we can almost buy what we need 128 certainly in the pipeline

Switch testing GE, use Alteon boards programmed as traffic generators FE use 32 node FPGA based traffic generators –Doubles as ROB emulator –Note/talk by Micheal Levine Used to evaluate switches and calibrate modeling

Switch under test GE NIC Clock Mem CPU Cache Controller PCI BUS FE NIC Expansion to multiple units NICs housed in PCs with 14/17 PCI slots Global clock

Modeling Continuing progress Adding QoS, trunking and TCP/IP stack Model various models for Trigger/DAQ networks Two separate Integrated

Geographic distribution of computing resources At the pit On CERN site At remote locations Farms at home

Network: a global view and possible integration? Level 2 DAQ/EF DCS Front end ROD crates

Ethernet SW evolution See talk of Marc Also will revisit the problem of high performance Ethernet I/O –Will look at the TCP/IP co-existence problem –How to best deliver fibre performance to the application? –Scalability –Fault tolerance –QoS –Trunking

Present PC I/O architecture

Future PC I/O Architecture

Infiniband Trade Association Major players »IBM »INTEL »Microsoft »Lucent »SUN »Compaq »Hitachi »Fujitsu »Dell A significant development! Need to know more. Spec available soon.

Is this the end of PCI? I think not! As ESA bus became a sub system on PCI, so PCI will likely be a sub system hanging off Infiniband May gain a nice way of supporting high bandwidth from multiple PCI buses into a host