Presentation on theme: "Ethernet Over PCI Express Presented by Kallol Biswas"— Presentation transcript:
1 Ethernet Over PCI Express Presented by Kallol Biswas NucleoDyne Systems, Inc Stevens Creek Blvd Cupertino, CA
2 Outline of Today’s Presentation OverviewHighlights of PCI Express ProtocolSystem to System communication using PCIe ( PCI Express protocol )Advantages and IssuesApplication Areas
3 Overview Traditional Use model New Use Model Ethernet devices connect two or morecomputer systems.PCI Express bus links motherboardmounted peripherals or add-in devices.New Use ModelPCI Express switch connects two or morecomputer systems at system bus level.
4 Multiple Computer Systems Connected through PCIe switch Remote system’s memory is available to local system for load/store CPU instructions and DMA operations.
5 New Use Model A process writes to a remote process’ address space
6 Inter process communication schemes Direct CommunicationOne process read/writes information toremote process on a different systemNo socket API is necessaryLow latency data accessTCP/IP based CommunicationEthernet frames are sent over PCIe BusObservationLow Latency and High ThroughputLower Power consumption and Low cost
7 Highlights of PCI Express Protocol Packet based Serial bus protocolPoint to Point, bidirectionalEffective data rate on each lane 2, 4 or 8 gbpsLayer architectureSoftware, Transaction, Data Link,PhysicalPath based routing, globally addressable fabricQoS supportUniversal acceptance
8 System to System Communication Two PCs are connected with an external PCIe cable
9 Two Node Communication in PIO Mode Store r3, <address in System B’s DDR>System ASystem BProcessorProcessorFSBFSBRoot ComplexRoot ComplexDDR3DDR3TLP with modified headerACK/NACK DLLPSwitchSwitchStartSeq#HeaderContent of r3ECRCLCRCEnd
10 System to System Communication Ethernet Over PCI Express TCP/IP Stack over PCIe Bus
11 Test Results Throughput & CPU Utilization Throughput in gbps
12 Netperf TCP_RR numbers RR/sec vs Packet size in bytes Test Result - LatencyNetperf TCP_RR numbers RR/sec vs Packet size in bytes
13 Advantages Lower Power Consumption Lower Cost Savings in ecosystem A 16 lane Gen2 switch consumes ~2.5WLower CostCost is around $1 per len, x8 lane device costs ~$8Savings in ecosystemLower cost for each components, clocks, connectors, cables and test equipmentsLower latency and higher throughput
14 Issues Length Limitation Max External cable length is approx 5m, with optical connector max length upto 100mMaximum number of nodes supported ina fabricMax number of Bus x device x func256 x 32 x 8 = nodes, Gen3 supports much larger number
15 Application Areas Replacement of parallel buses like VME (Versa Modular Eurocard bus) 9.97 Gbps over x4 PCIe switch vs 2.56 GbpsMulti-node cluster developmentNVRAM mirroringIn trading systems or banking industry
16 www.nucleodyne.com US System software services company Low Level Kernel & system softwareLow level device drivers for storage andcommunication protocolsEnd to end system developmentprocessor customizationsystem board developmentOS port or write new OScustom application development
17 NucleoDyne Systems, Inc. 19925 Stevens Creek Blvd, Cupertino, CA Thank YouNucleoDyne Systems, Inc Stevens Creek Blvd, Cupertino, CA
Your consent to our cookies if you continue to use this website.