1. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Initial Performance Measurements Gigabit Ethernet NICs 64 bit PCI Motherboards (Work in progress)

2. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester The Measurements (1) uLatency uRound trip times measured using Request-Response UDP frames uLatency as a function of frame size Slope gives sum of individual data transfer rates end-to-end Mem copy + pci + Gig Ethernet + pci + mem copy uHistograms of individual measurements

3. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester The Measurements (2) uUDP Throughput uSend a burst of UDP frames spaced at regular intervals uVary the frame size and the frame transmit spacing uRecord The time to send and the time to receive the frames The number received, the number lost, number out of order The received inter-packet spacing CPU load, Number of interrupts Zero stats OK done ●●● Get remote statistics Send statistics Send data frames at regular intervals ●●● Time to send Time to receive Inter-packet time

4. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Gigabit Ethernet Probe The Measurements (3) uPCI Activity uLogic Analyzer with PCI Probe cards in sending PC Gigabit Ethernet Fiber Probe Card PCI Probe cards in receiving PC CPU mem chipset NIC CPU mem NIC chipset Logic Analyser Display

5. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Latency: Alteon AceNIC Motherboard: SuperMicro 370DLE Chipset: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14

6. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester UDP Throughput: Alteon AceNIC Motherboard: SuperMicro 370DLE Chipset: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14

7. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Latency: SysKonnect Motherboard: SuperMicro 370DLE Chipset: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 Latency good Slope expected 0.118 us/byte

8. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester UDP Throughput: SysKonnect Motherboard: SuperMicro 370DLE Chipset: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 Packet loss during drop

9. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester PCI: SysKonnect Motherboard: SuperMicro 370DLE Chipset: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 SK300 1400 bytes sent Wait 100 us

10. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester PCI: SysKonnect Motherboard: SuperMicro 370DLE Chipset: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 SK301 1400 bytes sent Wait 20 us Sk303 1400 bytes sent Wait 10 us Frames are back-to-back Cannot go any faster !

11. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Latency: Intel Motherboard: SuperMicro 370DLE Chipset:: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 Latency high Slope expected 0.118 us/byte

12. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Throughput: Intel Motherboard: SuperMicro 370DLE Chipset:: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 Packet loss during drop

13. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester PCI: Intel Motherboard: SuperMicro 370DLE Chipset:: ServerWorks III LE Chipset CPU: PIII 800 MHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.14 IT66M212 1400 bytes sent Wait 11 us IT66M212 1400 bytes sent Wait 11 us Packets lost Action of pause packet?

14. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Latency: Intel Motherboard: SuperMicro P4CD6+ Chipset: Intel i860 CPU: Dual Xeon Prestonia (2cpu/die) 2.2 GHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.2 Latency high Slope expected 0.118 us/byte

15. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Throughput: Intel Motherboard: SuperMicro P4CD6+ Chipset: Intel i860 CPU: Dual Xeon Prestonia (2cpu/die) 2.2 GHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.2

16. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester PCI: Intel Motherboard: SuperMicro P4CD6+ Chipset: Intel i860 CPU: Dual Xeon Prestonia (2cpu/die) 2.2 GHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.2 IT66M220 1400 bytes sent Wait 1000 us IT66M224 1400 bytes sent Wait 100 us Detail Chipset limits PCI transfers with STOPs Try i870 Chipset

17. DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester PCI: Intel Motherboard: SuperMicro P4CD6+ Chipset: Intel i860 CPU: Dual Xeon Prestonia (2cpu/die) 2.2 GHz PCI:64 bit 66 MHz RedHat 7.1 Kernel 2.4.2 IT66M221 1400 bytes sent Wait 11 us