From molnarp@tartaros.CCS.ORNL.GOV Mon Aug 19 10:00:34 1996 On 8/15/96, performance testing was done on the ORNL xps150 and xps35 to determine what the maximum TCP/IP transfer rate is using the GigaNet ATM nodes with the Accelerated TCP/IP support. The testing involved sending TCP/IP data from the 150 to the 35 at OC-12 speeds through a Fore ATM switch. Maximum throughput was achieved when 7 compute nodes were used on each system to transmit/recieve the data resulting in an aggregate bandwidth of over 60 Megabytes per second. The tests were run using a modified version of ttcp which takes advantage of the new system calls for the accelerated TCP/IP suuport. One ttcp session was run per compute node. The transfer rate (as indicated from ttcp), the duration of each session and the startup time for multiple sessions (the standard deviation) are as follows: OC-12 to OC-12 -------------- 1 session: 1. 12,543.11 KB/s 10.43 seconds 4 sessions: 1. 10,058.99 KB/s 13.03 seconds 2. 10,019.50 KB/s 13.08 seconds 3. 10,039.90 KB/s 13.06 seconds 4. 10,135.65 KB/s 12.93 seconds Aggregate: 40,254.04 KB/s 5 sessions: (startup time 3.53 seconds) 1. 9,483.52 KB/s 13.82 seconds 2. 9,324.20 KB/s 14.06 seconds 3. 9,296.91 KB/s 14.10 seconds 4. 9,361.56 KB/s 14.00 seconds 5. 11,454.48 KB/s 11.44 seconds Aggregate: 48,920.67 KB/s 6 sessions: (startup time 6.75 seconds) 1. 9,069.16 KB/s 14.45 seconds 2. 8,325.71 KB/s 15.74 seconds 3. 8,918.16 KB/s 14.70 seconds 4. 8,946.53 KB/s 14.65 seconds 5. 10,991.69 KB/s 11.92 seconds 6. 11,094.00 KB/s 11.81 seconds Aggregate: 57,345.72 KB/s 7 sessions: (startup time 4.27 seconds) 1. 9,989.38 KB/s 13.12 seconds 2. 10,510.77 KB/s 12.47 seconds 3. 10,747.56 KB/s 12.20 seconds 4. 8,450.24 KB/s 15.51 seconds 5. 8,560.46 KB/s 15.31 seconds 6. 8,160.13 KB/s 16.06 seconds 7. 8,617.16 KB/s 15.21 seconds Aggregate: 65,035.70 KB/s 8 sessions: (startup time 6.43 seconds) 1. 9,740.46 KB/s 13.46 seconds 2. 8,364.75 KB/s 15.67 seconds 3. 4,572.17 KB/s 28.67 seconds 4. 4,887.38 KB/s 26.82 seconds 5. 7,457.14 KB/s 17.58 seconds 6. 7,694.83 KB/s 17.03 seconds 7. 6,990.23 KB/s 18.75 seconds 8. 7,993.87 KB/s 16.40 seconds Aggregate: 57,700.83 KB/s OC-12 --> DS-3 --> OC-12 ------------------------ 2 sessions: 1. 2,260.23 KB/s 57.99 seconds 2. 2,262.34 KB/s 57.94 seconds 3 sessions: 1. 1,509.14 KB/s 86.85 seconds 2. 1,501.25 KB/s 87.31 seconds 3. 1,507.20 KB/s 87.05 seconds 4 sessions: 1. 1,155.89 KB/s 113.39 seconds 2. 1,137.82 KB/s 115.20 seconds 3. 1,137.29 KB/s 115.25 seconds 4. 1,144.60 KB/s 114.93 seconds 5 sessions: 1. 1,151.35 KB/s 113.84 seconds 2. 1,135.26 KB/s 115.46 seconds 3. Did not complete - hung forever 4. 1,136.12 KB/s 115.37 seconds 5. 1,147.51 KB/s 114.22 seconds OC-12 --> DS-3 --> (simulated delay of about .80 ms)** --> OC-12 ------------------------------------------------------------ 1 session: 1. 662.97 KB/s 197.70 seconds NOTE: ** With the simulated delay, a "ping" took 86 ms. data rates are for a 64K message, command was ./ttcp.user.nx -sz 1 -r -s -Gn1212 -p5012 -Gm256000 -GM256 -l65536 -b65535