Find the answer to your Linux question:
Page 1 of 2 1 2 LastLast
Results 1 to 10 of 14
I've installed a new switch last week, upgraded from old netgear layer 1 hub 10/100 8 port to a new D-Link DGS-1024D 10/100/1000Mbps 24-Port. I've been doing throughput test using ...
Enjoy an ad free experience by logging in. Not a member yet? Register.
  1. 05-28-2009 #1
    Mad Professor
    Mad Professor is offline
    Linux Newbie Mad Professor's Avatar
    Join Date
    May 2006
    Posts
    131

    gigabit network, 350mbit/s what is this rubbish?

    I've installed a new switch last week, upgraded from old netgear layer 1 hub 10/100 8 port to a new D-Link DGS-1024D 10/100/1000Mbps 24-Port.

    I've been doing throughput test using iperf on Gigabit capable machine, and all of them can only do about 300-350 Mbits and just so we're clear, that's 300 Megabits. I've check the connection and settings and all of them are at 1000, full duplex. I've also tried tweaking sysctl on the centos boxes, and trying all kinds of configs and none of them have any effect on them. It's like They are stuck at 300Mbits. I've tried four different machines and with the same result. I've tried direct connection via a crossover cable taking the switch out of the equation and it still has the same effect.

    For some weird reason one additional computer *totaling 5 computers with gigabit cards* can allow 400Mbits coming in from "certain computers" but going out to any other machine it's 300Mbits and this is an old Tbird clocked at 933 and 4 ide drives in raid 0 and two 5400 U160 scsi drives also in raid 0.

    The cabling is sub par in the home but most of my test have been conducted on good Cat5e, I have cat6 bulk cabling in a box have not gotten around to making some cables.

    Am I missing something? Why are we going around 300Mbits when I was kind of expecting 500-600Mbits, is this the sad truth of Gigabit?

    ~MP
    Reply With Quote Reply With Quote
  2. 05-29-2009 #2
    b2bwild
    b2bwild is offline
    Linux Engineer b2bwild's Avatar
    Join Date
    Jul 2008
    Location
    Behind You!
    Posts
    1,108
    1000 Gbit refers to bandwidth not the speed.

    If you expect your 1 GB file transfer to be done in 1 Second..X_X It doesnt work that way, sorry.

    Also the data transfer rates, while file transfers are depended on Hard Drive speeds also.

    The gigabit ethernet will work at full capacity when working on huge network load, which doesn't have to do anything with anyother component on your system like, Web Server, SQL Server or FTP Servers.
    Never make any misteaks.

    Read my Blog at --> Penguin Inside Subscribe Feed
    Reply With Quote Reply With Quote
  3. 05-29-2009 #3
    Mad Professor
    Mad Professor is offline
    Linux Newbie Mad Professor's Avatar
    Join Date
    May 2006
    Posts
    131
    Quote Originally Posted by b2bwild View Post
    1000 Gbit refers to bandwidth not the speed.

    If you expect your 1 GB file transfer to be done in 1 Second..X_X It doesnt work that way, sorry.

    Also the data transfer rates, while file transfers are depended on Hard Drive speeds also.

    The gigabit ethernet will work at full capacity when working on huge network load, which doesn't have to do anything with anyother component on your system like, Web Server, SQL Server or FTP Servers.
    I fully understand networking concept, I'm not dumb you know, I wasn't expecting to transfer a 1 GB file in a split second. I'm asking why is my throughput so low on iperf? 300-350MBits is too low on a direct connection, when it should be more close to 80% of the line speed. I was expecting 70% at least on throughput and not this 30% ********, and I understand hardware can be a limiting factor but thats no reason why throughput is so low especially when iperf doesn't utilize a read or write to a disk and this is just for a lan with serving capabilities.
    Reply With Quote Reply With Quote
  4. 05-29-2009 #4
    b2bwild
    b2bwild is offline
    Linux Engineer b2bwild's Avatar
    Join Date
    Jul 2008
    Location
    Behind You!
    Posts
    1,108
    What is the latancy between the both machines?
    are you using -C option with iperf?
    Have you mentioned Window Size?
    Is network healthy? make sure there are no congestion
    try using UDP, ( -u with -b option)
    Never make any misteaks.

    Read my Blog at --> Penguin Inside Subscribe Feed
    Reply With Quote Reply With Quote
  5. 05-29-2009 #5
    Mad Professor
    Mad Professor is offline
    Linux Newbie Mad Professor's Avatar
    Join Date
    May 2006
    Posts
    131
    I'm using iperf -i 1 -t 30 -c 192.168.0.124.
    Code:
    [root@backup ~]# iperf -i 1 -t 30 -c 192.168.0.124
------------------------------------------------------------
Client connecting to 192.168.0.124, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.112 port 42416 connected with 192.168.0.124 port 5001
[  3]  0.0- 1.0 sec  39.1 MBytes    328 Mbits/sec
[  3]  1.0- 2.0 sec  37.8 MBytes    317 Mbits/sec
[  3]  2.0- 3.0 sec  38.3 MBytes    321 Mbits/sec
[  3]  3.0- 4.0 sec  36.6 MBytes    307 Mbits/sec
[  3]  4.0- 5.0 sec  38.2 MBytes    320 Mbits/sec
[  3]  5.0- 6.0 sec  36.9 MBytes    309 Mbits/sec
[  3]  6.0- 7.0 sec  37.7 MBytes    317 Mbits/sec
[  3]  7.0- 8.0 sec  37.7 MBytes    317 Mbits/sec
[  3]  8.0- 9.0 sec  37.3 MBytes    313 Mbits/sec
[  3]  9.0-10.0 sec  37.4 MBytes    314 Mbits/sec
[  3] 10.0-11.0 sec  38.1 MBytes    319 Mbits/sec
[  3] 11.0-12.0 sec  36.8 MBytes    308 Mbits/sec
[  3] 12.0-13.0 sec  37.6 MBytes    315 Mbits/sec
[  3] 13.0-14.0 sec  38.0 MBytes    318 Mbits/sec
[  3] 14.0-15.0 sec  37.4 MBytes    314 Mbits/sec
[  3] 15.0-16.0 sec  37.1 MBytes    311 Mbits/sec
[  3] 16.0-17.0 sec  38.0 MBytes    319 Mbits/sec
[  3] 17.0-18.0 sec  37.7 MBytes    317 Mbits/sec
[  3] 18.0-19.0 sec  37.2 MBytes    312 Mbits/sec
[  3] 19.0-20.0 sec  37.4 MBytes    313 Mbits/sec
[  3] 20.0-21.0 sec  37.7 MBytes    316 Mbits/sec
[  3] 21.0-22.0 sec  37.7 MBytes    316 Mbits/sec
[  3] 22.0-23.0 sec  36.8 MBytes    309 Mbits/sec
[  3] 23.0-24.0 sec  38.1 MBytes    319 Mbits/sec
[  3] 24.0-25.0 sec  37.6 MBytes    316 Mbits/sec
[  3] 25.0-26.0 sec  37.3 MBytes    313 Mbits/sec
[  3] 26.0-27.0 sec  37.8 MBytes    317 Mbits/sec
[  3] 27.0-28.0 sec  36.7 MBytes    308 Mbits/sec
[  3] 28.0-29.0 sec  37.8 MBytes    317 Mbits/sec
[  3] 29.0-30.0 sec  38.0 MBytes    318 Mbits/sec
[  3]  0.0-30.0 sec  1.10 GBytes    315 Mbits/sec
[root@backup ~]#
    I tried -u -b 10m and got

    Code:
    [root@backup ~]# iperf -c 192.168.0.124 -u -b 10m
------------------------------------------------------------
Client connecting to 192.168.0.124, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:   107 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.112 port 43468 connected with 192.168.0.124 port 5001
[  3]  0.0-10.0 sec  11.9 MBytes  10.0 Mbits/sec
[  3] Sent 8505 datagrams
[  3] Server Report:
[  3]  0.0-10.0 sec  11.9 MBytes  10.0 Mbits/sec  0.008 ms    0/ 8505 (0%)
[root@backup ~]#
    if I do it going back the other way

    Code:
    [root@fileserver ~]# iperf -i 1 -t 30 -c 192.168.0.112
------------------------------------------------------------
Client connecting to 192.168.0.112, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.124 port 12598 connected with 192.168.0.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  52.3 MBytes    439 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  1.0- 2.0 sec  52.2 MBytes    438 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  2.0- 3.0 sec  52.1 MBytes    437 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  3.0- 4.0 sec  51.9 MBytes    436 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  4.0- 5.0 sec  52.0 MBytes    436 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  5.0- 6.0 sec  52.0 MBytes    436 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  6.0- 7.0 sec  51.4 MBytes    431 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  7.0- 8.0 sec  51.4 MBytes    431 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  8.0- 9.0 sec  51.4 MBytes    431 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  9.0-10.0 sec  51.7 MBytes    434 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 10.0-11.0 sec  51.4 MBytes    432 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 11.0-12.0 sec  51.3 MBytes    430 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 12.0-13.0 sec  51.6 MBytes    433 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 13.0-14.0 sec  51.5 MBytes    432 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 14.0-15.0 sec  50.2 MBytes    421 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 15.0-16.0 sec  50.0 MBytes    420 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 16.0-17.0 sec  51.2 MBytes    430 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 17.0-18.0 sec  50.7 MBytes    425 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 18.0-19.0 sec  51.4 MBytes    431 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 19.0-20.0 sec  51.0 MBytes    428 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 20.0-21.0 sec  51.0 MBytes    428 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 21.0-22.0 sec  50.4 MBytes    423 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 22.0-23.0 sec  51.2 MBytes    429 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 23.0-24.0 sec  51.1 MBytes    429 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 24.0-25.0 sec  51.0 MBytes    428 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 25.0-26.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 26.0-27.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 27.0-28.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 28.0-29.0 sec  50.7 MBytes    425 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 29.0-30.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-30.0 sec  1.50 GBytes    430 Mbits/sec
[root@fileserver ~]#
    UDP
    Code:
    [root@fileserver ~]# iperf -c 192.168.0.112 -u -b 10m
------------------------------------------------------------
Client connecting to 192.168.0.112, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 2.41 MByte (default)
------------------------------------------------------------
[  3] local 192.168.0.124 port 33068 connected with 192.168.0.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.1 sec  11.9 MBytes  9.84 Mbits/sec
[  3] Sent 8466 datagrams
[  3] Server Report:
[ ID] Interval       Transfer     Bandwidth       Jitter   Lost/Total Datagrams
[  3]  0.0-10.1 sec  9.46 MBytes  7.85 Mbits/sec  0.007 ms 1717/ 8465 (20%)
[  3]  0.0-10.1 sec  1 datagrams received out-of-order
[root@fileserver ~]#
    Reply With Quote Reply With Quote
  6. 05-30-2009 #6
    b2bwild
    b2bwild is offline
    Linux Engineer b2bwild's Avatar
    Join Date
    Jul 2008
    Location
    Behind You!
    Posts
    1,108
    With -b option you limited the bandwidth on 10? well try 1000m with -b

    Have you check the latancy to your iperf server? 0.10ms is the best to get.
    Small difference in latancy will make huge difference in iperf calculation.
    Howevery its affects the iperf calculation, not the actual speed.

    Try using large frames, by setting your MTU to 8000 to 9000

    2nd some people have also suffered slow start delayes on 1gbit networks. so consider making tests of higher duration
    Never make any misteaks.

    Read my Blog at --> Penguin Inside Subscribe Feed
    Reply With Quote Reply With Quote
  7. 05-30-2009 #7
    blinky
    blinky is offline
    Linux Newbie
    Join Date
    Sep 2004
    Location
    UK
    Posts
    161
    What's it like between 2 machines on a loopback cable?
    In a world without walls and fences, who needs Windows and Gates?
    Reply With Quote Reply With Quote
  8. 05-30-2009 #8
    Mad Professor
    Mad Professor is offline
    Linux Newbie Mad Professor's Avatar
    Join Date
    May 2006
    Posts
    131
    Ok... Something definitely not configure right, but I don't know which machine tho.

    I switched out cat5e cables for some homebrew cat6e.

    before I replaced the cables, I ping computers that had cat5e and was getting 0.20 - 0.50 with some spiking. After replacing cable I ping a computer that had cat5e and was still getting the same.
    I then ping a computer that had cat6e and was getting 0.02 to 0.15.

    I ran a iperf test with -i 1 -t 30 and it increase a little about 10-20mbits.

    System specs of the two machines:
    Fileserver:
    O/S: Centos 5.2
    Mobo: Asus a7n8x-e deluxe
    CPU: Athlon XP 2500+
    Mem: had 2 gigs of corsair but it's being rma currently running temp corsair 1 gig.
    video: basic nvidia low profile can't remember the name but it's 16MB.
    Network: Onboard, marvell yukon 1 gigabit
    Hard-drives: 7
    4x 500GB seagates in raid 5 on sata controller native hardware raid. RR1740
    2x 1.5TB in linux raid mirror 1 on a simple 2 port sata controller.
    1x Fujitsu 10GB ide drive <--- OS drive
    PSU: Seasonic 330W 80plus

    Backup server:
    O/S: Centos 5.3
    Mobo: Asus A7v133-c deluxe
    CPU: Tbird 700mhz OC'd 933
    Mem: Sdramk 512MB pc133 running at 133FSB
    Video: S3 Savage
    Network: DLINK DGE-530T
    Hard-drives: 6
    4x ide drives: 2x maxtor 1x WD and 1x Seagate all 7200RPM in linux raid 0
    2x scsi: 1x 2gig seagate 5400 1x 1gig seagate 5400 on adaptec U160 controller in linux raid 0
    PSU: was a 400w but it died 3 days ago running on a Aopen 250W.

    Fileserver to backup
    Running mtu 9000 on both on cat6e
    Code:
    [root@fileserver ~]# iperf -i 1 -t 30 -c 192.168.0.112
------------------------------------------------------------
Client connecting to 192.168.0.112, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.124 port 59030 connected with 192.168.0.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  89.1 MBytes    747 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  1.0- 2.0 sec  87.9 MBytes    737 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  2.0- 3.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  3.0- 4.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  4.0- 5.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  5.0- 6.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  6.0- 7.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  7.0- 8.0 sec  80.3 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  8.0- 9.0 sec  82.1 MBytes    689 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  9.0-10.0 sec  84.4 MBytes    708 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 10.0-11.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 11.0-12.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 12.0-13.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 13.0-14.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 14.0-15.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 15.0-16.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 16.0-17.0 sec  84.1 MBytes    705 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 17.0-18.0 sec  82.3 MBytes    691 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 18.0-19.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 19.0-20.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 20.0-21.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 21.0-22.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 22.0-23.0 sec  80.2 MBytes    673 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 23.0-24.0 sec  80.1 MBytes    672 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 24.0-25.0 sec  81.8 MBytes    686 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 25.0-26.0 sec  84.1 MBytes    705 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 26.0-27.0 sec  78.7 MBytes    661 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 27.0-28.0 sec  80.7 MBytes    677 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 28.0-29.0 sec  84.0 MBytes    705 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 29.0-30.0 sec  78.1 MBytes    655 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-30.1 sec  2.39 GBytes    682 Mbits/sec
[root@fileserver ~]# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr 00:11:2F:D5:F3:58
          inet addr:192.168.0.124  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::211:2fff:fed5:f358/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:451625 errors:0 dropped:0 overruns:0 frame:0
          TX packets:435732 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:2786163842 (2.5 GiB)  TX bytes:2592752992 (2.4 GiB)
          Interrupt:217
    changed mtu on fileserver to 1500
    Code:
    [root@fileserver ~]# ifconfig eth0 mtu 1500
[root@fileserver ~]# iperf -i 1 -t 30 -c 192.168.0.112
------------------------------------------------------------
Client connecting to 192.168.0.112, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.124 port 59056 connected with 192.168.0.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  6.84 MBytes  57.4 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  1.0- 2.0 sec  2.88 MBytes  24.2 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  2.0- 3.0 sec  2.51 MBytes  21.0 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  3.0- 4.0 sec  2.20 MBytes  18.4 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  4.0- 5.0 sec  1.71 MBytes  14.4 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  5.0- 6.0 sec  1.67 MBytes  14.0 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  6.0- 7.0 sec  1.50 MBytes  12.6 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  7.0- 8.0 sec  1.45 MBytes  12.2 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  8.0- 9.0 sec  1.34 MBytes  11.3 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  9.0-10.0 sec  1.34 MBytes  11.2 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 10.0-11.0 sec  1.19 MBytes  9.96 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 11.0-12.0 sec  1.13 MBytes  9.50 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 12.0-13.0 sec  1.14 MBytes  9.57 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 13.0-14.0 sec  1.12 MBytes  9.44 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 14.0-15.0 sec  1.09 MBytes  9.18 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 15.0-16.0 sec    984 KBytes  8.06 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 16.0-17.0 sec  1016 KBytes  8.32 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 17.0-18.0 sec  1000 KBytes  8.19 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 18.0-19.0 sec    384 KBytes  3.15 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 19.0-20.0 sec    376 KBytes  3.08 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 20.0-21.0 sec    400 KBytes  3.28 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 21.0-22.0 sec    368 KBytes  3.01 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 22.0-23.0 sec    376 KBytes  3.08 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 23.0-24.0 sec    576 KBytes  4.72 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 24.0-25.0 sec    408 KBytes  3.34 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 25.0-26.0 sec    368 KBytes  3.01 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 26.0-27.0 sec    392 KBytes  3.21 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 27.0-28.0 sec    392 KBytes  3.21 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 28.0-29.0 sec    384 KBytes  3.15 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 29.0-30.0 sec    384 KBytes  3.15 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-30.3 sec  36.8 MBytes  10.2 Mbits/sec
[root@fileserver ~]#
    Then I changed the mtu on backup from 9000 to 1500 and fileserver from 1500 to 9000

    Code:
    [root@fileserver ~]# iperf -i 1 -t 30 -c 192.168.0.112
------------------------------------------------------------
Client connecting to 192.168.0.112, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.124 port 38243 connected with 192.168.0.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  51.7 MBytes    434 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  1.0- 2.0 sec  51.6 MBytes    433 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  2.0- 3.0 sec  51.6 MBytes    433 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  3.0- 4.0 sec  51.6 MBytes    432 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  4.0- 5.0 sec  51.6 MBytes    433 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  5.0- 6.0 sec  51.3 MBytes    431 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  6.0- 7.0 sec  51.2 MBytes    430 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  7.0- 8.0 sec  51.2 MBytes    430 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  8.0- 9.0 sec  51.2 MBytes    429 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  9.0-10.0 sec  51.2 MBytes    429 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 10.0-11.0 sec  51.3 MBytes    431 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 11.0-12.0 sec  51.2 MBytes    429 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 12.0-13.0 sec  49.7 MBytes    417 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 13.0-14.0 sec  51.3 MBytes    430 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 14.0-15.0 sec  50.9 MBytes    427 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 15.0-16.0 sec  51.0 MBytes    428 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 16.0-17.0 sec  50.7 MBytes    425 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 17.0-18.0 sec  50.9 MBytes    427 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 18.0-19.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 19.0-20.0 sec  50.9 MBytes    427 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 20.0-21.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 21.0-22.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 22.0-23.0 sec  50.9 MBytes    427 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 23.0-24.0 sec  50.7 MBytes    425 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 24.0-25.0 sec  50.7 MBytes    425 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 25.0-26.0 sec  50.9 MBytes    427 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 26.0-27.0 sec  50.9 MBytes    427 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 27.0-28.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 28.0-29.0 sec  50.8 MBytes    426 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3] 29.0-30.0 sec  50.7 MBytes    425 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-30.0 sec  1.50 GBytes    428 Mbits/sec
[root@fileserver ~]#
    Going from backup to fileserver
    Both mtu 9000
    Code:
    [root@backup ~]# ifconfig eth0 mtu 9000
[root@backup ~]# iperf -i 1 -t 30 -c 192.168.0.124
------------------------------------------------------------
Client connecting to 192.168.0.124, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.112 port 54095 connected with 192.168.0.124 port 5001
[  3]  0.0- 1.0 sec  40.4 MBytes    339 Mbits/sec
[  3]  1.0- 2.0 sec  44.4 MBytes    373 Mbits/sec
[  3]  2.0- 3.0 sec  51.0 MBytes    428 Mbits/sec
[  3]  3.0- 4.0 sec  42.8 MBytes    359 Mbits/sec
[  3]  4.0- 5.0 sec  46.5 MBytes    390 Mbits/sec
[  3]  5.0- 6.0 sec  40.2 MBytes    338 Mbits/sec
[  3]  6.0- 7.0 sec  47.1 MBytes    395 Mbits/sec
[  3]  7.0- 8.0 sec  40.3 MBytes    338 Mbits/sec
[  3]  8.0- 9.0 sec  46.3 MBytes    389 Mbits/sec
[  3]  9.0-10.0 sec  41.0 MBytes    344 Mbits/sec
[  3] 10.0-11.0 sec  44.7 MBytes    375 Mbits/sec
[  3] 11.0-12.0 sec  42.6 MBytes    357 Mbits/sec
[  3] 12.0-13.0 sec  42.9 MBytes    360 Mbits/sec
[  3] 13.0-14.0 sec  44.5 MBytes    373 Mbits/sec
[  3] 14.0-15.0 sec  40.9 MBytes    343 Mbits/sec
[  3] 15.0-16.0 sec  46.5 MBytes    390 Mbits/sec
[  3] 16.0-17.0 sec  40.3 MBytes    338 Mbits/sec
[  3] 17.0-18.0 sec  47.0 MBytes    395 Mbits/sec
[  3] 18.0-19.0 sec  40.3 MBytes    338 Mbits/sec
[  3] 19.0-20.0 sec  47.0 MBytes    395 Mbits/sec
[  3] 20.0-21.0 sec  40.3 MBytes    338 Mbits/sec
[  3] 21.0-22.0 sec  46.5 MBytes    390 Mbits/sec
[  3] 22.0-23.0 sec  40.9 MBytes    343 Mbits/sec
[  3] 23.0-24.0 sec  44.7 MBytes    375 Mbits/sec
[  3] 24.0-25.0 sec  42.7 MBytes    358 Mbits/sec
[  3] 25.0-26.0 sec  42.9 MBytes    360 Mbits/sec
[  3] 26.0-27.0 sec  44.4 MBytes    373 Mbits/sec
[  3] 27.0-28.0 sec  41.1 MBytes    345 Mbits/sec
[  3] 28.0-29.0 sec  46.3 MBytes    388 Mbits/sec
[  3] 29.0-30.0 sec  40.4 MBytes    339 Mbits/sec
[  3]  0.0-30.0 sec  1.28 GBytes    365 Mbits/sec
[root@backup ~]# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr 00:1C:F0:A1:74:4D
          inet addr:192.168.0.112  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21c:f0ff:fea1:744d/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
          RX packets:74439 errors:0 dropped:0 overruns:0 frame:0
          TX packets:153258 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:5211606 (4.9 MiB)  TX bytes:1381426976 (1.2 GiB)
          Interrupt:11
    Changed mtu on backup to 1500.

    Code:
    [root@backup ~]# ifconfig eth0 mtu 1500
[root@backup ~]# iperf -i 1 -t 30 -c 192.168.0.124
------------------------------------------------------------
Client connecting to 192.168.0.124, TCP port 5001
TCP window size:   934 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.112 port 54096 connected with 192.168.0.124 port 5001
[  3]  0.0- 1.0 sec  44.3 MBytes    371 Mbits/sec
[  3]  1.0- 2.0 sec  39.0 MBytes    328 Mbits/sec
[  3]  2.0- 3.0 sec  36.4 MBytes    305 Mbits/sec
[  3]  3.0- 4.0 sec  35.1 MBytes    295 Mbits/sec
[  3]  4.0- 5.0 sec  35.5 MBytes    298 Mbits/sec
[  3]  5.0- 6.0 sec  37.2 MBytes    312 Mbits/sec
[  3]  6.0- 7.0 sec  37.2 MBytes    312 Mbits/sec
[  3]  7.0- 8.0 sec  37.2 MBytes    312 Mbits/sec
[  3]  8.0- 9.0 sec  37.3 MBytes    313 Mbits/sec
[  3]  9.0-10.0 sec  36.4 MBytes    305 Mbits/sec
[  3] 10.0-11.0 sec  35.9 MBytes    302 Mbits/sec
[  3] 11.0-12.0 sec  35.8 MBytes    300 Mbits/sec
[  3] 12.0-13.0 sec  36.3 MBytes    305 Mbits/sec
[  3] 13.0-14.0 sec  35.7 MBytes    299 Mbits/sec
[  3] 14.0-15.0 sec  36.1 MBytes    303 Mbits/sec
[  3] 15.0-16.0 sec  36.2 MBytes    304 Mbits/sec
[  3] 16.0-17.0 sec  35.8 MBytes    300 Mbits/sec
[  3] 17.0-18.0 sec  37.3 MBytes    313 Mbits/sec
[  3] 18.0-19.0 sec  37.2 MBytes    312 Mbits/sec
[  3] 19.0-20.0 sec  38.0 MBytes    319 Mbits/sec
[  3] 20.0-21.0 sec  36.8 MBytes    308 Mbits/sec
[  3] 21.0-22.0 sec  36.4 MBytes    305 Mbits/sec
[  3] 22.0-23.0 sec  35.7 MBytes    299 Mbits/sec
[  3] 23.0-24.0 sec  35.9 MBytes    301 Mbits/sec
[  3] 24.0-25.0 sec  36.0 MBytes    302 Mbits/sec
[  3] 25.0-26.0 sec  36.2 MBytes    304 Mbits/sec
[  3] 26.0-27.0 sec  35.9 MBytes    301 Mbits/sec
[  3] 27.0-28.0 sec  36.8 MBytes    308 Mbits/sec
[  3] 28.0-29.0 sec  37.6 MBytes    315 Mbits/sec
[  3]  0.0-30.0 sec  1.08 GBytes    309 Mbits/sec
[root@backup ~]#
    I tried my laptop with ubuntu and the backup server get 400Mbits but my laptop doesn't support J-frames.

    I have a misconfiguration on my fileserver.

    any ideas?


    edit:     also forgot udp

    Both mtu 9000

    Backup > Fileserver

    Code:
    [root@backup ~]# iperf -c 192.168.0.124 -i 1 -u -b 1000m
------------------------------------------------------------
Client connecting to 192.168.0.124, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:   107 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.112 port 58079 connected with 192.168.0.124 port 5001
[  3]  0.0- 1.0 sec  40.7 MBytes    341 Mbits/sec
[  3]  1.0- 2.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  2.0- 3.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  3.0- 4.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  4.0- 5.0 sec  40.6 MBytes    340 Mbits/sec
[  3]  5.0- 6.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  6.0- 7.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  7.0- 8.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  8.0- 9.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  9.0-10.0 sec  40.6 MBytes    341 Mbits/sec
[  3]  0.0-10.0 sec    406 MBytes    341 Mbits/sec
[  3] Sent 289763 datagrams
[  3] Server Report:
[  3]  0.0-10.2 sec    137 MBytes    112 Mbits/sec  15.056 ms 191709/289761 (66%)
[root@backup ~]#
    Fileserver > Backup
    Code:
    [root@fileserver ~]# iperf -c 192.168.0.112 -i 1 -u -b 1000m
------------------------------------------------------------
Client connecting to 192.168.0.112, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:   107 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.124 port 32792 connected with 192.168.0.112 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  70.4 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  1.0- 2.0 sec  70.5 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  2.0- 3.0 sec  70.4 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  3.0- 4.0 sec  70.5 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  4.0- 5.0 sec  70.5 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  5.0- 6.0 sec  70.4 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  6.0- 7.0 sec  53.3 MBytes    447 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  7.0- 8.0 sec  70.4 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  8.0- 9.0 sec  70.4 MBytes    591 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  9.0-10.0 sec  70.2 MBytes    589 Mbits/sec
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec    687 MBytes    576 Mbits/sec
[  3] Sent 490110 datagrams
[  3] Server Report:
[ ID] Interval       Transfer     Bandwidth       Jitter   Lost/Total Datagrams
[  3]  0.0-10.2 sec    121 MBytes  99.2 Mbits/sec  15.689 ms 403701/490109 (82%)
[  3]  0.0-10.2 sec  1 datagrams received out-of-order
[root@fileserver ~]#

    I don't think udp likes jumbo frames.
    Reply With Quote Reply With Quote
  9. 05-30-2009 #9
    Rubberman
    Rubberman is offline
    Linux Guru Rubberman's Avatar
    Join Date
    Apr 2009
    Location
    I can be found either 40 miles west of Chicago, or in a galaxy far, far away.
    Posts
    10,142
    350mbps / 1470bytes/packet ~= 31,200 packets / second. Each packet sent, requires an ACK, so that means 62,400 packets transferred one way or the other each second, which is 16usec per packet transferred. Given hardware and processing speed, I think 350mbps is not out of the question, nor in truth unreasonable.

    I sometimes get about 1gbps out of a 3gbps sata link, at least until the drive buffer is full, then it steady-states at about 400mbps, which is pretty close to the theoretical i/o speed of the drive itself. To expect an ethernet link to exceed that is, IMO, not reasonable.
    Sometimes, real fast is almost as good as real time.
    Just remember, Semper Gumbi - always be flexible!
    Reply With Quote Reply With Quote
  10. 05-31-2009 #10
    Mad Professor
    Mad Professor is offline
    Linux Newbie Mad Professor's Avatar
    Join Date
    May 2006
    Posts
    131
    Took a windows machine *my desktop* iperf to my fileserver using 64K Tcp Window with jumbo frames got 550-600 Mbits, Did the reverse got a constant 700Mbits from fileserver to my desktop. I tried iperf from my desktop to backup using tcp 64K with jumbo frames got a constant 560Mbits, did the reverse going from backup to my desktop only got 357Mbits constant. I think something is limiting this, botch config maybe?
    Reply With Quote Reply With Quote
Page 1 of 2 1 2 LastLast
« Previous Thread | Next Thread »

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules