PDA

View Full Version : Low Network Performance with P4 Intel MB Gigabit and Raid Disk.


rluiten
9th May 2004, 09:06 AM
Im not sure I am in the right place but it seemed the best fit. (sorry its long ive been testing this for a while and thought id cram in most of my info)

I have setup with Fedora Core2 test3 release and have the hardware seemingly all running after a bit of fiddling. My samba 3 file share performance isnt very good . Im lucky if I write speeds for large files are higher than 14 megabytes/sec and read speeds lucky to average 18 megabytes or so.. I do say lucky as a lot of the time i get 11 or so read and or write which is barely any better than 100 megabit.

Just for some comparison I ran up windows 2003 on this hardware using a software raid 5. It was reading average over 30 megabytes/sec peak and writing speeds were close to 30 as well.

The other machine I am using for testing is a Windows XP Pro machine with a barton 2500 and PCI DLink gigabit network card.

Maybe my expectations are to high but I had thought a solid mid 20's megabyte/sec performance would be quite achievable..

What I have is a Abit IC7-MAX3 MB with 2.8Ghz P4 and a bunch of disk space. I am setting up a Samba based network file server. The motherboard uses INtels 875 chipset and has integrated CSA bus with gigabit Nic. I have setup a 6 disc software Raid on 200 gig Drives on the 6 available sata channels on the Motherboard.

The raid is setup with ext3 and raid 5 stripe of 128k chunksize. The block size is set at 2048 and the stride is set to 64. ( i read in a few places to make stride times block size match raid stripe ) I used mdadm to do the raid creation and used the default algorithm of 2.

I did some tests using netperf 2.1 between the P4 Linux and my XP Barton and get 330 megabit to the Linux and 580 megabit from the Linux box with that tool.

Seems raw network performances is ok.

hdparm reports read of raid device over 100 megabytes/sec

hdparm reports read of member drve in raid raid device around 48 megabytes/sec. (6 sata drives)

The raid array using some tests i can create a 3000 megabyte file takes around 80 seconds. (many repeated tests.) that is over 27 megabytes/sec

Tests used where.

time dd if=/dev/zero of=/raid/testfile bs=1M count=3000
and
time dd if=/dev/zero bs=1M count=3000 | tr '\000' '\055' > /raid/testfile

(Second test done just incase nulls are somehow detected in the writes.)

Test of read performance with file tried
time dd if=/raid/testfile of=/dev/null

The reading of this file takes on averagea around 44 seconds giving read speeds over 70 megabytes/sec

The raid filesystem seems capable of handling the sort of performance i expect.

I realise these tests are not to realistic but i use the same files for pushing / pulling across network link so I am trying to compare oranges and oranges.

I just realised I have done another network related test I setup web server on my XP Barton and grab it using wget and output file to /dev/null and im lucky to get 12 megabytes a second.

(My barton has 120 gig sata seagate drives in it so its disk performance is decent)

I also setup apache on the linux box and tried a local wget to /dev/null from apache and I get read speeds of over 80 megabytes/sec.

Yes I am using files larger than my ram size. Ram in each machine is 1 gig. Using files in general at least 3 gig. (its funny when i first tested i reran a test and it was instant then i realised ram cache)

I did try Knoppix 3.4 briefly tried booting under 2.4 and 2.6 kernel just to test the wget to /dev/null from my XP server. It was same performance as my installed Fedora Core2 test3.

If anyone can suggest something else to try id be happy to have more options. (I hope the answer isnt - im sorry thats all you can expect).

I am happy to try other tests if people can direct me to them if more informatin might help diagnose or further detail behaviour.

Respectfully,
Robin

Beng
8th December 2004, 09:37 AM
It's probaly the windows system. I had a simulair problem with two winxp system, network utilisation was low, between 0-1% and as a result filetransfers over shared folders was really slow.

check out this page:
http://www.petri.co.il/speed_up_network_file_copying_in_windows_xp.htm

You can solve this by setting the tcp receive window on the windows system to 513920. Just download the TCPOptimizer from speednet and run it on the windows system.

Another nice ms$$$ 'feature' :D

sej7278
8th December 2004, 05:21 PM

at work we've been evaluating some gigabit products (from simple pci cards right up to 1u devices) and have come to the conclusion that linux can only achieve about 200Mbps from gigabit (disappointing, as i've seen 700mbps from sun sparcs).

we've only used 32-bit pci cards, and we managed to get better performance by tweaking the kernel, but it's very disappointing.

we also found theat hyperthreading helps a lot - a p4 2.8 was getting up to 100% cpu usage when we hammered the gigabit nic, but a hyperthreading p4 3ghz was only using about 30%.

i don't think it's a driver issue as not all the devices used the same hardware/drivers, so i guess it's a pci bus thing - but then it would be surprising that you can get better from windows.....