Intel DN2800mt x64 2.0.3-2.1 bandwidth
-
I did that from the get go.. standard practice minimizing latency. Hyperthreading is off.. right now as we speak I have both tcp offload engine off, "tried with it on as well"
232Mbps
last pid: 39883; load averages: 0.21, 0.41, 0.24 up 0+00:05:08 23:24:26
113 processes: 3 running, 93 sleeping, 17 waitingMem: 57M Active, 19M Inact, 67M Wired, 284K Cache, 18M Buf, 1806M Free
Swap: 4096M Total, 4096M FreePID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND
11 root 171 ki31 0K 32K CPU0 0 4:12 88.28% [idle{idle: cpu0}]
11 root 171 ki31 0K 32K RUN 1 3:45 83.98% [idle{idle: cpu1}]
0 root -68 0 0K 240K - 0 0:23 9.28% [kernel{em1 que}]
0 root -68 0 0K 240K - 1 0:22 8.40% [kernel{em2 que}]
69333 root 47 0 6956K 1592K select 1 0:09 3.27% /usr/sbin/syslogd -s -c -c -l /var/dhcpd/va
31969 root 76 0 142M 41148K piperd 1 0:07 2.69% /usr/local/bin/php{php}
18343 root 44 0 5780K 1072K piperd 0 0:04 0.49% logger -t pf -p local0.info
0 root -16 0 0K 240K sched 1 0:44 0.00% [kernel{swapper}]
257 root 76 20 6908K 1360K kqread 1 0:18 0.00% /usr/local/sbin/check_reload_status
18245 root 44 0 11748K 2712K bpf 0 0:02 0.00% /usr/sbin/tcpdump -s 256 -v -S -l -n -e -tt
12 root -32 - 0K 272K WAIT 0 0:00 0.00% [intr{swi4: clock}]
14 root -16 - 0K 16K - 0 0:00 0.00% [yarrow]
28465 root 76 0 136M 21540K wait 1 0:00 0.00% /usr/local/bin/php
27988 root 76 0 136M 21540K wait 0 0:00 0.00% /usr/local/bin/php
27735 root 44 0 24220K 3936K kqread 0 0:00 0.00% /usr/local/sbin/lighttpd -f /var/etc/lighty
3 root -8 - 0K 16K - 0 0:00 0.00% [g_up]
59199 root 76 20 8296K 1776K wait 1 0:00 0.00% /bin/sh /var/db/rrd/updaterrd.sh
22760 root 44 0 5780K 1460K select 1 0:00 0.00% /usr/local/sbin/apinger -c /var/etc/apinger -
Really? Hmmmm…
Its good to know all my theories are not off the wall then.Question - How long is this test you run?
Is it long enough to see if HDD is involved in the process?(CPU is largely idle. Its got me looking elsewhere. PCIe is plenty fast)
-
it runs indefinitely until I disconnect.. I'll have my SSD tomorrow, im not sure thought that its touching anything on the HD
-
I'm not sure that it is. Also not sure it isn't. Firewall gets logged. States get logged. There is squid… I'm just interested to see what it would do with SSD. Speaking of SSD, what kind?
-
lemme run downstairs and try swapping cables..
-
cable change did nothing. its a 32Gig Samsung Full height mSata.. rated 520MB/s, I think the 32 gig is a 4channel though so it will probably be around 320MB/s.. I put it on a compeletly separate gig switch too…. I'm gonna put both these computers on the same switch and see if I get the bandwidth i'm looking for.
-
Yep - Being on same physical switch might speed things along. Its a good switch?
-
yep Enterasys b3g124-48.. and yes maxed out the lan link. this is frustrating
-
That is really too nice a rig for a home play toy…
I just picked up a HP V1910-24G 24 port for $30 and I was jumping with joy...
I'm easily happy...
-
My next question might be stupid, so feel free to call me an idiot for asking…
You have no slow painful packages like snort running? No traffic shapers running anywhere?
(asking dumb questions is part of my brainstorming process)
-
That is really too nice a rig for a home play toy…
I just picked up a HP V1910-24G 24 port for $30 and I was jumping with joy...
I'm easily happy...
I found mine on a ebay ad from someone "junking a old business" HAHHAAHAH.. 100 bux shipped. I snatched with the quickness. Of course overkill is always nice.
nope, fresh installation no packages
-
im gonna try reinstalling, not that it would make a difference, perhaps something got screwed up. be back in a few.
-
I found two references to check…
1. reviewing you dmesg output that you have no other device using one of the nic's irqs
2. Try with system > advanced > polling on.
Might as well try before a reinstall....
-
how would I go about checking irq
in bios I have everything extra disabled.
-
ok weird thing, reinstalled cpu0 is showing idle 24% and 11% under load. while cpu1 is sitting 88.77%idle.
could it be misrepresenting cpu idle state after updates? poll is enabled.. sitting 100% idle, or is it the Polling eating cpu? I get same throughput.
also going over dmesg list, Looks like my nic uses irq 17 and 18. 18 is also shared with USB controller.. Let me try disabling all usb no terminal
Just tried changing tool to iperf and netted 193Mbit and 191Mbit on default test. this isn't right. I can't for the life of me figure out why it doesn't saturate cpu or nic. just a little more information. when I run iperf or tamosoft tools, I can still pull 55Mb from my isp. the cpu gets further away from idle when I do. so I dont' know anymore. time for sleep.
-
Are you running 'top -SH' to show all system processes etc?
If you try polling, it's not recommended, make sure it correctly stops polling when you disable it again. I found it sometimes gets 'stuck'. Reboot.
You could try enabling IP fast forwarding in System: Advanced: System Tunables: That usually speeds things up when routing but breaks IPSec so no good if you need that.
Steve
-
Do you have hardware flow control enabled on all the links?
What is the size of the data blocks sent over the wire in your tests? What TCP window sizes are you using? How many concurrent connections are you running?
-
Do you have hardware flow control enabled on all the links?
What is the size of the data blocks sent over the wire in your tests? What TCP window sizes are you using? How many concurrent connections are you running?
iperf's default size 8, MTU 1500. just one connection
There is another pfsense box on the network, configured seperate vlan. I dont think that has anything to do with it though. it passes dhcp and dns to wan side. which iperf server is on that side of the vlan/wan depending if your left handed or right.
vlan side of subject pf, is direct to pc. Flow control is enabled on rx/tx
-
Are you running 'top -SH' to show all system processes etc?
If you try polling, it's not recommended, make sure it correctly stops polling when you disable it again. I found it sometimes gets 'stuck'. Reboot.
You could try enabling IP fast forwarding in System: Advanced: System Tunables: That usually speeds things up when routing but breaks IPSec so no good if you need that.
Steve
yup, i got stuck and had to reboot last night. I'll try the fast forwarding
-
Yeah - I'd read that sometimes polling doesn't work well, but I also figured it can't hurt to try if you are about to wipe and reinstall.
Still didn't get near full network speed huh?
