WebGUI dying under heavy load (Internal Server Error 500 etc.) ?

hoba

Hi.. i´m dealing with the same "problem" and therefore i ask..:

How much hardware do you need to run +80MBit/s througput?

Im getting max. 10MBit/s with my pIII 933/512MB mem and a 3Com 3C982 dual NIC

If i try the m0n0wall with the same HW the result is 22MBit/s ??

Something is wrong here. I'm able to get about 87 mbit/s throughput from one of my C3 1GHz LAN->WAN in factory default configs. If I remove the pfSense I only get about 2 mbit/s more and that is with crappy viarhine onboard nics. Your system should push much more.

lightning

Actually, the throughput should not be measured in Mbits/s but in packets/s (pps), like in routers.

This will be putting better light on the true performance, as the packet size usually matters less than the packet handling overhead.

Typically, with lots of 1500 bytes packets one way, and few 64 bytes ack packets the other way, if you are well below wirespeed, you can take the Mbits/s figure and divide it roughly by 1500*8 to get the pps throughput. e.g. 22 Mbits/s = 1'830 pps.

The true throughput performances are usually made with minimum size packets of 64 bytes, and I would be curious to see some of such performance figures :)

Please don't take this as critisism, pfSense is great work and runs great :)

JesperDJ

hmm wierd..

in bone stock config i get 45MBit/s with m0n0 and 22 with pfSense..

Any ideas?

My HW is P3 933CPU on MSI mainboard, 512MB PC133 SD, and a 3Com Dual NIC 3C982, well, it is the same with 2 Realtek 8139C…

sullrich

FreebSD 6.1 is much slower than 4.11. This is the reason that m0n0wall was hesitant to switch initially. Why they want to switch now is beyond me because its going to slow down every installation.

I would suggest going back to m0n0wall.

JesperDJ

yea but still the m0n0wall isnt doing the job either.. i should be able to get +80MBit througput on my existing hardware…

and the pfSense has some of the features i need

sullrich

Well then it sounds like you need beefier hardware then if you want to stick with pfSense.

JesperDJ

hmm.. ???

hoba wrote:

"Something is wrong here. I'm able to get about 87 mbit/s throughput from one of my C3 1GHz LAN->WAN in factory default configs. If I remove the pfSense I only get about 2 mbit/s more and that is with crappy viarhine onboard nics. Your system should push much more."

sullrich

I can push 40 megabit with a 500 mhz box so I somewhat agree with Holger.

What the exact problem is with your hardware is hard to predict, however.

JesperDJ

hmm yes.. im am trying with the default config, så it must be the HW.. im gonna try another machine tommorow then..

Thanks so far :)

JesperDJ

Ok.. the results with the new HW

HW: P4 2,5Ghz, 256MB DDR2, Onboard GB NICs

Config: 100% default

pfSense:
Max speed = 60MBit/s
Payload = 100%
System unstabel!
WebGUI = unreachable

m0n0wall:
Max speed = 85MBit/s (the switch couldt handle more, trying another GB Switch tommorrow)
Payload = 30%
System very stabel!
WebGUI = 100% functioning

seems 2 me that pfSense has a problem?

sullrich

You are not specifying which type of NICS. Please specify your NIC types.

databeestje

So far I have been able to push ~400Mbps through a dual port Intel GigE in a P3 1Ghz and 22Mbits+ through a via rhine(vr0)/3com 2000-T (sk0) combination on a Via Eden 933.

Then again, I have not been trying to access the webgui.
A p3 1Ghz doing 400Mbits is about ~55% interrupt. So that one doesn't die from load.

The Via with 22Mbits and a traffic shaper was pretty loaded but the queues page at 22Mbits was still accessible.

One point of thought though. This testing was performed somewhere in the pre RC1-ish days.
I have not ran benchmarks one rc2 and above yet.

Something may indeed be amiss.

JesperDJ

@sullrich, actually that isnt important in this case, i have tryied with 3Coms, Realteks & Onboards both 100MBits and 1GBits.. the difference is less than 2MBit/s when im using pfSense..

But if you need the exect type of NICs, please let me know.

The interrupt is 99/100% when pfSense is doing 60MBit/s on my actual system.. wich was; P4 2,5Ghz, 256MB DDR2

and perhaps your (databeestje) results where on some RC1-ish, but in my oppinion the newer version shouldnt be slower?

sullrich

This is a known problem. I've posted to the freebsd lists but nobody has responded yet.

JesperDJ

I have now tryied with a different setup:

pfSense testet with:

Motherboard: MSI MS-6723
CPU P3 933Mhz
Memory: 256MB SD DDR 400
NICs: Realtek 8139

Now i was able to get aproxx 96MBit (i guess the NICs couldnt handle more…)
Interrupt load was 83%.. leaving the system 100% stable and accessable..

maybe the other HW wasnt 100% compatible with pfSense.. or?

is there any recommandations wich HW to use ie. wich chipset, cpu, mem, nics etc?

rsw686

Thats interesting you and databeestje both had good throughput on a P3 system. Your P4 box didn't work as well. Wonder if its the processor or the NIC cards.

sullrich

That is VERY interesting that you are able to saturate the ethernet and access the system with different nics. That makes me wonder.

JesperDJ

@sullrich, i didnt understand your answer?

hoba

It's just interesting that there was such a difference between your setups. From the tests we did with different hardware/nics it looks like the problem always occurs when cpu is going to 100% no matter what hardware we used. Some nics will reach the 100% level sooner or later due to causing more or less cpu load at the same system but the problem was more or less always the same.

JesperDJ

I belive that the difference in througput was so different becouse the drivers wasnt correct.

I have tryed Celeron 633-S370/P3 933-S370 with good performance and with bad, depending on the motherboard, and the same with P4/C4 systems,
but in any case the type of NIC´s wasnt important.. the diffenrence between a Realtek 8139 and 3Com/Intel etc. was below 2-3MBit/s

Thats why i ask:

What HW is the best to use? What is pfSense written to?

Im no router/pc newbie, but i am pretty new in *nix environment..