25 GbE network card for PFsense 2.7
-
@Amodin Preferable SFP+ / SFP 28
-
There are a few reports of high througputs here with Mellanox NICs. Also using the Intel e800 series, ice(4) driver.
-
@Jakub_ said in 25 GbE network card for PFsense 2.7:
@Amodin Preferable SFP+ / SFP 28
As was mentioned, I have heard good things about Mellanox, and if you are an avid Amazon shopper, it's on there as well - so far showing the only one with that much throughput on SFP. I haven't personally used the product, as I tend to stick with Intel-based, but I don't recall them having an affordable product for what you are referring to...
Now their i225-V chipsets I wouldn't touch with a 50ft pole....
-
Thanks guys,
So I can order two pieces (I need 4 interfaces)
Intel E810-XXVDA2 without worrying about compatibility issues ? Alternatively which Mellanox do you recommend ? -
Check this thread: https://forum.netgate.com/topic/182079/help-with-25g-speeds-on-ha-pfsense-routers-lacp-using-mellanox-connectx-5-nic
Though actually passing traffic at those speeds still surprises me.
-
@stephenw10 said in 25 GbE network card for PFsense 2.7:
Though actually passing traffic at those speeds still surprises me.
He is probably using 9000 MTU; you only need to process 350k packets per second to hit 25Gb/s at 9000 MTU.
I've ran some rudimentary test using iperf3 and only managed to reach 1.4M packet per second using 4 out of 6 cores of an i5 12500. 2 virtual functions from different connectx-4 lx physical functions was used as the NIC,
-
@stephenw10
Hi again guys !
Finally purchased four Mallonix MCX512A cards, PCIe3.0 x 8 ( R250 riser limit is two PCI 8x ).
I made some tests. R250 (with two MCX512) to R250 (with two MCX512).
1 to 1 25GbE :
and LAGG 3x 25GbE:
Enjoy :)
Jakub. -
Nice! What CPU is that using?
And is that with jumboframes?
-
@stephenw10
Intel(R) Xeon(R) E-2356G CPU @ 3.20GHz / 32GB RAM.
Yes, with jumbo frames. -
@Jakub_ are you seeing these kind of performance numbers real world too or just iperf?
I know slightly older thread, but was curious if anyone had really seen much more than 10 ish gigabit through pfSense. Been working on planning a new firewall build for myself as my Netgate 6100 just can't keep up with my 8 gigabit WAN (didn't expect it to) and been debating if I should aim for something with 25 gig adapters for "future proofing" but am not sure if it's remotely worth it. Current plan is a Xeon 2146NT since it has QAT built in which I do care about.
-
@planedrop
The solution has been deployed in production, but we still have not transferred all the data streams, so I can boast of much lower results, while the 25GbE cards are working stable.
When I have an average load > 10GbE I will post.
-
@planedrop said in 25 GbE network card for PFsense 2.7:
I know slightly older thread, but was curious if anyone had really seen much more than 10 ish gigabit through pfSense.
Often users are installing router and/or firewalls internal of their networks
so no WAN/LAN but more LA/LAN traffic may be here the factor for higher
traffic. And by side this is a nearly ~400 € CPU with max. 5GHz 6C/12T
and plenty of RAM for buffering. -
@Jakub_ Sweet, this is at least a good start, appreciate the follow ups!