Zotac ZBOX CI323 nano
-
Hi-
I too am looking at purchasing this box for my first pfsense router… 2 NICs, 4 cores, AES-NI support for OpenVPN, and inexpensive, make it very attractive (at least to me).
What about Wifi?
Have you tested OpenVPN throughput?
Anything more you could provide on the Zotac ZBOX CI323 would be greatly appreciated.
Thanks,
Bob -
I bought the box with something different in mind, so I haven´t built and measured VPNs yet. So sorry, no direct answer :)
Wireless does not seem to be supported at the moment, but I honestly didn´t try very much and will pull the wireless cards out anyway - in my case I use it cable based only.
What I did though is run a hypervisor on it and then have pfsense in a vm. Reason for this is twofold: First, instant firewall recovery by using a cloned VM, second: Utilizing the hardware (8GB, 4 cores) to run a second or third VM as syslog server or a dedicated separate security box. Just in case something is not available as a package yet or for trying stuff out, like the Sophos UTM for example, while keeping the main firewall running and untouched.
ESXi is a nightmare and soooo picky about hardware, it didnt´t install and I spent quite some time. That does not say much, but I gave up after trying most tips I found online.
Xen seems to work so far, 2 days uptime with no issues. However, I am unable to pass VLANs into pfsense, as the NICs are seen as xn0 instead em0. Not a big issue as long as we´re talking 7 VLANs or less, as one creates one xn interface per vlan on the hypervisor, so the pfsense box sees just native, untagged frames.
So yes, running pfsense on this box is very well possible minus the wifi, but that´s from someone who has no interest in fixing the wireless part, there may be ways to get there.
-
Thanks for the response… very interesting. One more question:
I can't seem to find what chipset the Gigabit ethernet cards use. I've looked a lot of places. It seems to be a Realtek card but I can't find a model number. I see you mention xn0 but that's a FreeBSD Xen NIC driver if I'm not mistaken...
Do you know what model it is?
Regardless, I just ordered one and of course, it's on backorder >:(
Regardless, thanks for the response and I hope you Xen install continues to be a solid one...
Bob
-
Yes it´s a realtek, using lspci form the xenserver console i see that they are recognized as
Realtek RTL8111/8168/8411
Xen uses kernel driver r8169 to access these devices.
While we´re at it, lspci also finds the wireless card as an intel wireless 3160 but doesn´t use it as a NIC from a xenserver perspective.
I will double check that from a bare metal pfsense installation and see what BSD makes of the hardware, but that will happen a few days down the road.
-
Hey guys,
I'm about to take the plunge on this little box to build my own router and replace a TP-Link N750.
Any news on the wifi, usb 3, bluetooth and cardreader?
Thanks!
-
To my shame I never continued to work in that direction, as my setup does not use anything but the cable-based NICs.
What I can say is that a config with Xenserver as the HostOS and pfsense on one of the VMs runs stable for about 4 weeks now, so unless you need WiFi, I´d recommend the box.
-
-
The card reader does not work on 10.2 or 11
-
I've installed the OS from a USB3 stick, so that works
-
It's got enough power to compile your packages from ports or a kernel
There is one big caveat though: The NICs give up under load if you're using netmap. So you can't use that box as-is if you want to do IPs with Suricata until Suricata gets fixed to work with drivers which don't support netmap.
-
-
-
The card reader does not work on 10.2 or 11
-
I've installed the OS from a USB3 stick, so that works
-
It's got enough power to compile your packages from ports or a kernel
There is one big caveat though: The NICs give up under load if you're using netmap. So you can't use that box as-is if you want to do IPs with Suricata until Suricata gets fixed to work with drivers which don't support netmap.
As an alternative, you can wait until the drivers do support netmap. From the netmap website:
Netmap-aware device drivers are needed to use netmap at high speed on ethernet ports. To date, we have support for Intel ixgbe (10G), ixl (10/40G), e1000/e1000e/igb (1G), Realtek 8169 (1G) and Nvidia (1G). FreeBSD has also native netmap support in the Chelsio 10/40G cards.
I'm not sure what all is required for netmap support for Realtek RTL8111/8168/8411 versus Realtek 8169, but this could be a "simple" coding project for someone with the time if there are enough similarities between the 8168 and the 8169 drivers.
-
-
I may stand corrected. I just browsed the Realtek driver and netmap driver code in the FreeBSD stable branch. It looks like all versions of the Realtek gigabit chipsets are are supported by netmap in FreeBSD.
-
;)
That's correct, it's been "supported" from the start. If you read the code, you can see that performance is more akin to a half-gigabit NIC.The lock up problem has been reported upstream and since there is sort of a workaround by using jumbo frames, I have hope it's something which can be fixed.
-
;)
That's correct, it's been "supported" from the start. If you read the code, you can see that performance is more akin to a half-gigabit NIC.The lock up problem has been reported upstream and since there is sort of a workaround by using jumbo frames, I have hope it's something which can be fixed.
Unfortunately, my working knowledge of BSD driver code is good enough to tell if a feature is enable, but not good enough to see that performance with netmap is around ~500 Mb/s instead of 1Gb/s. Why is there such a performance hit for the Realtek using netmap?
A second question – why does the Realtek lock up? And what is it about jumbo frames the keeps the Realtek from locking up? And, more importantly, would I have to enable jumbo frames for my entire network, or just on the Realtek interface of this particular device in order to prevent the lockup from happening?
-
Why is there such a performance hit for the Realtek using netmap?
I don't think it's related to netmap, it's either the chip or the driver, because of badly designed chips, bad documentation, bad original driver (because of bad documentation), etc.
A second question – why does the Realtek lock up? And what is it about jumbo frames the keeps the Realtek from locking up? And, more importantly, would I have to enable jumbo frames for my entire network, or just on the Realtek interface of this particular device in order to prevent the lockup from happening?
My theory is that netmap overfills the card's buffer and at some point the card can't cope any more and we end up with interrupts piling up.
By turning on jumbo frames, the total number of mbufs is split equally between the 2 types of frames and the card only almost dies (dropping from 350kpps to less than a 100).
Ideally, you'd need all your network to support 9k frames to be able to see the benefits, but if you just want the fix, you can just turn it on for the LAN interface. There will be side effects and so, you should read about what happens when using large frames with equipment which doesn't support it. -
If jumbo frames don't work for you, you can use the emulated mode by setting "dev.netmap.admode" to 2. In my tests, I get the same throughput, but use a lot more CPU.
-
Interesting. Have you tested the same chip with another OS that supports netmap? I know Linux has different drivers and supports netmap. If Linux exhibits the same or similar behavior, then the problem is with the chip itself most likely. If Linux runs better, then the problem is probably with the BSD code (and likely fixable).
-
Interesting. Have you tested the same chip with another OS that supports netmap? I know Linux has different drivers and supports netmap. If Linux exhibits the same or similar behavior, then the problem is with the chip itself most likely. If Linux runs better, then the problem is probably with the BSD code (and likely fixable).
Not yet. I need to boot into IPFire or something and apply the same pkt-gen test
-
Interesting. Have you tested the same chip with another OS that supports netmap? I know Linux has different drivers and supports netmap. If Linux exhibits the same or similar behavior, then the problem is with the chip itself most likely. If Linux runs better, then the problem is probably with the BSD code (and likely fixable).
Not yet. I need to boot into IPFire or something and apply the same pkt-gen test
Well, if you end up testing it out, let me know. I would be interested in the results. I just bought one of these things to use as my first PFSense box, but am a little concerned after reading this thread. But maybe I shouldn't be since I was planning on using Snort instead of Suratica (unless Snort uses netmap also and I am just unaware).
-
netmap is the future, for IPS or just packet forwarding with netmap-fw. I'm sure the problem will be fixed eventually. It could simply be a problem with the 8111G revision. FreeNAS users had similar issues a few years back and were forced to use the Realtek drivers while waiting for a fix, so I think it will just be a matter of being patient (or paying someone to fix the problem).
-
I've bought the same Zbox (CI323). I would like to do the same thing: Install XenServer and install pfSense or rather Sophos UTM in a VM.
However, I've a probably simple (noob) question: When you install XenServer, you need to specify an IP address etc. But the VM inside this machine is going to be my router, so how is that going to work?
Can anybody help me?
-
Not sure. But this question is probably better answered by the guys who hang out in the Virtualization sub-thread. Those guys use Xen-Server and VMWare all the time.
-
Thanks a lot! I've a look at that!