PC Engines APU4C4 Experience
-
Hi
What Version of Bios do you think should i choose ?
-
@gtrdriver said in PC Engines APU4C4 Experience:
Hi
What Version of Bios do you think should i choose ?
You could give the legacy Bios 4.0.28 or mainline Bios prior to 4.10.0 a try - the versions above contain some significant changes that may interfere with your other hardware.
IMHO,
fireodo -
Hi
i have created a bootable Debian Stick - and tryed this
BIOS version v4.9.0.7
With this Bios Version Pfsense Seem to boot correctly - i will test.
-
@gtrdriver said in PC Engines APU4C4 Experience:
Hi,BIOS version v4.9.0.7
should be fine ...
With this Bios Version Pfsense Seem to boot correctly - i will test.
it would be helpful if you let us know what kind of SSD/HDD you use for you pfsense installation and if there is also other hardware (wireless etc.).
Regards,
fireodo -
Hi
i use a Plain APU4c4 Device without Wireless - only the 4 NIC´s
I also use the "original" SSD Device wich comes within the Bundle.There is no Vendor on the Delivered Msata SSD so i think its bulk
-
@gtrdriver said in PC Engines APU4C4 Experience:
Hi
i use a Plain APU4c4 Device without Wireless - only the 4 NIC´s
I also use the "original" SSD Device wich comes within the Bundle.There is no Vendor on the Delivered Msata SSD so i think its bulk
OK, thanks - those SSDs that come with the APU4 shouldnt make any trouble, but there is always a "but" possible ...
-
Hi
i also see that this Boards can be rund with a SD Card
Does there exist eny long Time exp whats better SD or SSD ?
I use SD on some Raspberry Projekts - no Problems at all ... -
@gtrdriver said in PC Engines APU4C4 Experience:
Hi
i also see that this Boards can be rund with a SD Card
Does there exist eny long Time exp whats better SD or SSD ?
I use SD on some Raspberry Projekts - no Problems at all ...SSD is the better alternative. The SD-Card is slower and if you have packages like squid or other, write intensive, packages a SD-Card would not be a good choice because of limited write cycles. In fact it depends how you intend to use pfsense.
-
@gtrdriver said in PC Engines APU4C4 Experience:
What Version of Bios do you think should i choose ?
I upgraded one to v4.10.0.1 three weeks ago. There wasn't any issue since then.
-
@gtrdriver Looking at the error message again... could there be an issue with the partition? Did you remove the existing partitions and try a clean installation?
I did read about the attempt to reinstall in your comment - but it once happened to me that I accidentally didn't boot from the USB stick but straight from the SSD... It looked like I was booting from USB but I wasn't. This happend after a power issue some time ago.
I am running BIOS 10.0.0. I am using one of those mSATA SSDs of 16 GB.
-
Hi
First of all - im sure that this happen on USB Boot !
I tryed this 5 Fimes and for security i created a new USB Media ...Perhaps The Installer "see" the bad Partition and Crash - dont know ...
Booting from the Debian Live Stick worked fine - then downgraded Bios and Attemp new Boot works fine then ... (Still with the bad parition ...)
So - after all - im nocht 100% sure but 95% ...
Second:
After some Tests im realy Impressed about this box:
Here we have 2 100Mbit VDSL Modems and use Wan1 and Wan2 with Load Balancing - works fine.
But more Impressed im about the OpenVPN PerformanceI use the Box to Connect to a Virtialised PFSENSE (Fat Host Hardware) in a DataCenter for S2S VPN
Do some Tests with Iperf:
85Mbit Down / 32Mbit Up in TcpIp Mode
88Mbit Down / 34Mbit Up in UDP ModeI think when i put the Overhead of OpenVPN to this results im Near to the Max Cap of one of our Lines (and we dont get 100/40mbit - i think its 98/36Mbit)
The Results are Steady even after much more Tests.
The Best thing is that in Real User Practise (We use RDP 8.x to Connect to Remote Windows Server in Datacenter i can Stream a Youtube Video over RDP in Fullscreen with arround 40-60Mbit/s over VPN in UDP Mode without any Issues
And RDP is not the Best Way to Stream a video ...This is not our Business Case but when a Fullscreen Video run Smooth than 15 RDP Workers can run Office and Craphical Tools smooth over a simple 100Mbit Connection with VPN.
With our old Hardware we had Dropouts on such Payloads.
Now i Hope this Kind of Box runs stable....
-
@gtrdriver
That is a filesystem error. Almost certainly nothing to do with the Coreboot update.https://docs.netgate.com/pfsense/en/latest/hardware/troubleshooting-disk-check-errors-fsck.html#manually-run-fsck
Steve
-
Just a hint:
To the best of my knowledge the APU family has no power button, but from time to time one has to power down, certainly after a bios update, as this is highly recommended. I have encountered many that power down using the power cord, which is understandable, but this may result in file system damage. The best way is to use the "Halt System" option in the GUI and wait until the system is powered down fully. It can take up to 5 minutes until all LED's are off, but this way you are certain that the system powers down gracefully.
-
Hi
I think (but don't know) that this is one of the differences to their own negate devices (special arm)
I think they use other file system methods to avoid this. (Ro temp and so on....)
I also think not every power loss will END ON A damaged file system.
Here I use usv ....
Does anyone know if those apu devices have a watchdog which works with pfsense ?
Or does the original arm netgate devices have a watchdog ?
In terms of price this kind of apu devices are same price as the sg1100
If I'm understand right the sg1100 have also a 2.5gbps backplate for the 3 Ethernet devices ...
-
One of the things I personally like about the APU is that they use Intel NIC's
https://pcengines.ch/apu2.htm
-
Personaly i agree but I think if you have original pfsense hardware I think this should also be stable
-
Such filesystem errors due to power outage seem to occur with UFS only.
Install pfSense with ZFS and you will be relaxed. That was recommended here already many times. -
@viragomann Please see the following excellent document: https://teklager.se/en/knowledge-base/pfsense-ufs-filesystem-corruption-after-power-loss/
-
@bouke
I agree with that. That affirms what I wrote above.ZFS seems to be very robust against power outage (incomplete write processes). I'm running pfSense on ZFS at home for almost two years and had recently multiple power outage due to a fault device a week ago with no effect to pfSense. It boots up and does its job every time when the power come back.
-
Did a
/root: fstyp -l /dev/gptid/091891e1-98b3-11e8-9310-000db9416710 ufs
Bummer, seems I did not choose ZFS during install
-
Yes, try to halt the box before powering off (unmount the filesystem) if you can.
If you are installing somewhere that cannot guaranty power stability then I suggest moving /var and /tmp to RAM drives minimising drive writes and therefore the chances of writing a critical file when power is lost.
Steve
-
Is there any reason why Auto (UFS) Guided Disk Setup is on top in the partitioning setup and Auto(ZFS) Guided Root-on-ZFS is way below in the pfSense Installer, as most will enter through the setup and thus choose the first?
-
That Question ist very Interesting.
-
UFS is the supported install type at this time. It's likely we will move to ZFS as the default at some point but currectly the vast majority of installs are UFS and that's what we test against.
I'm not aware of any issues with ZFS though, I have several boxes running that.Steve
-
Thanks Steve, from what I remember UFS is the default Unix file system and ZFS is open source, but that's al I know, as I have more experience with ext3/4. So as those filesystems are a bit out of my wheelhouse, is there anything to say pro or contra, apart from the "auto repairing" that ZFS seems to have, when using a 16GB SSD durable and fast Solid state drive?
-
Well not much beyond UFS is far more tested and uses less resouces. ZFS uses significantly more resources but is far better at recovering from data loss or not losing it in the first place!
I'm far from an expert there either.Steve
-
Hello
I just made some tests today - on APU Board with a mSata ZFS Installation works like a Charm - fine !
I also Tryed to install ZFS VErsion on a APU Board with a SD Card and here it seem that ZFS dont work - is that possible ?
The ZFS Installer report a Error - but no more ...Installation on SD witz Default UFS runs fine ...
-
Not sure I've ever tried that. What size/type of card? What was the error?
Steve
-
@gtrdriver said in PC Engines APU4C4 Experience:
Hello
I just made some tests today - on APU Board with a mSata ZFS Installation works like a Charm - fine !
I also Tryed to install ZFS VErsion on a APU Board with a SD Card and here it seem that ZFS dont work - is that possible ?
The ZFS Installer report a Error - but no more ...Installation on SD witz Default UFS runs fine ...
I would not recommend to use a SD card like this. My estimated guess is that the SD card will wear out very soon if you are able to format it ZFS. That said: I guess the SD card is too slow compared to an SSD. I would UFS format it and use RAM disk. On the other hand: a RAM disk isn't really feasible with 4GB RAM.
I would stick with an SSD. I normally format these UFS if there's a UPS available. I will format ZFS if there isn't any.
-
I installed pfSense with ZFS on an APU4C4 on a 16 GB mSATA. Works without issues.
-
@viragomann said in PC Engines APU4C4 Experience:
I installed pfSense with ZFS on an APU4C4 on a 16 GB mSATA. Works without issues.
So have I too but on two APU2C0 one with a Zheino 16GB SSD and on the other on a Transcend 32GB - no issues so far ...
-
Hello
Regarding ZFS on SD: There is no specific Error - the Installer Says:
ZFS setup failed x
x x
x An installation step has been aborted. Would x
x you like to restart the installation or exit x
x the installer? x
tqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq -
Ideally, ZFS requires a system with ECC memory, otherwise you're still not 100% safeguarded against bit errors..
I read that https://pcengines.ch/apu2.htm ECC is optional, can some comment on that?
-
From what I've read https://blog.3mdeb.com/2018/2018-10-16-enabling-ecc-on-pc-engines-apu2/ every APU2 equal and above 4GB memory it is enabled....
-
Recently I went over to from UFS to ZFS on a APU2C4 (RAM 4GB) with mSATA 16Gb, fresh install from USB then I restored the config.xml. I have a few Q's maybe someone can help, log file below...
[1+ Disks] Striping provides maximum storage but no redundancy pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqqqqqqqqZFS Configurationqqqqqqqqqqqqqqqqqqqk x Configure Options: x x lqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqk x x x >>> Install Proceed with Installation x x x x T Pool Type/Disks: stripe: 0 disks x x x x - Rescan Devices * x x x x - Disk Info * x x x x N Pool Name zroot x x x x 4 Force 4K Sectors? YES x x x x E Encrypt Disks? NO x x x x P Partition Scheme GPT (BIOS) x x x x S Swap Size 2g x x x x M Mirror Swap? NO x x x x W Encrypt Swap? NO x x x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj x tqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqu x <Select> <Cancel> x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj Create ZFS boot pool with displayed options pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqqqqqZFS Configurationqqqqqqqqqqqqqqqk x Select Virtual Device type: x x lqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqk x x x stripe Stripe - No Redundancy x x x x mirror Mirror - n-Way Mirroring x x x x raid10 RAID 1+0 - n x 2-Way Mirrors x x x x raidz1 RAID-Z1 - Single Redundant RAID x x x x raidz2 RAID-Z2 - Double Redundant RAID x x x x raidz3 RAID-Z3 - Triple Redundant RAID x x x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj x tqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqu x < OK > <Cancel> x mqqqqqqqq[Press arrows, TAB or ENTER]qqqqqqqqqj [1+ Disks] Striping provides maximum storage but no redundancy pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqZFS Configurationqqqqqqqqqqk x lqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqk x x x[*] ada0 SATA SSD x x x x[ ] da0 VendorCo ProductCode x x x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj x tqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqu x < OK > < Back > x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqqqqqqZFS Configurationqqqqqqqqqqqqqqqqqk x Last Chance! Are you sure you want to destroy x x the current contents of the following disks: x x x x ada0 x x x tqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqu x < YES > < NO > x mqqqqqqqqq[Press arrows, TAB or ENTER]qqqqqqqqqqqj ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) kern.geom.part.mbr.enforce_chs: 0 -> 0 pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqqFetching Distributionqqqqqqqqqqqqk x x x MANIFEST [ Done ] x x base.txz [ 100% ] x x x x Fetching distribution files... x x x x lqOverall Progressqqqqqqqqqqqqqqqqqqqqk x x x 100% x x x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqqChecksum Verificationqqqqqqqqqqqqk x x x base.txz [In Progress ] x x x x Verifying checksums of selected x x distributions. x x x x lqOverall Progressqqqqqqqqqqqqqqqqqqqqk x x x 0% x x x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqk x Checking distribution archives. x x Please wait... x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqArchive Extractionqqqqqqqqqk x Extracting distribution files... x x x x x x Overall Progress: x x lqqqqqqqqqqqqqqqqqqqqqqqqqqqqk x x x 100% x x x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqj x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj Looking for config.xml on da0s3: [found msdos] [no config.xml on da0s3, unmounting] diskid/DISK-920702597E285218784s3: [Could not locate an existing config.xml file!] Done. pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqManual Configurationqqqqqqqqqqk x The installation is now finished. x x Before exiting the installer, would x x you like to open a shell in the new x x system to make any final manual x x modifications? x tqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqu x < Yes > < No > x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqj pfSense Installer qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq lqqqqqqqqqCompleteqqqqqqqqqqqk x Installation of pfSense x x complete! Would you like x x to reboot into the x x installed system now? x tqqqqqqqqqqqqqqqqqqqqqqqqqqqqu x <Reboot> <Shell > x mqqqqqqqqqqqqqqqqqqqqqqqqqqqqj Nov 6 10:28:00 reboot: rebooted by root Nov 6 10:28:00 Waiting (max 60 seconds) for system process `vnlru' to stop... done Waiting (max 60 seconds) for system process `bufdaemon' to stop... done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining... 0 0 done All buffers synced. Uptime: 26m58s umass0: detached uhub2: detached PC Engines apu2 coreboot build 20190810 BIOS version v4.10.0.2 4080 MB ECC DRAM SeaBIOS (version rel-1.12.1.3-0-g300e8b7) Press F10 key now for boot menu Booting from Hard Disk... Boot failed: could not read the boot disk Trying next device: 2 Booting from Hard Disk... gptzfsboot: error 12 lba 32 gptzfsboot: error 12 lba 544 gptzfsboot: error 12 lba 1965088 gptzfsboot: error 12 lba 1965600 gptzfsboot: error 12 lba 1966072 gptzfsboot: error 12 lba 1 /boot/config: -S115200 -h Consoles: serial port BIOS drive C: is disk0 BIOS drive D: is disk1 read 1 from 0 to 0xcdf89440, error: 0xcread 1 from 0 to 0xcdf89440, error: 0xcBy FreeBSD/x86 ZFS enabled bootstrap loader, Revision 1.1 (Wed Nov 21 08:03:10 EST 2018 root@buildbot2.nyi.netgate.com) Loading /boot/defaults/loader.conf - __ _ __ / _|___ ___ _ __ ___ ___ | '_ \| |_/ __|/ _ \ '_ \/ __|/ _ \ | |_) | _\__ \ __/ | | \__ \ __/ | .__/|_| |___/\___|_| |_|___/\___| |_| +============Welcome to pfSense===========+ __________________________ | | / ___\ | 1. Boot Multi User [Enter] | | /` | 2. Boot [S]ingle User | | / :-| | 3. [Esc]ape to loader prompt | | _________ ___/ /_ | | 4. Reboot | | /` ____ / /__ ___/ | | | | / / / / / / | | Options: | | / /___/ / / / | | 5. [K]ernel: kernel (1 of 2) | | / ______/ / / | | 6. Configure Boot [O]ptions... | |/ / / / | | 7. Select Boot [E]nvironment... | / /___/ | | | / | | | /_________________________/ +=========================================+ /boot/kernel/kernel text=0x17c1930 data=0xb93d38+0x557b28 syms=[0x8+0x197400+0x] /boot/entropy size=0x1000 /boot/kernel/zfs.ko size 0x3821b0 at 0x2fde000 loading required module 'opensolaris' /boot/kernel/opensolaris.ko size 0xa3b0 at 0x3361000
First Q
As you can see, there are a few error on first boot (did not see them at second boot)
gptzfsboot: error 12 lba 32
gptzfsboot: error 12 lba 544
gptzfsboot: error 12 lba 1965088
gptzfsboot: error 12 lba 1965600
gptzfsboot: error 12 lba 1966072
gptzfsboot: error 12 lba 1What are they?
Second Q
The log mentioned
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
kern.geom.part.mbr.enforce_chs: 0 -> 0
pfSense InstallerAs the APU2C4 has 4Gb memory, do I have to adjust it (see loader.conf below) and what does it bring?
[2.4.4-RELEASE][root@pfSense.localdomain]/boot: cat loader.conf kern.cam.boot_delay=10000 kern.ipc.nmbclusters="1000000" kern.ipc.nmbjumbop="524288" kern.ipc.nmbjumbo9="524288" kern.geom.label.disk_ident.enable="0" kern.geom.label.gptid.enable="0" zfs_load="YES" boot_serial="YES" console="comconsole" comconsole_speed="115200" autoboot_delay="3" hw.usb.no_pf="1"
Third Q
Why does fstyp still mention UFS?
[2.4.4-RELEASE][root@pfSense.localdomain]/root: df -h Filesystem Size Used Avail Capacity Mounted on zroot/ROOT/default 12G 487M 11G 4% / devfs 1.0K 1.0K 0B 100% /dev zroot/tmp 11G 2.9M 11G 0% /tmp zroot/var 12G 150M 11G 1% /var zroot 11G 88K 11G 0% /zroot /dev/md0 3.4M 148K 3.0M 5% /var/run devfs 1.0K 1.0K 0B 100% /var/dhcpd/dev /lib 12G 487M 11G 4% /var/unbound/lib devfs 1.0K 1.0K 0B 100% /var/unbound/dev /var/log/pfblockerng 12G 150M 11G 1% /var/unbound/var/log/pfblockerng /usr/local/share/GeoIP 12G 487M 11G 4% /var/unbound/usr/local/share/GeoIP /usr/local/bin 12G 487M 11G 4% /var/unbound/usr/local/bin /usr/local/lib 12G 487M 11G 4% /var/unbound/usr/local/lib [2.4.4-RELEASE][root@pfSense.localdomain]/root: fstyp -l /dev/md0 ufs
Fourth Q
From what I read TRIM is enabled on ZFS, but how can I check it? ...
[2.4.4-RELEASE][root@pfSense.localdomain]/root: tunefs -p / tunefs: /: could not open special device
Thanks for any help
Cheers Qinn
-
-
Looks like some problem with the GPT header that it was able to recover. Of you don't see it again then it's likely been fixed at the first boot.
-
You don't have to set that. It would probably only be a marginal drive performance increase and disk performance is not hugely important for pfSense. If you do choose to set it put it in /boot/loader.conf.local to avoid it being overwritten.
-
Ram drives are still formatted UFS.
-
No idea.
Steve
-
-
Thanks Steve, would it be wise to set ( then maybe I have data redundancy, but not disk redundancy)
zfs set copies=2 yourpoolname
BTW I hope that anyone can shed a light on TRIM?
-
That's not something I've ever tried. If you have the space I guess it makes sense. It would double the writes to the drive though.
-
@Qinn said in PC Engines APU4C4 Experience:
BTW I hope that anyone can shed a light on TRIM?
What is the output of
sysctl vfs.zfs.trim
You should see something like:
[2.4.4-RELEASE] [root@b..]/root: sysctl vfs.zfs.trim vfs.zfs.trim.max_interval: 1 vfs.zfs.trim.timeout: 30 vfs.zfs.trim.txg_delay: 32 vfs.zfs.trim.enabled: 1 [2.4.4-RELEASE] [root@b..]/root:
vfs.zfs.trim.enabled: 1 means TRIM is enabled.
-
Thanks @bigsy
[2.4.4-RELEASE][root@pfSense.localdomain]/root: sysctl vfs.zfs.trim vfs.zfs.trim.max_interval: 1 vfs.zfs.trim.timeout: 30 vfs.zfs.trim.txg_delay: 32 vfs.zfs.trim.enabled: 1
Did not change anything after install, seems @doktornotor was right https://forum.netgate.com/topic/84867/2-2-x-zfs-full-install-howto/9
Also here https://www.freebsd.org/doc/en_US.ISO8859-1/books/faq/all-about-zfs.html
Nice thread here https://forum.netgate.com/topic/112490/how-to-2-4-0-zfs-install-ram-disk-hot-spare-snapshot-resilver-root-drive from @pfBasic every command uses "yourpoolname" although I think it's in most cases "zroot" is there anyway to check, it seems he did not mentioned it.
For now I used :
[2.4.4-RELEASE][root@pfSense.localdomain]/root: zpool status pool: zroot state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 errors: No known data errors
btw whats ada0p3 and why is the ram drive on UFS?