To do 25.07 or not?! That is the question!
-
Are you using RAM disks?
Also can we assume you mean a 4200 upgraded from 24.11 to 25.07.1?
-
@stephenw10 no, I don't use RAM disks.
Yes, 4200, not 4300. I've edited that.
-
@Mission-Ghost said in To do 25.07 or not?! That is the question!:
from 24.07 to 25.11
And I assume that is also a typo?
-
@stephenw10 yes, 24.11 to 25.07.1...jeez I'm losing my marble.
I had months of usage measurements and now they're gone:
Before the upgrade, I removed the status_traffic_totals package in accordance with the best practices, and after I added it back. I did not see nor choose any other options. Other packages, like cron, email reports and pfBlocker retained all their configurations and data.
-
Hmm, I'm not sure Traffic Totals does back it up. That would be a lot of data in the config. The RRD data is not saved by default.
Do you have a BE you can roll back to to get the data?
-
@stephenw10, I'm not sure either. I didn't use or restore a backup. I did a normal in-place ZFS upgrade.
If I had not removed the package, the data should have stayed in the BE and not been a factor in terms of being 'a lot of data in the config'?
But, logically then, It seems removing the package deleted the data with it, unlike other packages normal expected behaior. (It does occur to me that the config may have been saved; right away in v25 it retained the selection of the two WANs for display. I did not have to restore that after the upgrade. So maybe it did delete just the data and not the config?)
It may not be worth the effort to migrate the data back from v24 to v25, but it is useful for me and the record to know that the package manager/the package/pfSense apparently does not save this particular package's data like the other packages or as implied in the upgrade instructions. Unless this is actually a bug and should not have happened. I'd be interested in knowing which is true.
So, is it reasonable to leave the status_traffic_totals package in place during the next upgrade and only remove the other packages, given I want to retain the data?
Should this discrepancy in the behavior of this package compared with the others and the upgrade instructions be documented somewhere or, if it's a bug, fix it?
-
Yes, I would leave Traffic Totals installed across an upgrade. It's not a 'heavy' package that might consume enough resources to cause a problem at upgrade. I run it here and never remove it.
In fact in general it should not be necessary to remove any packages. I upgrade with Snort and pfBlocker installed and don't see problems. I would advise removing high resource packages (snort, suricata, pfblocker, squid) if you see or have seen problems upgrading.
If you're running ZFS in Plus then it will have created a new BE at upgrade. You can try rolling back to it and checking /var/db/vnstat
-
I noticed that pfSense upgrades randomly messed Traffic Totals data, though it was way back in 2.4.x time.
I started using the Backup (Backup File/Dir) package to backup RRD/vnstat databases before upgrades. -
@stephenw10 thank you for your thoughtful responses.
It should not be necessary yet, if I recall correctly, Netgate recommends it in the documentation. Perhaps more nuance is needed in the instructions or more checks by the upgrade modules to handle resource constraints better during the process.
For instance, maybe I still need to remove the packages when upgrading my 1100s because they barely have enough memory or storage to get through an upgrade without trouble. But my 4200 with a 128gb ssd is a wide open space for upgrades by comparison. How would I know that though?
Or maybe I need to remove some packages but not others. But system managers would benefit from official guidance on how to decide which.
For me, production requirements don’t give me a reasonable opening to go back and get the old database from a BE such that the benefits exceed the cost of doing so, unless I can restore just the Totals package and data from a recent backup, which I do have. I’ll have to go look. I’ve only ever restored an entire backup.
-
Yes it's still the safest way. If I were upgrading something something very remote with no recovery option I would remove all the packages first.
But it's almost always a memory exhaustion issue and the 1100 is most likely to hit it with 1GB. I've seen the 3100 hit it with 2GB when it's running lots of packages but I upgrade mine here with Snort and pfBlocker still installed. I have limited lists and signatures loaded though.
On a 4GB box it's unlikely to be a problem unless you really tried hard to exhaust the RAM with all the Snort signatures and every pfBlocker list!
In any case I would always have a backup of the config and a recovery media available just in case. It's often quicker to reinstall anyway so it's huge deal for me.
