Upgrade does not work correct? I assume on purpose?

louis2

Yep,

I have a completely different list .....

[2.7.0-DEVELOPMENT][admin@pfSense.lan]/root: pkg info -x pfsense
pfSense-pkg-Notes-0.2.9_3
pfSense-pkg-arping-1.2.2_2
pfSense-pkg-arpwatch-0.2.0_6
pfSense-pkg-haproxy-0.61_7
pfSense-pkg-iperf-3.0.2_5
pfSense-pkg-nmap-1.4.4_6
pfSense-pkg-pimd-0.0.3_5

I will do a clean install using the latest 2.7 build. See what happens.

Note that I did install my own pimd3 beta package (pimd2 does not work in actual freebsd). That however did not cause any issue up to now, also not in earlier 2.7 builds, so I doubt if that is the cause. Will test that as well of course

Note that I can install packages ..

louis2

@stephenw10

Stephen,

I did a lot of testing ....

To start with ...... there are things not ok in regard to installing and deleting packages, and that includes the vital packages related to ^pkg info -x pfSense^

My config file has 22.7 as version id (I assume that matches 2.7 and 22.05

Trying to identify the problem, I did remove the installed packages, starting with a few ending with all.

Even installing using a config file without any package defined, did not solve the issue ....

In that case pkg info -x pfSense shows

[2.7.0-DEVELOPMENT][admin@pfSense.lan]/root: pkg info -x pfSense
pkg: No package(s) matching pfSense

package related issues
During this testing I also noticed package related issues
Some of them

iperf
Warning: PHP Startup: Unable to load dynamic library 'gettext.so' (tried: /usr/local/lib/php/20190902/gettext.so (Shared object "libintl.so.8" not found, required by "gettext.so"), /usr/local/lib/php/20190902/gettext.so.so (Cannot open "/usr/local/lib/php/20190902/gettext.so.so")) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'readline.so' (tried: /usr/local/lib/php/20190902/readline.so (Shared object "libreadline.so.8" not found, required by "readline.so"), /usr/local/lib/php/20190902/readline.so.so (Cannot open "/usr/local/lib/php/20190902/readline.so.so")) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'rrd.so' (tried: /usr/local/lib/php/20190902/rrd.so (Shared object "libintl.so.8" not found, required by "librrd.so.8"), /usr/local/lib/php/20190902/rrd.so.so (Cannot open "/usr/local/lib/php/20190902/rrd.so.so")) in Unknown on line 0

Fatal error: Uncaught Error: Call to undefined function gettext() in /etc/inc/certs.inc:48
Stack trace:
#0 /etc/inc/functions.inc(34): require_once()
#1 /etc/inc/notices.inc(26): require_once('/etc/inc/functi...')
#2 /etc/inc/config.inc(51): require_once('/etc/inc/notice...')
#3 /etc/rc.packages(30): require_once('/etc/inc/config...')
#4 {main}
thrown in /etc/inc/certs.inc on line 48
pkg-static: DEINSTALL script failed
[1/1] Deleting files for pfSense-pkg-iperf-3.0.2_5: ........ done

arping
1/1] Deinstalling pfSense-pkg-arping-1.2.2_2...

Warning: PHP Startup: Unable to load dynamic library 'curl.so' (tried: /usr/local/lib/php/20190902/curl.so (Shared object "libintl.so.8" not found, required by "libpsl.so.5"), /usr/local/lib/php/20190902/curl.so.so (Cannot open "/usr/local/lib/php/20190902/curl.so.so")) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'gettext.so' (tried: /usr/local/lib/php/20190902/gettext.so (Shared object "libintl.so.8" not found, required by "gettext.so"), /usr/local/lib/php/20190902/gettext.so.so (Cannot open "/usr/local/lib/php/20190902/gettext.so.so")) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'readline.so' (tried: /usr/local/lib/php/20190902/readline.so (Shared object "libreadline.so.8" not found, required by "readline.so"), /usr/local/lib/php/20190902/readline.so.so (Cannot open "/usr/local/lib/php/20190902/readline.so.so")) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'rrd.so' (tried: /usr/local/lib/php/20190902/rrd.so (Shared object "libintl.so.8" not found, required by "librrd.so.8"), /usr/local/lib/php/20190902/rrd.so.so (Cannot open "/usr/local/lib/php/20190902/rrd.so.so")) in Unknown on line 0

Fatal error: Uncaught Error: Call to undefined function gettext() in /etc/inc/certs.inc:48
Stack trace:
#0 /etc/inc/functions.inc(34): require_once()
#1 /etc/inc/notices.inc(26): require_once('/etc/inc/functi...')
#2 /etc/inc/config.inc(51): require_once('/etc/inc/notice...')
#3 /etc/rc.packages(30): require_once('/etc/inc/config...')
#4 {main}
thrown in /etc/inc/certs.inc on line 48
pkg-static: DEINSTALL script failed
[1/1] Deleting files for pfSense-pkg-arping-1.2.2_2: ....... done

note
1/1] Deinstalling pfSense-pkg-Notes-0.2.9_3...

Warning: PHP Startup: Unable to load dynamic library 'rrd.so' (tried: /usr/local/lib/php/20190902/rrd.so (Shared object "libpcre.so.1" not found, required by "libglib-2.0.so.0"), /usr/local/lib/php/20190902/rrd.so.so (Cannot open "/usr/local/lib/php/20190902/rrd.so.so")) in Unknown on line 0
Removing Notes components...
Menu items... done.
[1/1] Deleting files for pfSense-pkg-Notes-0.2.9_3: ...... done

Warning: PHP Startup: Unable to load dynamic library 'rrd.so' (tried: /usr/local/lib/php/20190902/rrd.so (Shared object "libpcre.so.1" not found, required by "libglib-2.0.so.0"), /usr/local/lib/php/20190902/rrd.so.so (Cannot open "/usr/local/lib/php/20190902/rrd.so.so")) in Unknown on line 0
Removing Notes components...
Configuration... done.

stephenw10

Did you set a different pkg repo to install pimd3 at all?

Those library errors generally imply a mismatched package, like it is still using the 2.6 pkg repo or it's using the FreeBSD repo.

Without the correct pfSense base packages there you will not be able upgrade among other things. If you can still reinstall packages you can try this:
https://docs.netgate.com/pfsense/en/latest/troubleshooting/upgrades.html#forced-pkg-reinstall

A clean install will of course bring those back.

Steve

louis2

@stephenw10

Stephan, ..... I tried every thing ....... it just does not work ...
Note that I did clean installs using a boot usb and a config usb. Trying the things on the linked page as well ...

One thing to mention ... I was so ^brave^ to rename my wan-interface ...... with as result that my ipv6 was gone
however the gateway did still show green

I discovered that and did edit the config file back to the original name. That solved the problem I think, however given this issues, I am not 100 % sure.

I did create a ticket ...... however according to Jim, it is not a bug it is ^just not supported^.

What ever I am going to install 2.6 and given that my actual config is not compatible will probably trying to upgrade to 2.7 from there ...

Hope it works, I did already spend far to much time on 2.7 (note that in the past I have always felt positive about development releases).

stephenw10

So you installed 2.7 clean and restored your config and ended up with missing base packages?

louis2

@stephenw10

Yep !!!

I just tried to install 2.6 ...... which

does show the expected "pkg info -x pfsense" packages
but can NOT handle the config file

And not 2.7 ..... which

does NOT show those packages
but can handle the config file
and has a not working ipv6 interface issue .....

Its a struggle ..... I probably have to go back to an even older config :(
Which is hopefully working ....

stephenw10

@louis2 said in Upgrade does not work correct? I assume on purpose?:

And not 2.7 ..... which

does NOT show those packages

But I assume only after restoring the config?

louis2

@stephenw10

Stephen, I decided to install the today 2.7 version together with my actual config,

That situation is working, apart from the fact that the update function is broken.

I did invest at least a day trying to find the reason for that, but I simply do not know. All I / we know that : pkg info -x pfSense shows that the packages are not installed.

So for the moment I think I have to live with this. Hoping for a fix in the near future

louis2

@stephenw10

I do not know. pfSense is part of my network, which is only functioning if pfSense is doing its job.

So for that reason I did do the tests with two USB-sticks, one containing the installer image, the other one the desired config to be loaded during boot.

So I never see a pfSense version without config

louis2

@stephenw10

What if .....

The startup procedure assumes that it is ready before the config is loaded ....

However the config is loaded before the startup sequence is ready .......

Then you might have a problem like this one ....

stephenw10

Ok, I think I have reproduced this. We are digging into it now.

Does your config have ramdisks enabled?

Steve

louis2

@stephenw10

Yep, I have

my pfSense computer has

Intel(R) Pentium(R) CPU G4620 @ 3.70GHz 4 CPUs: 1 package(s) x 2 core(s) x 2 hardware threads
8 GB RAM (1gb tmp ram disk & 4 GB var ram (3 GB free!?)
60 GB sata SSD

louis2

@stephenw10

Related inconvenience ...

The boot priority of the computer is set to boot from the usb above the sata ssd

So If I place the two USB-sticks and reboot, the pc boots into the installer.

The installer at the end ask if it is ok to reboot ..... However If I would answer yes ....... it would boot again ..... with the installer image

So before I can push reboot I have to go downstairs to remove the installer usb.

However I have to leave the config ssd in the system ...... because the config is not yet copied to the sata-ssd .....

So I have to go back to my computer upstairs ....
push the boot OK ..... a small problem ..... the installer usb is gone so the system is confused ...
The easy workaround is Cntr-Alt-Del via my KVM

Than the system boots, and I have to go downstairs again to remove the config USB ...

Back to my computer upstairs to continue

It is a good "work out" of course but the process could be a lot easier ....

At least by copying the config to the disk during install, and allow to remove the two disks together before activating the reboot ....

stephenw10

OK, it looks like there's a conflict there between running /var as a ramdisk and the way ZFS mounts it.

If you can remove line that enables ramdisks from your config:

<use_mfs_tmpvar></use_mfs_tmpvar>

Then retest importing it into a clean 2.7 install.

Steve

stephenw10

@louis2 said in Upgrade does not work correct? I assume on purpose?:

At least by copying the config to the disk during install, and allow to remove the two disks together before activating the reboot ....

You can do that. If the config is in the correct place on the USB drive it will be imported during the install and you can then remove it before rebooting:
https://docs.netgate.com/pfsense/en/latest/backup/restore-during-install.html#restore-configuration-from-usb-during-install

Steve

louis2

@stephenw10

Yep and Yep ....

After removing <use_mfs_tmpvar></use_mfs_tmpvar> the upgrade mechanism is working again

And removing both USB-sticks before reboot is also working as described.

So only thing left is the question if it is yes or no a good idea not to use a ram disk given the fact that there is plenty of ram available .. Of cause that largely depends on how the software has been designed, if it is not storing data to disk, which is not intended to survive a reboot ..... unless there is lack of memory .... then ..... there is no need for a ram disk .... I think

stephenw10

Well for now the choice is simple. Until this is fixed, do not use ramdisks if you are running ZFS.
https://redmine.pfsense.org/issues/13182

At the very least we will add code to prevent that conflict with /var so that may mean only /tmp can be a ram disk. Or there may be a better solution, we are still exploring options.

Steve