Unable to upgrate 23.09.1 to 24.11

stephenw10 · Mar 17, 2025, 7:38 PM

Hmm, odd. Try running: pfSense-repoc -DJ

That should show you what info is being sent and which branches are being pushed back. Obviously don't post that output here.

nanda · Mar 18, 2025, 12:00 PM

@stephenw10

In the post data repo section, I can see three repos: 24.11, 24.03, 23.09.1. The 23.09.1 has the default field set to yes; other repo sections do not have this field.

Would you tell me, how to deduce/solve the problem with the command response?

stephenw10 · Mar 18, 2025, 1:07 PM

Ok try running: ls -ls /usr/local/etc/pkg/repos

That should show a symlink for pfSense.conf that points to the selected repo like:

24.03-RELEASE][admin@plusdev-4.stevew.lan]/root: ls -ls /usr/local/etc/pkg/repos
total 1
1 -rw-r--r--  1 root wheel 25 Apr 19  2024 FreeBSD.conf
1 lrwxr-xr-x  1 root wheel 55 Mar 18 12:49 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-0003.conf

When you change the update branch in the webgui that symlink should be updated.

Then if you check that repo it should be 24.11 like:

[24.03-RELEASE][admin@plusdev-4.stevew.lan]/root: cat /usr/local/etc/pfSense/pkg/repos/pfSense-repo-0003.conf
FreeBSD: { enabled: no }

pfSense-core: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v24_11_amd64-core",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

pfSense: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v24_11_amd64-pfSense_plus_v24_11",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

I'm guessing your install is not showing that for some reason.

nanda · Mar 18, 2025, 3:00 PM

@stephenw10

Your guess is true, symlink did not change to the selected repo when the update branch changed in the GUI. It stays with 23.09.1.

$ ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 18 16:45 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf

pfSense-repo-23_09_1_rel.conf has urls for 23.09.1 in pfsense-core and pfsense section.

"pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v23_09_1_amd64-core"
"pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v23_09_1_amd64-pfSense_plus_v23_09_1"

Is there any command that can be executed via the terminal to change the repo?

stephenw10 · Mar 18, 2025, 3:20 PM

Yes you can try manually creating the symlink. What conf files do you have in /usr/local/etc/pfSense/pkg/repos ?

nanda · Mar 18, 2025, 3:31 PM

@stephenw10

The repos directory has three config files for 23.09.1, 24.03 and 24.11

-rw-r--r--  1 root wheel 512 Mar 18 16:45 /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf
-rw-r--r--  1 root wheel 506 Mar 18 16:45 /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_03-rel.conf
-rw-r--r--  1 root wheel 506 Mar 18 16:45 /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf

stephenw10 · Mar 18, 2025, 5:11 PM

OK first try running: pfSense-repo-setup then re-check.

nanda · Mar 18, 2025, 5:39 PM

@stephenw10

pfSense-repo-setup command did not return any message, so it should be a clean execution.

[23.09.1-RELEASE][...]/root: pfSense-repo-setup
[23.09.1-RELEASE][...]/root: ls -l /usr/local/etc/pfSense/pkg/repos/*.conf
-rw-r--r--  1 root wheel 512 Mar 18 19:22 /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf
-rw-r--r--  1 root wheel 506 Mar 18 19:22 /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_03-rel.conf
-rw-r--r--  1 root wheel 506 Mar 18 19:22 /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf

After saving the 24.11 update branch in the system update via GUI, symlink still stays with 23.09.1

[23.09.1-RELEASE][...]/root: ls -ls/usr/local/etc/pfkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 18 19:24 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf
[23.09.1-RELEASE][...]/root:

stephenw10 · Mar 18, 2025, 5:54 PM

Hmm, weird. Is it not updating the line in the config perhaps?

Anyway you should be able to run:
rm /usr/local/etc/pkg/repos/pfSense.conf

Then:
ln -s /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf /usr/local/etc/pkg/repos/pfSense.conf

That should allow it to see the 24.11 upgrade.

nanda · Mar 18, 2025, 6:29 PM

@stephenw10

ln -s ... command created the symlink pointing 24.11 conf and it is verified too.

[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 56 Mar 18 20:06 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf

When I tried to update via Sys => Update => System Update, the page returned 'Up to date' status with 23.09.1 as the base and latest versions. Symlink verification for pfSense.conf shows that the config reverted to 23.09.1. It seems the problem lies with the GUI.

[23.09.1-RELEASE][...]/root: ls -ls/usr/local/etc/pfkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 18 20:14 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf

Should I retry the update via option 13 after recreating the symlink?
Will it cause problems?

stephenw10 · Mar 18, 2025, 6:56 PM

Try running pfSense-upgrade directly after creating the symlink.

nanda · Mar 19, 2025, 7:13 PM

@stephenw10

Sorry for my belated response. The firewall cannot be taken offline immediately.

I executed the pfSense-upgrade command, but it did not upgrade the firewall. I verified the pfSense.conf symlink before and after command execution. It looks like the pfSense.conf again reverted to 23.09.1.

[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 56 Mar 19 21:03 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf
[23.09.1-RELEASE][...]/root: pfSense-upgrade
>>> Updating repositories metadata...
Updating pfSense-core repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: . done
Processing entries: . done
pfSense-core repository update completed. 5 packages processed.
Updating pfSense repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: ....... done
Processing entries: .......... done
pfSense repository update completed. 739 packages processed.
All repositories are up to date.
Your packages are up to date
[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 19 21:03 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf

stephenw10 · Mar 19, 2025, 8:05 PM

OK check the config file. What branch is it saving there?

Or change the branch then check the config history. You should see it switch from 23.09.1 to 24.11.

nanda · Mar 19, 2025, 9:09 PM

@stephenw10

Update branch change to 24.11 after symlink creation.

[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 56 Mar 19 23:01 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf
[23.09.1-RELEASE]...]/root: cat /usr/local/etc/pkg/repos/pfSense.conf
FreeBSD: { enabled: no }

pfSense-core: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v24_11_amd64-core",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

pfSense: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v24_11_amd64-pfSense_plus_v24_11",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

Updated branch rollback to 23.09.1 after pfSense-upgrade execution

[23.09.1-RELEASE][...]/root: pfSense-upgrade
>>> Updating repositories metadata...
Updating pfSense-core repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: . done
Processing entries: . done
pfSense-core repository update completed. 5 packages processed.
Updating pfSense repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: ..... done
Processing entries: .......... done
pfSense repository update completed. 739 packages processed.
All repositories are up to date.
Your packages are up to date
[23.09.1-RELEASE][...]/root: cat /usr/local/etc/pkg/repos/pfSense.conf
FreeBSD: { enabled: no }

pfSense-core: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v23_09_1_amd64-core",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

pfSense: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v23_09_1_amd64-pfSense_plus_v23_09_1",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

[23.09.1-RELEASE][...]/root:

stephenw10 · Mar 20, 2025, 8:09 AM

But what does it show in the main pfSense config.xml file? That's where pfSense-upgrade it triggering it be pulled from.

I can't imagine why it would not be getting updated but....

nanda · Mar 20, 2025, 8:16 AM

@stephenw10

I assume the main pfSense config.xml you are referring to is the file in /cf/conf/config.xml. <system/> section is the point of interest, I believe, as it contains information related to host, users, groups and webui.

	<system>
		<optimization>normal</optimization>
		...
		<already_run_config_upgrade></already_run_config_upgrade>
		<pkg_repo_conf_path>/usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf</pkg_repo_conf_path>
		<firmware>
			<disableautobe></disableautobe>
		</firmware>
		<gitsync>
			<repositoryurl></repositoryurl>
			<branch></branch>
		</gitsync>
		...
	</system>

The <pkg_repo_conf_path> directs to the 24.11 configuration file and the file has links to the 24.11 repo.

[23.09.1-RELEASE][...]/root: cat /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf
FreeBSD: { enabled: no }

pfSense-core: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v24_11_amd64-core",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

pfSense: {
    url: "pkg+https://pfsense-plus-pkg.netgate.com/pfSense_plus-v24_11_amd64-pfSense_plus_v24_11",
    mirror_type: "srv",
    signature_type: "fingerprints",
    fingerprints: "/usr/local/share/pfSense/keys/pkg",
    enabled: yes
}

[23.09.1-RELEASE][...]/root:

Should <firmware/>and <gitsync/> sections have values pointing to 24.11?
Or am I looking at the wrong place?

stephenw10 · Mar 20, 2025, 4:56 PM

No that's all correct. Weird.

What happens if you try upgrading to 24.03 first?

nanda · Mar 20, 2025, 4:58 PM

@stephenw10

After changing the update branch to 24.03 via System => Update => Update Settings, the main pfSense config.xml's pkg_repo_conf_path changed to 24.03 repo.

<system>
	...
	<pkg_repo_conf_path>/usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_03-rel.conf</pkg_repo_conf_path>
	...
</system>

The symlink points to 23.09.1. I changed it manually and initiated an upgrade, but the result is the same and the main pfSense config.xml's pkg_repo_conf_path changed to 24.11 repo.

[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 20 18:28 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf
[23.09.1-RELEASE][...]/root: rm /usr/local/etc/pkg/repos/pfSense.conf
[23.09.1-RELEASE][...]/root: ln -s /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_03-rel.conf /usr/local/etc/pkg/repos/pfSense.conf
[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 60 Mar 20 18:39 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_03-rel.conf
[23.09.1-RELEASE][...]/root: pfSense-upgrade
>>> Updating repositories metadata...
Updating pfSense-core repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: . done
Processing entries: . done
pfSense-core repository update completed. 5 packages processed.
Updating pfSense repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: ...... done
Processing entries: .......... done
pfSense repository update completed. 739 packages processed.
All repositories are up to date.
Your packages are up to date
[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 20 18:41 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf

<system>
	...
	<pkg_repo_conf_path>/usr/local/etc/pfSense/pkg/repos/pfSense-repo-24_11.conf</pkg_repo_conf_path>
	...
<system>

The entire process is unclear to me since the upgrade process started with a lower version (24.03) but was completed with the lowest version (i.e., the original base version:23.09.1), and recorded in the config.xml with the latest version (24.11).

stephenw10 · Mar 21, 2025, 8:55 PM

Ok I managed to replicate this locally. I think!

Just visiting the webgui upgrade page resets the symlink to the correct branch

So first set the repo branch back to 23.09.1. Then run: pkg upgrade -f pfSense-repoc

Assuming it offers a downgrade allow that like:

[23.09.1-RELEASE][root@plusdev.stevew.lan]/root: pkg upgrade -f pfSense-repoc
pkg: Warning: Major OS version upgrade detected.  Running "pkg bootstrap -f" recommended
Updating pfSense-core repository catalogue...
Fetching meta.conf:   0%
pfSense-core repository is up to date.
Updating pfSense repository catalogue...
pfSense repository is up to date.
All repositories are up to date.
Checking integrity... done (0 conflicting)
The following 3 package(s) will be affected (of 0 checked):

Installed packages to be DOWNGRADED:
        libucl: 0.9.2_1 -> 0.8.2 [pfSense]
        pfSense-repoc: 20241121 -> 20230912 [pfSense]

Installed packages to be REINSTALLED:
        uclcmd-0.2.20211204 [pfSense] (ABI changed: 'freebsd:15:x86:64' -> 'freebsd:14:x86:64')

Number of packages to be reinstalled: 1
Number of packages to be downgraded: 2

Proceed with this action? [y/N]: y
[1/3] Downgrading libucl from 0.9.2_1 to 0.8.2...
[1/3] Extracting libucl-0.8.2: 100%     14 B   0.0kB/s    00:01    
[2/3] Reinstalling uclcmd-0.2.20211204...
[2/3] Extracting uclcmd-0.2.20211204: 100%      4 B   0.0kB/s    00:01    
[3/3] Downgrading pfSense-repoc from 20241121 to 20230912...
[3/3] Extracting pfSense-repoc-20230912: 100%      2 B   0.0kB/s    00:01

Now set the upgrade branch back to 24.11 and try to upgrade again.

nanda · Mar 21, 2025, 8:56 PM

@stephenw10

As you mentioned, I switched repo branch to 23.09.1 via System => Update => Update settings, and config.xml's pkg_repo_conf_path changed to 23.09.1.

<system>
	...
	<pkg_repo_conf_path>/usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf</pkg_repo_conf_path>
	...
</system>

[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 21 22:39 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf
[23.09.1-RELEASE][...]/root: pkg upgrade -f pfSense-repoc
Updating pfSense-core repository catalogue...
Fetching meta.conf:   0%
pfSense-core repository is up to date.
Updating pfSense repository catalogue...
pfSense repository is up to date.
All repositories are up to date.
Checking integrity... done (0 conflicting)
The following 1 package(s) will be affected (of 0 checked):

Installed packages to be REINSTALLED:
        pfSense-repoc-20230912 [pfSense]

Number of packages to be reinstalled: 1

Proceed with this action? [y/N]: y
[1/1] Reinstalling pfSense-repoc-20230912...
[1/1] Extracting pfSense-repoc-20230912: 100%      2 B   0.0kB/s    00:01

After updating the repo branch to 24.11, config.xml's pkg_repo_conf_path changed to 24.11, but symlink points to 23.09.1. Then I executed pfSense-upgrade.

[23.09.1-RELEASE][...]/root:ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 21 22:41 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf
[23.09.1-RELEASE][...]/root: pfSense-upgrade
>>> Updating repositories metadata...
Updating pfSense-core repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: . done
Processing entries: . done
pfSense-core repository update completed. 5 packages processed.
Updating pfSense repository catalogue...
Fetching meta.conf: . done
Fetching packagesite.pkg: ..... done
Processing entries: .......... done
pfSense repository update completed. 739 packages processed.
All repositories are up to date.
Your packages are up to date
[23.09.1-RELEASE][...]/root: ls -ls /usr/local/etc/pkg/repos
total 4
4 -rw-r--r--  1 root wheel 26 Dec  6  2023 FreeBSD.conf
0 lrwxr-xr-x  1 root wheel 62 Mar 21 22:41 pfSense.conf -> /usr/local/etc/pfSense/pkg/repos/pfSense-repo-23_09_1_rel.conf

After pfSense-upgrade, the symlink state and config.xml's pkg_repo_conf_path value are the same. The firewall is not upgraded.