DHCP weirdness after 23.09 upgrade

[michmoor]

@johnpoz said in DHCP weirdness after 23.09 upgrade:

It was actually a nice test of booting to an old zfs.. which worked out great.

The boot environment feature is so clutch. Just awesome

[beatvjiking]

I'm seeing similar problems while applying "DHCP enforcement" through my wifi infrastructure - the controllers aren't recognizing the DHCP transactions and are kicking clients off even after they receive DHCP leases. Switching to Kea isn't an option for me yet since I'm running redundant pairs. The behavior is reliably reproducible on 23.09 and doesn't exist on 23.05.1.

[Phizix]

I may have to do this soon. It appears my garage door opener is not getting an IP. DOH!!

[beatvjiking]

If anyone has a non-ZFS-based way to patch/work around the issue at scale (not all my affected boxes have been moved to ZFS yet, and there are a lot, so a binary swap would be challenging) I'd be super amped to hear about it.

[mathiasringhof]

@beatvjiking As long as you pay attention to architecture you can just use a random 23.05.1 install, get the file and then deploy to all your boxes. Anything below the 4000 series is ARM though, so be careful not to deploy x86 binaries to those.

[Phizix]

OK, looking back at the Garage Door opener logs, it lost IP long before the 23.09 upgrade.

Looks like I have some troubleshooting to do.

Phizix

[lopezi]

Where can we download 23.05 to get the previous binary?

[SteveITS]

@lopezi If you have ZFS you can revert to an earlier boot environment.
https://docs.netgate.com/pfsense/en/latest/backup/zfsbe/index.html

If not and you have Netgate hardware you can request an old image and install it. (Also gets you ZFS)

If you don’t have Netgate hardware then one way might be to install 2.6, then upgrade to 23.05? If it lets you choose Previous Stable while upgrading…?

[lopezi]

@SteveITS No, not on Netgate hardware but I did upgrade from CE to Plus a few versions back but my install is still using UFS so no ZFS boot for me.

If I go to System -> Update -> Update Settings I can select 23.05.1 but I don't want to revert my whole system. However, if I can get the endpoints that this is pulling from, I could download the package in theory. Anyone know the endpoints?

[dem]

@johnpoz said in DHCP weirdness after 23.09 upgrade:

For me I just booted the zfs 23.05.1 on my VM, grabbed the file via sftp.

You might not need to reboot to fetch a file from a previous ZFS Boot Environment. Try looking for the ZFS snapshot of your previous root in /.zfs/snapshot. It will be named after the date and time it was created.

For example, on my 23.09 system:

ls -l /usr/local/sbin/dhcpd
-r-xr-xr-x  1 root wheel 3084656 Oct  6 00:44 /usr/local/sbin/dhcpd

ls -l /.zfs/snapshot/2023-11-09-11:07:11-0/usr/local/sbin/dhcpd
-r-xr-xr-x  1 root wheel 3111960 Feb 17  2023 /.zfs/snapshot/2023-11-09-11:07:11-0/usr/local/sbin/dhcpd

The /.zfs directory won't appear in a regular ls listing.

[SteveITS]

@mathiasringhof
https://redmine.pfsense.org/issues/15011#note-14
"The fix will be included in 23.09/2.7.1 in the next ports build, after which running pfSense-repoc; pkg upgrade will pick it up."

Sounds like it will be slipstreamed in for those who haven't upgraded yet...?