IPv6 DHCP-PD – radvd dies after interface reset - dhcpv6 does not reaquire addr

reslip

Thank you for the continued work on this. I've updated to the latest Mar 21 04:30:58 EDT 2013.

A few notes on this build:

In the system log I am seeing quite frequently… dhcp6c[34635]: client6_recvadvert: XID mismatch
Ping6 works fine from the firewall, but not from any clients on the local lan.
radvd does not start automatically. However, I can start it now without it giving a core dump. When I do start it, I can ping from the local lan as well. :)

priller

I updated to:

2.1-BETA1 (amd64)
built on Thu Mar 21 17:04:35 EDT 2013

Appears to working OK. Only observations are:

I had to manually start radvd. Once started, there were no errors. IPv6 connectivity is good.
/var/db/wan_ipv6 and /var/db/wan_cacheipv6 don't have the current WAN IPv6 address. Problem or not???

So, I'll wait 48 hours and see what happens at dhcpv6 renewal time. That's when I have been loosing the LAN PD and have to reboot.

priller

@priller:

So, I'll wait 48 hours and see what happens at dhcpv6 renewal time. That's when I have been loosing the LAN PD and have to reboot.

It's now been over 72 hours and it's still solid. So, it looks like a good fix. Thanks!

priller

Guess I spoke too soon. A different issue has shown itself now.

At exactly 4 days uptime, I lost all IPv6 addressing. The WAN IPv6 address was gone; the PD for the LAN was also gone.

4 days just happens to be the IPv6 lease time from Comcast. So, it looks like the lease expired and pfSense did not renew.

The only syslog during this event was:

Mar 26 07:35:03 dhcp6c[46766]: client6_timo: all information to be updated was canceled
Mar 26 07:38:12 dhcp6c[46766]: client6_timo: all information to be updated was canceled

reslip

I'm still having similar problems. It looks like it was around 48 hours later, then my ipv6 lan addressing was also dropped.

Mar 21 12:14:43 radvd[66853]: version 1.9.1 started <–-----------------STARTED
Mar 21 12:38:50 radvd[67052]: attempting to reread config file
Mar 21 12:38:50 radvd[67052]: resuming normal operation
Mar 21 12:43:50 radvd[67052]: attempting to reread config file
Mar 21 12:43:50 radvd[67052]: resuming normal operation
Mar 23 11:55:35 radvd[67052]: Exiting, sigterm or sigint received. <–----------RADVD STOPPED, NEVER RESTARTED

Wan IPv6 still works ok. I am using Comcast as well.

Using the latest Mar 26th build it looks like radvd is still not starting.
Mar 26 18:50:43 php: : rc.newwanip: Informational is starting fxp1.
Mar 26 18:50:43 php: : rc.newwanip: on (IP address: 71.238.140.xxx) (interface: wan) (real interface: fxp1).
Mar 26 18:50:43 php: : Accept router advertisements on interface fxp1
Mar 26 18:50:43 php: : ROUTING: setting default route to 71.238.140.1
Mar 26 18:50:43 php: : ROUTING: setting IPv6 default route to fe80::201:5cff:fe3d:xxxx%fxp1
Mar 26 18:50:43 php: : ROUTING: setting default route to 71.238.140.1
Mar 26 18:50:43 php: : ROUTING: setting IPv6 default route to fe80::201:5cff:fe3d:xxxx%fxp1
Mar 26 18:50:44 dhcpleases: Could not deliver signal HUP to process because its pidfile does not exist, No such file or directory.
Mar 26 18:50:44 dhcp6c[46524]: dhcp6_ctl_authinit: failed to open /usr/local/etc/dhcp6cctlkey: No such file or directory
Mar 26 18:50:44 dhcp6c[46524]: client6_init: failed initialize control message authentication
Mar 26 18:50:44 dhcp6c[46524]: client6_init: skip opening control port

priller

Very interesting. I had to start radvd manually every time the system booted.

I decided to do a total reinstall, now radvd starts reliably (I imported the config.xml into the fresh install)

Does applying the update builds leave stuff behind that in-turn causes conflicts or doesn't update something?

Have to wait and see if the IPv6 address renewal problem is any better now.

darkcrucible

I think I've fallen victim to this issue as well. IPv6 has disappeared from the LAN interface. RADVD service is simply gone from the services page now. It was there earlier. I think after 48 hours there is some sort of address renewal process which triggers this.

Without the LAN interface having any IPv6 connectivity, all IPv6 connectivity on the LAN has ceased. Strangely enough, the renewal code seems to correctly populate resolv.conf with the IPV6 DNS entries. Upon bootup, resolv.conf will only have IPv4 DNS. So startup and renewal each have their own issues.

This is on the March 26th snapshot nanobsd i386. ISP is Comcast.

darkcrucible

I'm not sure if what I'm seeing after upgrading to the March 30th snapshot is the same issue for this thread but I don't have any IPv6 connectivity at all on the LAN. RADVD is sending advertisements, all LAN clients pick up an address (but not DNS) but there is no connectivity.

I can't ping the router's LAN address

I get a lot of failed to update WAN IPv6 address errors.

Mar 31 17:18:05 	php: : ROUTING: setting IPv6 default route to fe80::201:5cff:fe31:b7c1%vr1
Mar 31 10:18:08 	php: : rc.newwanipv6: Failed to update wan IPv6, restarting...
Mar 31 17:18:11 	check_reload_status: Updating all dyndns
Mar 31 10:18:18 	php: : rc.newwanip: Informational is starting vr1.
Mar 31 10:18:18 	php: : rc.newwanip: on (IP address: 24.x.y.z) (interface: wan) (real interface: vr1).
Mar 31 10:18:18 	php: : Accept router advertisements on interface vr1
Mar 31 17:18:18 	check_reload_status: Restarting ipsec tunnels
Mar 31 10:18:18 	php: : ROUTING: setting default route to 24.x.yyy.1
Mar 31 10:18:18 	php: : ROUTING: setting IPv6 default route to fe80::201:5cff:fe31:b7c1%vr1
Mar 31 17:18:20 	check_reload_status: Reloading filter
Mar 31 10:18:21 	dhcp6c[18942]: client6_recvreply: status code: success
Mar 31 10:18:21 	dhcp6c[48004]: dhcp6_ctl_authinit: failed to open /usr/local/etc/dhcp6cctlkey: No such file or directory
Mar 31 10:18:22 	dhcp6c[48004]: client6_init: failed initialize control message authentication
Mar 31 10:18:22 	dhcp6c[48004]: client6_init: skip opening control port
Mar 31 10:18:23 	php: : rc.newwanipv6: Informational is starting vr1.
Mar 31 10:18:25 	php: : Resyncing OpenVPN instances for interface WAN.
Mar 31 10:18:26 	php: : Creating rrd update script
Mar 31 10:18:28 	php: : rc.newwanipv6: Failed to update wan IPv6, restarting...
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvadvert: XID mismatch
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvadvert: XID mismatch
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvadvert: XID mismatch
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvadvert: XID mismatch
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvadvert: XID mismatch
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvadvert: XID mismatch
Mar 31 10:18:28 	dhcp6c[18942]: client6_recvreply: status code: success
Mar 31 10:18:30 	php: : rc.newwanipv6: Informational is starting vr1.
Mar 31 10:18:30 	php: : pfSense package system has detected an ip change 0.0.0.0 -> 24.x.y.z ... Restarting packages.
Mar 31 17:18:30 	check_reload_status: Starting packages
Mar 31 10:18:35 	php: : rc.newwanipv6: Failed to update wan IPv6, restarting...
Mar 31 10:18:35 	dhcp6c[18942]: check_exit: exiting
Mar 31 10:18:40 	php: : Restarting/Starting all packages.
Mar 31 10:18:40 	php: : The OpenVPN Client Export Utility package is missing its configuration file and must be reinstalled.
Mar 31 10:18:44 	php: : rc.newwanipv6: Informational is starting vr1.
Mar 31 17:18:46 	check_reload_status: Syncing firewall
Mar 31 10:18:49 	php: : rc.newwanipv6: Failed to update wan IPv6, restarting...
Mar 31 17:18:54 	php: : Creating rrd update script
Mar 31 17:19:38 	php: : PBI dir for zip-3.0-i386 was not found - cannot cleanup PBI files
Mar 31 17:19:38 	php: : PBI dir for p7zip-9.20.1-i386 was not found - cannot cleanup PBI files
Mar 31 17:19:40 	check_reload_status: Syncing firewall
Mar 31 17:19:43 	php: : Beginning package installation for OpenVPN Client Export Utility .
Mar 31 17:21:48 	check_reload_status: Syncing firewall
Mar 31 10:21:49 	syslogd: exiting on signal 15
Mar 31 10:21:49 	syslogd: kernel boot file is /boot/kernel/kernel
Mar 31 10:21:51 	php: : Restarting/Starting all packages.

priller

darkcrucible: Are you on a cable modem?

When I have seen the "dhcp6c[18942]: client6_recvadvert: XID mismatch", pfsense will just keep thrashing until I power cycle the cable modem and reboot pfsense. Then it clears and will obtain the IPv6 addressing (IPv4 is always fine).

This seems to happen after updating to a newer snapshot.

priller

Bit of update. Once again at renewal time, all IPv6 addressing was lost. The only syslog message was:

Apr 1 13:32:49 dhcp6c[29310]: client6_timo: all information to be updated was canceled

During this time, I was also running a packet capture on the WAN.

It was interesting to see that pfSense was getting two replies from Comcast, different server ID's. One had the addresses that should have been renewed, the other had different addressing. So, I suspect the pfSense didn't like that and killed everything.

So, I have a contact within Comcast and will see what they have to say about the two different responses. And what the expected client response should have been.

Also, after a reboot, I'm back to having to manually start RADVD.

johnpoz

I have been having issues with my comcast ipv6 as well - have not gotten around to looking into it yet, not something that I really need.. Just like having up to play with when I want to play with ipv6.

But I am seeing

Mar 31 11:44:38 radvd[55232]: Exiting, failed to read config file.
Mar 31 11:44:38 radvd[55232]: error parsing or activating the config file: /var/etc/radvd.conf
Mar 31 11:44:38 radvd[55232]: syntax error in /var/etc/radvd.conf, line 2:
Mar 31 11:44:38 radvd[55232]: version 1.9.1 started

You look in the conf and there is nothing there.

cat /var/etc/radvd.conf

Automatically Generated, do not edit

Currently running
2.1-BETA1 (i386)
built on Fri Mar 22 11:05:31 EDT 2013
FreeBSD 8.3-RELEASE-p6

I will update when I get home and look into it a bit deeper. I was working fine for long time, then just noticed a while back not working after update to snap.. I to was going to do a clean install, just have not go around to that either..

If I do a sniff I do see this which seems odd - seems like offering 2 prefixes?

2prefix.jpg_thumb

priller

I have opened the following bug: https://redmine.pfsense.org/issues/2919

I was running a packet capture when the lease expired. The IPv6 DHCP server is responding properly, but pfSense never binds.

darkcrucible

With the April 8th snapshot, IPv6 connectivity with my Comcast link is restored to the LAN clients. I skimmed through redmine to see what might be affecting this. A few items stood out. Not sure exactly which one.

Getting connectivity back is certainly an improvement. pfsense itself still doesn't use the IPv6 DNS given to it by Comcast and none of the LAN clients seem to use the IPv6 LAN address of pfsense for DNS forwarding like they used to back in February.

I'll report back in a few days after the renewal on whether connectivity remains and if the pfsense starts using IPv6 DNS at that point.

johnpoz

sweet!!!! I will try this build when I get home!

Michael Sh.

On my routers DHCP v6 not working at all after switching on rtsol.

rtsold should be used on IPv6 hosts (non-router nodes) only.

[2.1-BETA1][root@router.lan]/root(105): /usr/sbin/rtsold -1 -p /var/run/rtsold_em0.pid -O /var/etc/rtsold_em0_script.sh em0
rtsold: kernel is configured as a router, not a host

johnpoz

Still not working

2.1-BETA1 (i386)
built on Tue Apr 9 13:23:01 EDT 2013

Get errors that radvd.conf is bad

Apr 10 08:09:51 radvd[74841]: Exiting, failed to read config file.
Apr 10 08:09:51 radvd[74841]: error parsing or activating the config file: /var/etc/radvd.conf
Apr 10 08:09:51 radvd[74841]: syntax error in /var/etc/radvd.conf, line 2:

There is nothing in this file other than

[2.1-BETA1][root@pfsense.local.lan]/var/etc(11): cat /var/etc/radvd.conf

Automatically Generated, do not edit

[2.1-BETA1][root@pfsense.local.lan]/var/etc(12):

What is suppose to update this file? I tried clean install, and I did see my 2001 address on wan and 2006 address on lan, but it ended it :2 – and after reboot gone? No nothing on wan other than local link address, and nothing on lan.

This was working perfect, and then just stopped??

johnpoz

So I gave it some time, and now getting /128 on wan and /64 on lan

WAN (wan) -> em1 -> v4/DHCP4: 24.13.xx.xx/21
v6/DHCP6: 2001:558:xxxx:12c:405d:37e1:34e1:fe29/128
LAN (lan) -> em0 -> v4: 192.168.1.253/24
v6/t6: 2601:d:xxxx:d7:250:56ff:fe00:2/64

So it is working - but here is question. I don't want the lan IP to use the mac, which clearly is where that address is coming from. What would be nicer is if the lan interface grabbed the first IP in the net

2601:d:xxxx:d7::1

so my mac on the lan interface is

em0: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
options=98 <vlan_mtu,vlan_hwtagging,vlan_hwcsum>ether 00:50:56:00:00:02

Is there some setting that needs to be made so it doesn't do that, and just uses the first IP in the network its assigned?</vlan_mtu,vlan_hwtagging,vlan_hwcsum></up,broadcast,running,simplex,multicast>

darkcrucible

At 48 hours, the renewal time, the IPv6 LAN address disappears, RADVD vanishes from the services page, and resolv.conf picks up the IPv6 DNS from Comast (it only had the 75.75.x addresses prior to the renewal).

address.png_thumb

dns.png_thumb

service.png_thumb

priller

@darkcrucible:

At 48 hours, the renewal time, the IPv6 LAN address disappears, RADVD vanishes from the services page, and resolv.conf picks up the IPv6 DNS from Comast (it only had the 75.75.x addresses prior to the renewal).

pfSense will only bind the LAN IPv6 prefix at boot time. Once the lease expires it will never rebind. It just keeps trying to infinity. I'd say this is definitely a Show-Stopper bug.

rebind.jpg_thumb

johnpoz

Yup seems I lost my IPs as well…

So I have updated to

2.1-BETA1 (i386)
built on Fri Apr 12 04:55:08 EDT 2013
FreeBSD 8.3-RELEASE-p7

Still not working, so turned off ipv6 on the wan - then back on. Got my 2001 on my wan, then a bit later new 2601 on my lan - but different subnet. Gawd that sucks - if the /64 handed to me is going to change every time, I will just go back to the tunnel from HE. This never changed.

Also noticed that delete virtual IPs is still not working as well. Since the virtual I put on my lan with ::1 as the address vs the mac containing ipv6 it get would not delete. Using IE gives a warning about deleting, you say yes never deletes - firefox no such warning, but might because I popups blocked. But does not delete. So once got new address on lan, I change my virtual to be in that /64 and now I have ipv6 access again. But its a pain, lets see if goes away in 48 hours.

And I looked in the config - only place that address was listed was


	 <virtualip><vip><mode>ipalias</mode>
			<interface>lan</interface>
			 <descr><type>single</type>
			<subnet_bits>64</subnet_bits>
			<subnet>2601:d:xxxx:d7::1</subnet></descr></vip></virtualip>