DNS Resolver stopped working unexpectedly pfsense 2.3.4-RELEASE amd64



  • Hi,

    I am currently using pfSense 2.3.4-RELEASE amd64.  I had been using DNS Resolver for domain name aliases.  It was working fine for several weeks.

    All of the sudden it stopped working.  What I've tried so far:
    Restarting the DNS Resolver service
    Manually turning the service off and then on (saving changes after each change).

    It's currently on and it won't resolve any of my aliases.  This is not related to a system upgrade or anything else that I have done –- it just stopped resolving the aliases all on its own.

    Any ideas?

    More info:  I'm running pfSense on a j1800 motherboard using a 4-port pcie Intel Pro/1000 VT.  I have not updated/upgraded pfSense for several weeks.

    Thanks!



  • Having the same issue. Just upgraded from 2.3.3 to 2.3.4 (amd64), have DNS Resolver enabled with forwarding checked. 4 DNS servers listed in General  Settings–2 local windows server DNS, which has the A records for my local hosts; plus two Google's DNS servers. No servers are listed under the DHCP Server settings.

    Configured like this, none of my dhcp clients can see the host names for any local devices. The second I add one of the windows DNS servers to either the local client network dns settings or in the pfsense DHCP DNS Server configuration, everything works.

    Bug?

    UPDATE: I forgot to mention that I had to disable the DNS resolver for the DNS servers I added to the DHCP Server section to show up on the client.  Of course. Just wanted to mention that. With the resolver enabled, only the routers lan ip address shows up on the client as the DNS server of choice.



  • I'm also on 2.3.4 amd64 and don't have those problems.



  • Tried to switch to Forwarder from Resolver, it's not forwarding to aliases either

    This makes no sense to me.  Aliases were working fine for weeks, and I made no changes to anything.  Absolutely no sense.


  • Netgate Administrator

    It's not clear exactly what you're doing that is failing here. can you give us an example of something not working as you expect?

    I assume you are using Unbound (the resolver) but you say you switched to that from the Forwarder?

    Steve



  • It seem I am hit with the same problem on 2.3.4.
    I have a clean 2.3.4 install and today I found unbound dead ( I never had this problem with 2.3.2 ), here are all the logs related from when it stated the problem: at 01:11
    Gateway:

    Jun 2 07:37:08 	dpinger 		WANGW xx.xx.xx.xx: Clear latency 2366us stddev 18027us loss 19%
    Jun 2 07:36:24 	dpinger 		WANGW xx.xx.xx.xx: Alarm latency 451us stddev 1340us loss 22%
    Jun 2 07:36:21 	dpinger 		WANGW xx.xx.xx.xx: Clear latency 442us stddev 1298us loss 20%
    Jun 2 07:35:59 	dpinger 		WANGW xx.xx.xx.xx: Alarm latency 302us stddev 65us loss 22%
    Jun 2 06:27:34 	dpinger 		WANGW xx.xx.xx.xx: Clear latency 3443us stddev 22703us loss 14%
    Jun 2 06:26:40 	dpinger 		WANGW xx.xx.xx.xx: Alarm latency 301us stddev 70us loss 21%
    Jun 2 06:17:21 	dpinger 		WANGW xx.xx.xx.xx: Clear latency 794us stddev 2987us loss 14%
    Jun 2 06:16:25 	dpinger 		WANGW xx.xx.xx.xx: Alarm latency 619us stddev 1867us loss 21%
    Jun 2 01:11:33 	dpinger 		send_interval 500ms loss_interval 2000ms time_period 60000ms report_interval 0ms data_len 0 alert_interval 1000ms latency_alarm 500ms loss_alarm 20% dest_addr xx.xx.xx.xx bind_addr xx.xx.xx.yy identifier "WANGW "
    Jun 2 01:11:18 	dpinger 		send_interval 500ms loss_interval 2000ms time_period 60000ms report_interval 0ms data_len 0 alert_interval 1000ms latency_alarm 500ms loss_alarm 20% dest_addr xx.xx.xx.xx bind_addr xx.xx.xx.yy identifier "WANGW " 
    

    syslog:

    Jun 2 08:22:44 	check_reload_status 		Reloading filter
    Jun 2 08:22:44 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 08:22:44 	php-fpm 	52419 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 08:22:44 	php-fpm 	52419 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 08:22:43 	check_reload_status 		Reloading filter
    Jun 2 08:22:43 	check_reload_status 		rc.newwanip starting em2
    Jun 2 08:22:43 	php-fpm 	52419 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:22:42 	kernel 		em2: link state changed to UP
    Jun 2 08:22:42 	check_reload_status 		Linkup starting em2
    Jun 2 08:22:41 	check_reload_status 		Reloading filter
    Jun 2 08:22:41 	php-fpm 	25072 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:22:40 	kernel 		em2: link state changed to DOWN
    Jun 2 08:22:40 	check_reload_status 		Linkup starting em2
    Jun 2 08:14:58 	check_reload_status 		Reloading filter
    Jun 2 08:14:58 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 08:14:58 	php-fpm 	79536 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 08:14:58 	php-fpm 	79536 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 08:14:57 	check_reload_status 		Reloading filter
    Jun 2 08:14:57 	check_reload_status 		rc.newwanip starting em2
    Jun 2 08:14:57 	php-fpm 	79536 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:14:56 	kernel 		em2: link state changed to UP
    Jun 2 08:14:56 	check_reload_status 		Linkup starting em2
    Jun 2 08:14:55 	check_reload_status 		Reloading filter
    Jun 2 08:14:55 	php-fpm 	35676 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:14:54 	kernel 		em2: link state changed to DOWN
    Jun 2 08:14:54 	check_reload_status 		Linkup starting em2
    Jun 2 08:10:47 	php 		[pfBlockerNG] No changes to Firewall rules, skipping Filter Reload
    Jun 2 08:07:54 	check_reload_status 		Reloading filter
    Jun 2 08:07:54 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 08:07:54 	php-fpm 	44633 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 08:07:54 	php-fpm 	44633 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 08:07:53 	check_reload_status 		Reloading filter
    Jun 2 08:07:53 	check_reload_status 		rc.newwanip starting em2
    Jun 2 08:07:53 	php-fpm 	44633 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:07:52 	check_reload_status 		Linkup starting em2
    Jun 2 08:07:52 	kernel 		em2: link state changed to UP
    Jun 2 08:07:52 	avahi-daemon 	31835 	Withdrawing workstation service for em2.
    Jun 2 08:07:51 	check_reload_status 		Reloading filter
    Jun 2 08:07:51 	php-fpm 	12131 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:07:50 	kernel 		em2: link state changed to DOWN
    Jun 2 08:07:50 	check_reload_status 		Linkup starting em2
    Jun 2 08:06:04 	php 		[pfBlockerNG] Starting cron process.
    Jun 2 08:05:03 	avahi-daemon 	31835 	Service "fwpl" (/usr/local/etc/avahi/services/sftp-ssh.service) successfully established.
    Jun 2 08:05:03 	avahi-daemon 	31835 	Service "fwpl" (/usr/local/etc/avahi/services/ssh.service) successfully established.
    Jun 2 08:05:03 	avahi-daemon 	31835 	Server startup complete. Host name is fwpl.local. Local service cookie is 198903733.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 192.168.22.1 on em0.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 10.10.10.1 on em0.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 192.168.24.1 on em1.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 192.168.23.1 on re0.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 192.168.101.1 on em1_vlan101.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 10.22.22.17 on ovpns1.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 10.22.22.1 on ovpns2.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Registering new address record for 10.22.22.49 on ovpns5.IPv4.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Network interface enumeration completed.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface em0.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface em0.IPv4 with address 10.10.10.1.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface em1.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface em1.IPv4 with address 192.168.24.1.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface re0.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface re0.IPv4 with address 192.168.23.1.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface em1_vlan101.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface em1_vlan101.IPv4 with address 192.168.101.1.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface ovpns1.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface ovpns1.IPv4 with address 10.22.22.17.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface ovpns2.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface ovpns2.IPv4 with address 10.22.22.1.
    Jun 2 08:05:02 	avahi-daemon 	31835 	New relevant interface ovpns5.IPv4 for mDNS.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Joining mDNS multicast group on interface ovpns5.IPv4 with address 10.22.22.49.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Loading service file /usr/local/etc/avahi/services/ssh.service.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Loading service file /usr/local/etc/avahi/services/sftp-ssh.service.
    Jun 2 08:05:02 	avahi-daemon 	31835 	WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
    Jun 2 08:05:02 	avahi-daemon 	31835 	avahi-daemon 0.6.31 starting up.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Successfully dropped root privileges.
    Jun 2 08:05:02 	avahi-daemon 	31835 	Found user 'avahi' (UID 558) and group 'avahi' (GID 558).
    Jun 2 08:04:50 	dhcpleases 		kqueue error: unkown
    Jun 2 08:04:49 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 08:04:49 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 08:04:48 	zzzzz.xx.xx.xx.yy 		nginx: 2017/06/02 08:04:48 [error] 89099#100136: *1685 open() "/usr/local/www/themes/pfsense_ng_fs/images/icons/favicon.ico" failed (2: No such file or directory), client: 192.168.101.22, server: , request: "GET /themes/pfsense_ng_fs/images/icons/favicon.ico HTTP/1.1", host: "192.168.23.1:23228"
    Jun 2 08:02:53 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 08:02:53 	check_reload_status 		Reloading filter
    Jun 2 08:02:53 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 08:02:53 	php-fpm 	44955 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 08:02:53 	php-fpm 	44955 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 08:02:52 	check_reload_status 		Reloading filter
    Jun 2 08:02:52 	check_reload_status 		rc.newwanip starting em2
    Jun 2 08:02:52 	php-fpm 	44955 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:02:51 	kernel 		em2: link state changed to UP
    Jun 2 08:02:51 	check_reload_status 		Linkup starting em2
    Jun 2 08:02:50 	check_reload_status 		Reloading filter
    Jun 2 08:02:50 	php-fpm 	28496 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 08:02:49 	php-fpm 	88842 	/index.php: Successful login for user 'admin' from: 192.168.101.22
    Jun 2 08:02:49 	kernel 		em2: link state changed to DOWN
    Jun 2 08:02:49 	check_reload_status 		Linkup starting em2
    Jun 2 08:02:28 	php-fpm 	88842 	/index.php: User logged out for user 'admin' from: 192.168.101.22
    Jun 2 08:01:15 	php-fpm 	43279 	/index.php: Successful login for user 'admin' from: 192.168.101.22
    Jun 2 07:38:06 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 07:38:06 	check_reload_status 		Reloading filter
    Jun 2 07:38:06 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 07:38:06 	php-fpm 	9271 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 07:38:06 	php-fpm 	9271 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 07:38:05 	check_reload_status 		Reloading filter
    Jun 2 07:38:05 	check_reload_status 		rc.newwanip starting em2
    Jun 2 07:38:05 	php-fpm 	9271 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 07:38:04 	kernel 		em2: link state changed to UP
    Jun 2 07:38:04 	check_reload_status 		Linkup starting em2
    Jun 2 07:38:03 	check_reload_status 		Reloading filter
    Jun 2 07:38:03 	php-fpm 	2223 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 07:38:02 	kernel 		em2: link state changed to DOWN
    Jun 2 07:38:02 	check_reload_status 		Linkup starting em2
    Jun 2 07:37:10 	php-fpm 	56720 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 07:37:08 	check_reload_status 		Reloading filter
    Jun 2 07:37:08 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 07:37:08 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 07:37:08 	check_reload_status 		updating dyndns WANGW
    Jun 2 07:36:25 	php-fpm 	56720 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 07:36:24 	check_reload_status 		Reloading filter
    Jun 2 07:36:24 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 07:36:24 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 07:36:24 	check_reload_status 		updating dyndns WANGW
    Jun 2 07:36:22 	php-fpm 	43387 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 07:36:21 	check_reload_status 		Reloading filter
    Jun 2 07:36:21 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 07:36:21 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 07:36:21 	check_reload_status 		updating dyndns WANGW
    Jun 2 07:36:00 	php-fpm 	21132 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 07:35:59 	check_reload_status 		Reloading filter
    Jun 2 07:35:59 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 07:35:59 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 07:35:59 	check_reload_status 		updating dyndns WANGW
    Jun 2 07:31:42 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 07:31:42 	check_reload_status 		Reloading filter
    Jun 2 07:31:42 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 07:31:42 	php-fpm 	18092 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 07:31:42 	php-fpm 	18092 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 07:31:41 	check_reload_status 		Reloading filter
    Jun 2 07:31:41 	check_reload_status 		rc.newwanip starting em2
    Jun 2 07:31:41 	php-fpm 	18092 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 07:31:40 	kernel 		em2: link state changed to UP
    Jun 2 07:31:40 	check_reload_status 		Linkup starting em2
    Jun 2 07:31:40 	check_reload_status 		Reloading filter
    Jun 2 07:31:40 	php-fpm 	23401 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 07:31:39 	kernel 		em2: link state changed to DOWN
    Jun 2 07:31:39 	check_reload_status 		Linkup starting em2
    Jun 2 06:57:25 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:57:25 	check_reload_status 		Reloading filter
    Jun 2 06:57:25 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:57:25 	php-fpm 	21261 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 06:57:25 	php-fpm 	21261 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 06:57:24 	check_reload_status 		Reloading filter
    Jun 2 06:57:24 	check_reload_status 		rc.newwanip starting em2
    Jun 2 06:57:24 	php-fpm 	21261 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:57:23 	kernel 		em2: link state changed to UP
    Jun 2 06:57:23 	check_reload_status 		Linkup starting em2
    Jun 2 06:57:23 	check_reload_status 		Reloading filter
    Jun 2 06:57:23 	php-fpm 	5431 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:57:22 	kernel 		em2: link state changed to DOWN
    Jun 2 06:57:22 	check_reload_status 		Linkup starting em2
    Jun 2 06:46:25 	upsd 	29602 	User monslave@192.168.22.16 logged into UPS [ActiveJet]
    Jun 2 06:46:10 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:46:10 	check_reload_status 		Reloading filter
    Jun 2 06:46:10 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:46:10 	php-fpm 	173 	/rc.newwanip: rc.newwanip: on (IP address: 192.168.22.1) (interface: LAN1[lan]) (real interface: em0).
    Jun 2 06:46:10 	php-fpm 	173 	/rc.newwanip: rc.newwanip: Info: starting on em0.
    Jun 2 06:46:09 	check_reload_status 		Reloading filter
    Jun 2 06:46:09 	check_reload_status 		rc.newwanip starting em0
    Jun 2 06:46:09 	php-fpm 	173 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:46:08 	kernel 		em0: link state changed to UP
    Jun 2 06:46:08 	check_reload_status 		Linkup starting em0
    Jun 2 06:46:03 	check_reload_status 		Reloading filter
    Jun 2 06:46:03 	php-fpm 	53768 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:46:02 	kernel 		em0: link state changed to DOWN
    Jun 2 06:46:02 	check_reload_status 		Linkup starting em0
    Jun 2 06:45:39 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:45:39 	check_reload_status 		Reloading filter
    Jun 2 06:45:39 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:45:39 	php-fpm 	52223 	/rc.newwanip: rc.newwanip: on (IP address: 192.168.22.1) (interface: LAN1[lan]) (real interface: em0).
    Jun 2 06:45:39 	php-fpm 	52223 	/rc.newwanip: rc.newwanip: Info: starting on em0.
    Jun 2 06:45:38 	check_reload_status 		Reloading filter
    Jun 2 06:45:38 	check_reload_status 		rc.newwanip starting em0
    Jun 2 06:45:38 	php-fpm 	52223 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:45:37 	kernel 		em0: link state changed to UP
    Jun 2 06:45:37 	check_reload_status 		Linkup starting em0
    Jun 2 06:45:36 	check_reload_status 		Reloading filter
    Jun 2 06:45:36 	php-fpm 	39218 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:45:35 	kernel 		em0: link state changed to DOWN
    Jun 2 06:45:35 	check_reload_status 		Linkup starting em0
    Jun 2 06:45:08 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:45:08 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:45:08 	php-fpm 	39218 	/rc.newwanip: rc.newwanip: on (IP address: 192.168.22.1) (interface: LAN1[lan]) (real interface: em0).
    Jun 2 06:45:08 	php-fpm 	39218 	/rc.newwanip: rc.newwanip: Info: starting on em0.
    Jun 2 06:45:07 	check_reload_status 		rc.newwanip starting em0
    Jun 2 06:45:07 	php-fpm 	39218 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:45:06 	kernel 		em0: link state changed to UP
    Jun 2 06:45:06 	check_reload_status 		Linkup starting em0
    Jun 2 06:45:04 	php-fpm 	39218 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:45:03 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:45:03 	check_reload_status 		Reloading filter
    Jun 2 06:45:03 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:45:03 	php-fpm 	34856 	/rc.newwanip: rc.newwanip: on (IP address: 192.168.22.1) (interface: LAN1[lan]) (real interface: em0).
    Jun 2 06:45:03 	php-fpm 	34856 	/rc.newwanip: rc.newwanip: Info: starting on em0.
    Jun 2 06:45:03 	kernel 		em0: link state changed to DOWN
    Jun 2 06:45:03 	check_reload_status 		Linkup starting em0
    Jun 2 06:45:02 	check_reload_status 		Reloading filter
    Jun 2 06:45:02 	check_reload_status 		rc.newwanip starting em0
    Jun 2 06:45:02 	php-fpm 	34856 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:45:01 	kernel 		em0: link state changed to UP
    Jun 2 06:45:01 	check_reload_status 		Linkup starting em0
    Jun 2 06:45:01 	check_reload_status 		Reloading filter
    Jun 2 06:45:01 	php-fpm 	98795 	/rc.linkup: Hotplug event detected for LAN1(lan) static IP (192.168.22.1 )
    Jun 2 06:45:00 	kernel 		em0: link state changed to DOWN
    Jun 2 06:45:00 	check_reload_status 		Linkup starting em0
    Jun 2 06:37:29 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:37:29 	check_reload_status 		Reloading filter
    Jun 2 06:37:29 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:37:29 	php-fpm 	96971 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 06:37:29 	php-fpm 	96971 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 06:37:28 	check_reload_status 		Reloading filter
    Jun 2 06:37:28 	check_reload_status 		rc.newwanip starting em2
    Jun 2 06:37:28 	php-fpm 	96971 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:37:27 	kernel 		em2: link state changed to UP
    Jun 2 06:37:27 	check_reload_status 		Linkup starting em2
    Jun 2 06:37:26 	check_reload_status 		Reloading filter
    Jun 2 06:37:26 	php-fpm 	76389 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:37:25 	kernel 		em2: link state changed to DOWN
    Jun 2 06:37:25 	check_reload_status 		Linkup starting em2
    Jun 2 06:30:55 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:30:55 	check_reload_status 		Reloading filter
    Jun 2 06:30:55 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:30:55 	php-fpm 	73974 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 06:30:55 	php-fpm 	73974 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 06:30:54 	check_reload_status 		Reloading filter
    Jun 2 06:30:54 	check_reload_status 		rc.newwanip starting em2
    Jun 2 06:30:54 	php-fpm 	73974 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:30:53 	kernel 		em2: link state changed to UP
    Jun 2 06:30:53 	check_reload_status 		Linkup starting em2
    Jun 2 06:30:52 	check_reload_status 		Reloading filter
    Jun 2 06:30:52 	php-fpm 	24267 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:30:51 	kernel 		em2: link state changed to DOWN
    Jun 2 06:30:51 	check_reload_status 		Linkup starting em2
    Jun 2 06:27:44 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:27:44 	check_reload_status 		Reloading filter
    Jun 2 06:27:44 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:27:44 	php-fpm 	22571 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 06:27:44 	php-fpm 	22571 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 06:27:43 	check_reload_status 		Reloading filter
    Jun 2 06:27:43 	check_reload_status 		rc.newwanip starting em2
    Jun 2 06:27:43 	php-fpm 	22571 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:27:42 	kernel 		em2: link state changed to UP
    Jun 2 06:27:42 	check_reload_status 		Linkup starting em2
    Jun 2 06:27:42 	check_reload_status 		Reloading filter
    Jun 2 06:27:42 	php-fpm 	18658 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:27:41 	check_reload_status 		Linkup starting em2
    Jun 2 06:27:41 	kernel 		em2: link state changed to DOWN
    Jun 2 06:27:35 	php-fpm 	72993 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 06:27:34 	check_reload_status 		Reloading filter
    Jun 2 06:27:34 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 06:27:34 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 06:27:34 	check_reload_status 		updating dyndns WANGW
    Jun 2 06:26:41 	php-fpm 	41343 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 06:26:40 	check_reload_status 		Reloading filter
    Jun 2 06:26:40 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 06:26:40 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 06:26:40 	check_reload_status 		updating dyndns WANGW
    Jun 2 06:21:34 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:21:34 	check_reload_status 		Reloading filter
    Jun 2 06:21:34 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:21:34 	php-fpm 	39196 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 06:21:34 	php-fpm 	39196 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 06:21:33 	check_reload_status 		Reloading filter
    Jun 2 06:21:33 	check_reload_status 		rc.newwanip starting em2
    Jun 2 06:21:33 	php-fpm 	39196 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:21:32 	kernel 		em2: link state changed to UP
    Jun 2 06:21:32 	check_reload_status 		Linkup starting em2
    Jun 2 06:21:31 	check_reload_status 		Reloading filter
    Jun 2 06:21:31 	php-fpm 	54640 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:21:30 	kernel 		em2: link state changed to DOWN
    Jun 2 06:21:30 	check_reload_status 		Linkup starting em2
    Jun 2 06:17:22 	php-fpm 	45293 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 06:17:21 	check_reload_status 		Reloading filter
    Jun 2 06:17:21 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 06:17:21 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 06:17:21 	check_reload_status 		updating dyndns WANGW
    Jun 2 06:16:26 	php-fpm 	46466 	/rc.openvpn: OpenVPN: One or more OpenVPN tunnel endpoints may have changed its IP. Reloading endpoints that may use WANGW.
    Jun 2 06:16:25 	check_reload_status 		Reloading filter
    Jun 2 06:16:25 	check_reload_status 		Restarting OpenVPN tunnels/interfaces
    Jun 2 06:16:25 	check_reload_status 		Restarting ipsec tunnels
    Jun 2 06:16:25 	check_reload_status 		updating dyndns WANGW
    Jun 2 06:14:49 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 06:14:49 	check_reload_status 		Reloading filter
    Jun 2 06:14:49 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 06:14:49 	php-fpm 	43883 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 06:14:49 	php-fpm 	43883 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 06:14:48 	check_reload_status 		Reloading filter
    Jun 2 06:14:48 	check_reload_status 		rc.newwanip starting em2
    Jun 2 06:14:48 	php-fpm 	43883 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:14:47 	kernel 		em2: link state changed to UP
    Jun 2 06:14:47 	check_reload_status 		Linkup starting em2
    Jun 2 06:14:46 	check_reload_status 		Reloading filter
    Jun 2 06:14:46 	php-fpm 	15707 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 06:14:45 	kernel 		em2: link state changed to DOWN
    Jun 2 06:14:45 	check_reload_status 		Linkup starting em2
    Jun 2 05:17:55 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 05:17:55 	check_reload_status 		Reloading filter
    Jun 2 05:17:55 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 05:17:55 	php-fpm 	13990 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 05:17:55 	php-fpm 	13990 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 05:17:54 	check_reload_status 		Reloading filter
    Jun 2 05:17:54 	check_reload_status 		rc.newwanip starting em2
    Jun 2 05:17:54 	php-fpm 	13990 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 05:17:53 	kernel 		em2: link state changed to UP
    Jun 2 05:17:53 	check_reload_status 		Linkup starting em2
    Jun 2 05:17:52 	check_reload_status 		Reloading filter
    Jun 2 05:17:52 	php-fpm 	85059 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 05:17:51 	kernel 		em2: link state changed to DOWN
    Jun 2 05:17:51 	check_reload_status 		Linkup starting em2
    Jun 2 04:23:32 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 04:23:32 	check_reload_status 		Reloading filter
    Jun 2 04:23:32 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 04:23:32 	php-fpm 	82645 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 04:23:32 	php-fpm 	82645 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 04:23:31 	check_reload_status 		Reloading filter
    Jun 2 04:23:31 	check_reload_status 		rc.newwanip starting em2
    Jun 2 04:23:31 	php-fpm 	82645 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 04:23:30 	kernel 		em2: link state changed to UP
    Jun 2 04:23:30 	check_reload_status 		Linkup starting em2
    Jun 2 04:23:29 	check_reload_status 		Reloading filter
    Jun 2 04:23:29 	php-fpm 	54144 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 04:23:28 	kernel 		em2: link state changed to DOWN
    Jun 2 04:23:28 	check_reload_status 		Linkup starting em2
    Jun 2 03:35:08 	check_reload_status 		Syncing firewall
    Jun 2 03:35:08 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] The Rules update has finished.
    Jun 2 03:35:08 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Removed 0 obsoleted rules category files.
    Jun 2 03:35:08 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Hide Deprecated Rules is enabled. Removing obsoleted rules categories.
    Jun 2 03:35:08 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Server returned error code 0...
    Jun 2 03:35:08 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Snort GPLv2 Community Rules md5 download failed...
    Jun 2 03:35:08 	php-cgi 		suricata_check_for_rule_updates.php: File 'community-rules.tar.gz.md5' download attempts: 4 ...
    Jun 2 03:34:53 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:34:53 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10544 milliseconds
    Jun 2 03:34:27 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:34:27 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10559 milliseconds
    Jun 2 03:34:01 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:34:01 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10578 milliseconds
    Jun 2 03:33:36 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:33:36 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10552 milliseconds
    Jun 2 03:33:25 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Server returned error code 0...
    Jun 2 03:33:25 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Snort VRT rules md5 download failed...
    Jun 2 03:33:25 	php-cgi 		suricata_check_for_rule_updates.php: File 'snortrules-snapshot-2990.tar.gz.md5' download attempts: 4 ...
    Jun 2 03:33:10 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:33:10 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10561 milliseconds
    Jun 2 03:32:45 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:32:45 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10563 milliseconds
    Jun 2 03:32:19 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:32:19 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10539 milliseconds
    Jun 2 03:31:54 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:31:54 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10558 milliseconds
    Jun 2 03:31:43 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Server returned error code 0...
    Jun 2 03:31:43 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Emerging Threats Open rules md5 download failed...
    Jun 2 03:31:43 	php-cgi 		suricata_check_for_rule_updates.php: File 'emerging.rules.tar.gz.md5' download attempts: 4 ...
    Jun 2 03:31:28 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:31:28 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10587 milliseconds
    Jun 2 03:31:02 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:31:02 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10546 milliseconds
    Jun 2 03:30:37 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:30:37 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10545 milliseconds
    Jun 2 03:30:11 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Will retry in 15 seconds...
    Jun 2 03:30:11 	php-cgi 		suricata_check_for_rule_updates.php: [Suricata] Rules download error: Resolving timed out after 10561 milliseconds
    Jun 2 03:15:39 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 03:15:39 	check_reload_status 		Reloading filter
    Jun 2 03:15:39 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 03:15:39 	php-fpm 	50892 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 03:15:39 	php-fpm 	50892 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 03:15:38 	check_reload_status 		Reloading filter
    Jun 2 03:15:38 	check_reload_status 		rc.newwanip starting em2
    Jun 2 03:15:38 	php-fpm 	50892 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 03:15:37 	kernel 		em2: link state changed to UP
    Jun 2 03:15:37 	check_reload_status 		Linkup starting em2
    Jun 2 03:15:36 	check_reload_status 		Reloading filter
    Jun 2 03:15:36 	php-fpm 	73739 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 03:15:35 	kernel 		em2: link state changed to DOWN
    Jun 2 03:15:35 	check_reload_status 		Linkup starting em2
    Jun 2 03:01:00 	root 		rc.update_bogons.sh is sleeping for 28774
    Jun 2 03:01:00 	root 		rc.update_bogons.sh is starting up.
    Jun 2 01:14:58 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 01:14:58 	check_reload_status 		Reloading filter
    Jun 2 01:14:58 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 01:14:58 	php-fpm 	69364 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 01:14:58 	php-fpm 	69364 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 01:14:57 	check_reload_status 		Reloading filter
    Jun 2 01:14:57 	check_reload_status 		rc.newwanip starting em2
    Jun 2 01:14:57 	php-fpm 	69364 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 01:14:56 	kernel 		em2: link state changed to UP
    Jun 2 01:14:56 	check_reload_status 		Linkup starting em2
    Jun 2 01:14:55 	check_reload_status 		Reloading filter
    Jun 2 01:14:55 	php-fpm 	25962 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 01:14:54 	kernel 		em2: link state changed to DOWN
    Jun 2 01:14:54 	check_reload_status 		Linkup starting em2
    Jun 2 01:11:48 	avahi-daemon 	32980 	avahi-daemon 0.6.31 exiting.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface em0.IPv4 with address 10.10.10.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface em1.IPv4 with address 192.168.24.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface re0.IPv4 with address 192.168.23.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface em1_vlan101.IPv4 with address 192.168.101.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface ovpns1.IPv4 with address 10.22.22.17.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface ovpns2.IPv4 with address 10.22.22.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Leaving mDNS multicast group on interface ovpns5.IPv4 with address 10.22.22.49.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Got SIGTERM, quitting.
    Jun 2 01:11:48 	avahi-daemon 	32980 	write() failed while writing return value to pipe: Broken pipe
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 192.168.22.1 on em0.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 10.10.10.1 on em0.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 192.168.24.1 on em1.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 192.168.23.1 on re0.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 192.168.101.1 on em1_vlan101.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 10.22.22.17 on ovpns1.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 10.22.22.1 on ovpns2.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Registering new address record for 10.22.22.49 on ovpns5.IPv4.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Network interface enumeration completed.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface em0.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface em0.IPv4 with address 10.10.10.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface em1.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface em1.IPv4 with address 192.168.24.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface re0.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface re0.IPv4 with address 192.168.23.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface em1_vlan101.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface em1_vlan101.IPv4 with address 192.168.101.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface ovpns1.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface ovpns1.IPv4 with address 10.22.22.17.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface ovpns2.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface ovpns2.IPv4 with address 10.22.22.1.
    Jun 2 01:11:48 	avahi-daemon 	32980 	New relevant interface ovpns5.IPv4 for mDNS.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Joining mDNS multicast group on interface ovpns5.IPv4 with address 10.22.22.49.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Loading service file /usr/local/etc/avahi/services/ssh.service.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Loading service file /usr/local/etc/avahi/services/sftp-ssh.service.
    Jun 2 01:11:48 	avahi-daemon 	32980 	WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
    Jun 2 01:11:48 	avahi-daemon 	32980 	avahi-daemon 0.6.31 starting up.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Successfully dropped root privileges.
    Jun 2 01:11:48 	avahi-daemon 	32980 	Found user 'avahi' (UID 558) and group 'avahi' (GID 558).
    Jun 2 01:11:47 	postfix/postfix-script 	32017 	fatal: the Postfix mail system is already running
    Jun 2 01:11:47 	check_reload_status 		Syncing firewall
    Jun 2 01:11:45 	upsd 	29602 	User monuser@127.0.0.1 logged into UPS [ActiveJet]
    Jun 2 01:11:45 	upsd 	29602 	Connected to UPS [ActiveJet]: blazer_usb-ActiveJet
    Jun 2 01:11:44 	php-cgi 		nut_email.php: Message sent to admin@wwwwwwwwww OK
    Jun 2 01:11:44 	blazer_usb 	9486 	Startup successful
    Jun 2 01:11:43 	upsd 	29602 	Startup successful
    Jun 2 01:11:43 	upsd 	29301 	Can't connect to UPS [ActiveJet] (blazer_usb-ActiveJet): Connection refused
    Jun 2 01:11:43 	upsd 	29301 	listening on 127.0.0.1 port 3493
    Jun 2 01:11:43 	upsd 	29301 	listening on ::1 port 3493
    Jun 2 01:11:43 	upsd 	29301 	listening on 192.168.22.1 port 3493
    Jun 2 01:11:42 	php-fpm 	21185 	[pfBlockerNG] Starting cron process.
    Jun 2 01:11:42 	upsmon 	27690 	Startup successful
    Jun 2 01:11:41 	blazer_usb 	26175 	Startup successful
    Jun 2 01:11:40 	upsd 	26120 	Startup successful
    Jun 2 01:11:40 	upsd 	26084 	Can't connect to UPS [ActiveJet] (blazer_usb-ActiveJet): No such file or directory
    Jun 2 01:11:40 	upsd 	26084 	listening on 127.0.0.1 port 3493
    Jun 2 01:11:40 	upsd 	26084 	listening on ::1 port 3493
    Jun 2 01:11:40 	upsd 	26084 	listening on 192.168.22.1 port 3493
    Jun 2 01:11:39 	upsmon 	24098 	Startup successful
    Jun 2 01:11:39 	php-fpm 	21185 	/rc.start_packages: Starting service nut
    Jun 2 01:11:39 	upsd 	46991 	Signal 15: exiting
    Jun 2 01:11:39 	upsd 	46991 	mainloop: Interrupted system call
    Jun 2 01:11:39 	upsd 	46991 	User monuser@127.0.0.1 logged out from UPS [ActiveJet]
    Jun 2 01:11:39 	upsmon 	42992 	Signal 15: exiting
    Jun 2 01:11:39 	php-fpm 	21185 	/rc.start_packages: Stopping service nut
    Jun 2 01:11:39 	php-fpm 	21185 	/rc.start_packages: Restarting/Starting all packages.
    Jun 2 01:11:39 	upsmon 	42992 	Communications with UPS ActiveJet lost
    Jun 2 01:11:39 	upsmon 	42992 	Poll UPS [ActiveJet] failed - Driver not connected
    Jun 2 01:11:38 	check_reload_status 		Starting packages
    Jun 2 01:11:38 	php-fpm 	56363 	/rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> 10.22.22.1 - Restarting packages.
    Jun 2 01:11:38 	blazer_usb 	95015 	Permissions problem: Input/output error
    Jun 2 01:11:38 	avahi-daemon 	4324 	avahi-daemon 0.6.31 exiting.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface em0.IPv4 with address 10.10.10.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface em1.IPv4 with address 192.168.24.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface re0.IPv4 with address 192.168.23.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface em1_vlan101.IPv4 with address 192.168.101.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface ovpns1.IPv4 with address 10.22.22.17.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface ovpns2.IPv4 with address 10.22.22.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Leaving mDNS multicast group on interface ovpns5.IPv4 with address 10.22.22.49.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Got SIGTERM, quitting.
    Jun 2 01:11:38 	avahi-daemon 	4324 	write() failed while writing return value to pipe: Broken pipe
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 192.168.22.1 on em0.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 10.10.10.1 on em0.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 192.168.24.1 on em1.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 192.168.23.1 on re0.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 192.168.101.1 on em1_vlan101.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 10.22.22.17 on ovpns1.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 10.22.22.1 on ovpns2.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Registering new address record for 10.22.22.49 on ovpns5.IPv4.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Network interface enumeration completed.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface em0.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface em0.IPv4 with address 10.10.10.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface em1.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface em1.IPv4 with address 192.168.24.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface re0.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface re0.IPv4 with address 192.168.23.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface em1_vlan101.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface em1_vlan101.IPv4 with address 192.168.101.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface ovpns1.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface ovpns1.IPv4 with address 10.22.22.17.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface ovpns2.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface ovpns2.IPv4 with address 10.22.22.1.
    Jun 2 01:11:38 	avahi-daemon 	4324 	New relevant interface ovpns5.IPv4 for mDNS.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Joining mDNS multicast group on interface ovpns5.IPv4 with address 10.22.22.49.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Loading service file /usr/local/etc/avahi/services/ssh.service.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Loading service file /usr/local/etc/avahi/services/sftp-ssh.service.
    Jun 2 01:11:38 	avahi-daemon 	4324 	WARNING: No NSS support for mDNS detected, consider installing nss-mdns!
    Jun 2 01:11:38 	avahi-daemon 	4324 	avahi-daemon 0.6.31 starting up.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Successfully dropped root privileges.
    Jun 2 01:11:38 	avahi-daemon 	4324 	Found user 'avahi' (UID 558) and group 'avahi' (GID 558).
    Jun 2 01:11:37 	postfix/postfix-script 	2440 	fatal: the Postfix mail system is already running
    Jun 2 01:11:37 	avahi-daemon 	78976 	avahi-daemon 0.6.31 exiting.
    Jun 2 01:11:37 	avahi-daemon 	78976 	Leaving mDNS multicast group on interface em1.IPv4 with address 192.168.24.1.
    Jun 2 01:11:37 	avahi-daemon 	78976 	Leaving mDNS multicast group on interface re0.IPv4 with address 192.168.23.1.
    Jun 2 01:11:37 	avahi-daemon 	78976 	Leaving mDNS multicast group on interface em1_vlan101.IPv4 with address 192.168.101.1.
    Jun 2 01:11:37 	avahi-daemon 	78976 	Leaving mDNS multicast group on interface ovpns1.IPv4 with address 10.22.22.17.
    Jun 2 01:11:37 	avahi-daemon 	78976 	IP_DROP_MEMBERSHIP failed: Can't assign requested address
    Jun 2 01:11:37 	avahi-daemon 	78976 	Leaving mDNS multicast group on interface ovpns5.IPv4 with address 10.22.22.49.
    Jun 2 01:11:37 	avahi-daemon 	78976 	Got SIGTERM, quitting.
    Jun 2 01:11:37 	check_reload_status 		Syncing firewall
    Jun 2 01:11:36 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 01:11:36 	php-fpm 	56363 	/rc.newwanip: Creating rrd update script
    Jun 2 01:11:36 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 01:11:35 	dhcpleases 		kqueue error: unkown
    Jun 2 01:11:35 	php-fpm 	56363 	/rc.newwanip: The command '/usr/local/sbin/unbound -c /var/unbound/unbound.conf' returned exit code '1', the output was '[1496358695] unbound[36645:0] error: bind: address already in use [1496358695] unbound[36645:0] fatal error: could not open ports'
    Jun 2 01:11:34 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 01:11:34 	upsd 	46991 	User monuser@127.0.0.1 logged into UPS [ActiveJet]
    Jun 2 01:11:34 	upsd 	46991 	Connected to UPS [ActiveJet]: blazer_usb-ActiveJet
    Jun 2 01:11:33 	blazer_usb 	95015 	Startup successful
    Jun 2 01:11:32 	upsd 	46991 	Startup successful
    Jun 2 01:11:32 	upsd 	45933 	Can't connect to UPS [ActiveJet] (blazer_usb-ActiveJet): Connection refused
    Jun 2 01:11:32 	upsd 	45933 	listening on 127.0.0.1 port 3493
    Jun 2 01:11:32 	upsd 	45933 	listening on ::1 port 3493
    Jun 2 01:11:32 	upsd 	45933 	listening on 192.168.22.1 port 3493
    Jun 2 01:11:31 	upsmon 	42435 	Startup successful
    Jun 2 01:11:30 	php-fpm 	21185 	[pfBlockerNG] Starting cron process.
    Jun 2 01:11:30 	upsd 	31019 	User monuser@127.0.0.1 logged into UPS [ActiveJet]
    Jun 2 01:11:30 	upsd 	31019 	Connected to UPS [ActiveJet]: blazer_usb-ActiveJet
    Jun 2 01:11:29 	blazer_usb 	31353 	Startup successful
    Jun 2 01:11:28 	upsd 	31019 	Startup successful
    Jun 2 01:11:28 	upsd 	30745 	Can't connect to UPS [ActiveJet] (blazer_usb-ActiveJet): No such file or directory
    Jun 2 01:11:28 	upsd 	30745 	listening on 127.0.0.1 port 3493
    Jun 2 01:11:28 	upsd 	30745 	listening on ::1 port 3493
    Jun 2 01:11:28 	upsd 	30745 	listening on 192.168.22.1 port 3493
    Jun 2 01:11:27 	upsmon 	28872 	Startup successful
    Jun 2 01:11:27 	php-fpm 	21185 	/rc.start_packages: Starting service nut
    Jun 2 01:11:27 	blazer_usb 	10723 	Signal 15: exiting
    Jun 2 01:11:25 	upsd 	90834 	Signal 15: exiting
    Jun 2 01:11:25 	upsd 	90834 	mainloop: Interrupted system call
    Jun 2 01:11:25 	upsmon 	87730 	upsmon parent: read
    Jun 2 01:11:25 	upsd 	90834 	User monuser@127.0.0.1 logged out from UPS [ActiveJet]
    Jun 2 01:11:25 	upsmon 	89031 	Signal 15: exiting
    Jun 2 01:11:25 	php-fpm 	21185 	/rc.start_packages: Stopping service nut
    Jun 2 01:11:25 	php-fpm 	21185 	/rc.start_packages: Restarting/Starting all packages.
    Jun 2 01:11:24 	php-fpm 	56363 	/rc.newwanip: IP has changed, killing states on former IP 0.0.0.0.
    Jun 2 01:11:24 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 01:11:24 	php-fpm 	56363 	/rc.newwanip: rc.newwanip: on (IP address: 10.22.22.1) (interface: VPN_SERVER[opt6]) (real interface: ovpns2).
    Jun 2 01:11:24 	php-fpm 	56363 	/rc.newwanip: rc.newwanip: Info: starting on ovpns2.
    Jun 2 01:11:24 	check_reload_status 		Starting packages
    Jun 2 01:11:24 	php-fpm 	56363 	/rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xx.xx.xx.yy - Restarting packages.
    Jun 2 01:11:22 	check_reload_status 		rc.newwanip starting ovpns2
    Jun 2 01:11:22 	php-fpm 	56363 	/rc.newwanip: Creating rrd update script
    Jun 2 01:11:22 	check_reload_status 		Reloading filter
    Jun 2 01:11:22 	php-fpm 	56363 	OpenVPN PID written: 94043
    Jun 2 01:11:22 	kernel 		ovpns2: link state changed to UP
    Jun 2 01:11:22 	check_reload_status 		Reloading filter
    Jun 2 01:11:22 	avahi-daemon 	78976 	Withdrawing workstation service for ovpns2.
    Jun 2 01:11:22 	avahi-daemon 	78976 	Interface ovpns2.IPv4 no longer relevant for mDNS.
    Jun 2 01:11:22 	avahi-daemon 	78976 	Leaving mDNS multicast group on interface ovpns2.IPv4 with address 10.22.22.1.
    Jun 2 01:11:22 	avahi-daemon 	78976 	Withdrawing address record for 10.22.22.1 on ovpns2.
    Jun 2 01:11:22 	kernel 		ovpns2: link state changed to DOWN
    Jun 2 01:11:22 	php-fpm 	56363 	OpenVPN terminate old pid: 51788
    Jun 2 01:11:22 	php-fpm 	56363 	/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
    Jun 2 01:11:20 	dhcpleases 		kqueue error: unkown
    Jun 2 01:11:20 	dhcpleases 		Could not deliver signal HUP to process because its pidfile (/var/run/unbound.pid) does not exist, No such process.
    Jun 2 01:11:19 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 01:11:18 	php-fpm 	56363 	/rc.newwanip: ROUTING: setting default route to xx.xx.xx.xx
    Jun 2 01:11:14 	php-fpm 	56363 	/rc.newwanip: IP has changed, killing states on former IP 0.0.0.0.
    Jun 2 01:11:14 	dhcpleases 		/var/etc/hosts changed size from original!
    Jun 2 01:11:14 	php-fpm 	56363 	/rc.newwanip: rc.newwanip: on (IP address: xx.xx.xx.yy) (interface: WAN[wan]) (real interface: em2).
    Jun 2 01:11:14 	php-fpm 	56363 	/rc.newwanip: rc.newwanip: Info: starting on em2.
    Jun 2 01:11:13 	check_reload_status 		Reloading filter
    Jun 2 01:11:13 	check_reload_status 		rc.newwanip starting em2
    Jun 2 01:11:13 	php-fpm 	56363 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 01:11:12 	kernel 		em2: link state changed to UP
    Jun 2 01:11:12 	check_reload_status 		Linkup starting em2
    Jun 2 01:11:11 	check_reload_status 		Reloading filter
    Jun 2 01:11:11 	php-fpm 	38898 	/rc.linkup: Hotplug event detected for WAN(wan) static IP (xx.xx.xx.yy )
    Jun 2 01:11:10 	check_reload_status 		Linkup starting em2
    Jun 2 01:11:10 	kernel 		em2: link state changed to DOWN
    Jun 2 01:11:10 	avahi-daemon 	78976 	Withdrawing workstation service for em2\. 
    

    edit:
    it looks like I can't add all as code so see attachments

    resolver.txt
    dhcp.txt



  • Hit with the same issue today running 2.3.4-p1. First time I've seen the issue.. Unbound was shown in a stopped state, with no indication as to why it restarted in the first place.

    Could see the following logs, so it looked like it attempted to restart then couldn't read the config.

    Time Process PID Message
    Aug 18 04:59:18 unbound 36953:0 info: 0.000000 0.000001 1
    Aug 18 04:59:18 unbound 36953:0 info: 0.008192 0.016384 2
    Aug 18 04:59:18 unbound 36953:0 info: 0.016384 0.032768 5
    Aug 18 04:59:18 unbound 36953:0 info: 0.032768 0.065536 2
    Aug 18 04:59:18 unbound 36953:0 info: 0.065536 0.131072 3
    Aug 18 04:59:18 unbound 36953:0 info: 0.262144 0.524288 1
    Aug 18 04:59:18 unbound 36953:0 notice: Restart of unbound 1.6.1.
    Aug 18 04:59:18 unbound 36953:0 fatal error: Could not read config file: /unbound.conf



  • EDIT: I posted this before I checked what happened after my last reboot. It works now.

    Did this and then rebooted:
    rm /var/unbound/root.key
    unbound-anchor -a /var/unbound/root.key
    chown unbound /var/unbound/root.key

    @noons:

    Hit with the same issue today running 2.3.4-p1. First time I've seen the issue.. Unbound was shown in a stopped state, with no indication as to why it restarted in the first place.

    Same thing happened to me today.
    Same error as this:
    https://forum.pfsense.org/index.php?topic=97205.0

    These steps didn't help:
    https://forum.pfsense.org/index.php?topic=87357.0

    Reported as a bug 2 years ago:
    https://redmine.pfsense.org/issues/5334



  • If I choose my interfaces in resolver and include "IPv6 link-local" my resolver will not start when rebooted or updated. This has happened in the past and seems to have regressed.

    Starting the service manually does work.