Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    WAN only connects on unplug and plug back in

    Scheduled Pinned Locked Moved General pfSense Questions
    59 Posts 4 Posters 3.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S
      stephenw10 Netgate Administrator
      last edited by

      Unlikely, it probably doesn't have an IPv6 address.

      Which pfSense version is this?

      randombitsR 1 Reply Last reply Reply Quote 0
      • randombitsR
        randombits @stephenw10
        last edited by

        @stephenw10 I just remembered I did briefly enable IPv6 in the WAN basically to see if it would pick up an address from my ISP it did. But I undid it. I'm using version

        pfSense CE version 2.7.2-RELEASE (amd64)
        built on Wed Dec 6 20:10:00 GMT 2023
        FreeBSD 14.0-CURRENT
        
        1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator
          last edited by

          Hmm what do you see if you run?:

          [2.7.2-RELEASE][admin@cedev-6.stevew.lan]/root: /sbin/route -n6 get 'default'
          route: route has not been found: No error: 0
          

          For some reason that is returning 1 for you during bootup which is probably preventing the rest of the script running.

          randombitsR 1 Reply Last reply Reply Quote 0
          • randombitsR
            randombits @stephenw10
            last edited by randombits

            @stephenw10 When it's working ok the same as you

            [2.7.2-RELEASE][root@pfSense.localdomain]/root: /sbin/route -n6 get 'default'
            route: route has not been found: No error: 0
            

            I need to wait a bit before I can reboot and take the internet down as I'm up and downloading....

            Just rebooted and it's the (no internet) 😕

            [2.7.2-RELEASE][root@pfSense.localdomain]/root: /sbin/route -n6 get 'default'
            route: route has not been found: No error: 0
            
            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              OK, so that's the no default IPv4 route situation?

              randombitsR 1 Reply Last reply Reply Quote 0
              • randombitsR
                randombits @stephenw10
                last edited by

                @stephenw10 indeed, until WAN up-down

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Hmm, curious. Try setting the IPv6 default gateway to something, WAN_DHCPv6 for example. That should remove the error at least.

                  randombitsR 1 Reply Last reply Reply Quote 0
                  • randombitsR
                    randombits @stephenw10
                    last edited by randombits

                    @stephenw10 Well, As a sanity(in) check I installed another pfSense (VM) and lo and behold that has the same issue !

                    What I have is Proxmox with a single ethernet port with Proxmox provides the two NIC's for pfSense, the WAN NIC is on vlan 1000 and the switch splits that of into to ports. The ONT port is untagged 1000 solely (no vlan 1 internal to the switch) and LAN and other vlans are on one of the other ports

                    	g1	Trunk	1	1U	 
                    	g2	Trunk	1	1U	 
                    	g3	Trunk	1	1U	 
                    	g4	Trunk	1	1U	 
                    	g5	Trunk	1	1U,10T,20T,999T	 
                    	g6	Trunk	1	1U,10T,20T,999T,1000T	 
                    	g7	Access	1000	1000U	 
                    	g8	Trunk	1	1U,10T,20T,999T	 
                    
                    Switch ports
                    1	-		1U
                    2	-		1U
                    3	-		1U
                    4	SPA		1U
                    5	AP		1U,10T,20T,999T	 
                    6	Server	        1U,10T,20T,999T,1000T	 
                    7	Modem	        1000U
                    8	-		1U,10T,20T,999T
                    
                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      Hmm, this starts to feel like a timing issue. I'm testing pretty much exactly that setup though without using VLANs.

                      Your WAN is pulling a DHCP lease from the ISP directly?

                      Does your test VM come up correctly if it pulls a lease from a local server?

                      randombitsR 1 Reply Last reply Reply Quote 0
                      • randombitsR
                        randombits @stephenw10
                        last edited by randombits

                        @stephenw10 Yes, the WAN address is coming from the ISP directly, the ISP told me to set DHCP and set PNP - not a good idea so I didn't.

                        Not tested the local test VM other than setting it's WAN & LAN. It messed up a bit with my current pfSense running and every thing got a bit confused ... I'll have another go in a moment with the test VM.

                        I first conntacted my ISP with the issue and as expected they weren't a great deal of help. I'm maybe only one of very few that use a different router than the supplied Adtran - the ONT is Adtran too.

                        I set the test VM to get it's WAN from the main pfSense LAN and that worked, got an IP for it and can ping out.

                        The main pfSense gets an IP but no internet. One thing I thought is I wonder if the ISP has updated the firmware in the ONT or OLT, I asked but answer on that. Incidentally the supplied ISP's router connects ok

                        ------------ rebooted test VM -----------
                        
                        
                        Aug 22 17:24:25	syslogd		kernel boot file is /boot/kernel/kernel
                        Aug 22 17:24:25	kernel		---<<BOOT>>---
                        Aug 22 17:24:25	kernel		Copyright (c) 1992-2023 The FreeBSD Project.
                        Aug 22 17:24:25	kernel		Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
                        Aug 22 17:24:25	kernel		The Regents of the University of California. All rights reserved.
                        Aug 22 17:24:25	kernel		FreeBSD is a registered trademark of The FreeBSD Foundation.
                        Aug 22 17:24:25	kernel		FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023
                        Aug 22 17:24:25	kernel		root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64
                        Aug 22 17:24:25	kernel		FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
                        Aug 22 17:24:25	kernel		VT(vga): text 80x25
                        Aug 22 17:24:25	kernel		CPU: QEMU Virtual CPU version 2.5+ (2496.09-MHz K8-class CPU)
                        Aug 22 17:24:25	kernel		Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1
                        Aug 22 17:24:25	kernel		Features=0x783fbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2>
                        Aug 22 17:24:25	kernel		Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV>
                        Aug 22 17:24:25	kernel		AMD Features=0x20100800<SYSCALL,NX,LM>
                        Aug 22 17:24:25	kernel		AMD Features2=0x1<LAHF>
                        Aug 22 17:24:25	kernel		Hypervisor: Origin = "KVMKVMKVM"
                        Aug 22 17:24:25	kernel		real memory = 2147483648 (2048 MB)
                        Aug 22 17:24:25	kernel		avail memory = 2016673792 (1923 MB)
                        Aug 22 17:24:25	kernel		Event timer "LAPIC" quality 100
                        Aug 22 17:24:25	kernel		ACPI APIC Table: <BOCHS BXPC >
                        Aug 22 17:24:25	kernel		random: unblocking device.
                        Aug 22 17:24:25	kernel		ioapic0 <Version 1.1> irqs 0-23
                        Aug 22 17:24:25	kernel		TCP_ratelimit: Is now initialized
                        Aug 22 17:24:25	kernel		wlan: mac acl policy registered
                        Aug 22 17:24:25	kernel		ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                        Aug 22 17:24:25	kernel		ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                        Aug 22 17:24:25	kernel		module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1
                        Aug 22 17:24:25	kernel		ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                        Aug 22 17:24:25	kernel		ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                        Aug 22 17:24:25	kernel		module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1
                        Aug 22 17:24:25	kernel		ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                        Aug 22 17:24:25	kernel		ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                        Aug 22 17:24:25	kernel		module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1
                        Aug 22 17:24:25	kernel		iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                        Aug 22 17:24:25	kernel		iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                        Aug 22 17:24:25	kernel		module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1
                        Aug 22 17:24:25	kernel		iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                        Aug 22 17:24:25	kernel		iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                        Aug 22 17:24:25	kernel		module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1
                        Aug 22 17:24:25	kernel		iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                        Aug 22 17:24:25	kernel		iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                        Aug 22 17:24:25	kernel		module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1
                        Aug 22 17:24:25	kernel		random: entropy device external interface
                        Aug 22 17:24:25	kernel		kbd1 at kbdmux0
                        Aug 22 17:24:25	kernel		WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
                        Aug 22 17:24:25	kernel		netgate0: <QEMU Guest>
                        Aug 22 17:24:25	kernel		kvmclock0: <KVM paravirtual clock>
                        Aug 22 17:24:25	kernel		Timecounter "kvmclock" frequency 1000000000 Hz quality 975
                        Aug 22 17:24:25	kernel		kvmclock0: registered as a time-of-day clock, resolution 0.000001s
                        Aug 22 17:24:25	kernel		vtvga0: <VT VGA driver>
                        Aug 22 17:24:25	kernel		smbios0: <System Management BIOS> at iomem 0xf5290-0xf52ae
                        Aug 22 17:24:25	kernel		smbios0: Version: 2.8, BCD Revision: 2.8
                        Aug 22 17:24:25	kernel		acpi0: <BOCHS BXPC>
                        Aug 22 17:24:25	kernel		acpi0: Power Button (fixed)
                        Aug 22 17:24:25	kernel		cpu0: <ACPI CPU> on acpi0
                        Aug 22 17:24:25	kernel		atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
                        Aug 22 17:24:25	kernel		atrtc0: registered as a time-of-day clock, resolution 1.000000s
                        Aug 22 17:24:25	kernel		Event timer "RTC" frequency 32768 Hz quality 0
                        Aug 22 17:24:25	kernel		hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
                        Aug 22 17:24:25	kernel		Timecounter "HPET" frequency 100000000 Hz quality 950
                        Aug 22 17:24:25	kernel		Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
                        Aug 22 17:24:25	kernel		acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
                        Aug 22 17:24:25	kernel		pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
                        Aug 22 17:24:25	kernel		pci0: <ACPI PCI bus> on pcib0
                        Aug 22 17:24:25	kernel		isab0: <PCI-ISA bridge> at device 1.0 on pci0
                        Aug 22 17:24:25	kernel		isa0: <ISA bus> on isab0
                        Aug 22 17:24:25	kernel		atapci0: <Intel PIIX3 WDMA2 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf0a0-0xf0af at device 1.1 on pci0
                        Aug 22 17:24:25	kernel		ata0: <ATA channel> at channel 0 on atapci0
                        Aug 22 17:24:25	kernel		ata1: <ATA channel> at channel 1 on atapci0
                        Aug 22 17:24:25	kernel		uhci0: <Intel 82371SB (PIIX3) USB controller> port 0xf040-0xf05f irq 11 at device 1.2 on pci0
                        Aug 22 17:24:25	kernel		usbus0 on uhci0
                        Aug 22 17:24:25	kernel		pci0: <bridge> at device 1.3 (no driver attached)
                        Aug 22 17:24:25	kernel		vgapci0: <VGA-compatible display> mem 0xfc000000-0xfcffffff,0xfea90000-0xfea90fff at device 2.0 on pci0
                        Aug 22 17:24:25	kernel		vgapci0: Boot video device
                        Aug 22 17:24:25	kernel		virtio_pci0: <VirtIO PCI (legacy) Balloon adapter> port 0xf000-0xf03f mem 0xfd600000-0xfd603fff irq 11 at device 3.0 on pci0
                        Aug 22 17:24:25	kernel		vtballoon0: <VirtIO Balloon Adapter> on virtio_pci0
                        Aug 22 17:24:25	kernel		pcib1: <ACPI PCI-PCI bridge> mem 0xfea91000-0xfea910ff irq 10 at device 5.0 on pci0
                        Aug 22 17:24:25	kernel		pci1: <ACPI PCI bus> on pcib1
                        Aug 22 17:24:25	kernel		virtio_pci1: <VirtIO PCI (legacy) SCSI adapter> port 0xe000-0xe03f mem 0xfe800000-0xfe800fff,0xfd400000-0xfd403fff irq 10 at device 1.0 on pci1
                        Aug 22 17:24:25	kernel		vtscsi0: <VirtIO SCSI Adapter> on virtio_pci1
                        Aug 22 17:24:25	kernel		virtio_pci2: <VirtIO PCI (legacy) Network adapter> port 0xf060-0xf07f mem 0xfea92000-0xfea92fff,0xfd604000-0xfd607fff irq 10 at device 18.0 on pci0
                        Aug 22 17:24:25	kernel		vtnet0: <VirtIO Networking Adapter> on virtio_pci2
                        Aug 22 17:24:25	kernel		vtnet0: Ethernet address: bc:24:11:23:6c:e0
                        Aug 22 17:24:25	kernel		vtnet0: netmap queues/slots: TX 1/256, RX 1/512
                        Aug 22 17:24:25	kernel		000.000761 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512
                        Aug 22 17:24:25	kernel		virtio_pci3: <VirtIO PCI (legacy) Network adapter> port 0xf080-0xf09f mem 0xfea93000-0xfea93fff,0xfd608000-0xfd60bfff irq 11 at device 19.0 on pci0
                        Aug 22 17:24:25	kernel		vtnet1: <VirtIO Networking Adapter> on virtio_pci3
                        Aug 22 17:24:25	kernel		vtnet1: Ethernet address: bc:24:11:95:85:5e
                        Aug 22 17:24:25	kernel		vtnet1: netmap queues/slots: TX 1/256, RX 1/512
                        Aug 22 17:24:25	kernel		000.000762 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512
                        Aug 22 17:24:25	kernel		pcib2: <ACPI PCI-PCI bridge> mem 0xfea94000-0xfea940ff irq 10 at device 30.0 on pci0
                        Aug 22 17:24:25	kernel		pci2: <ACPI PCI bus> on pcib2
                        Aug 22 17:24:25	kernel		pcib3: <ACPI PCI-PCI bridge> mem 0xfea95000-0xfea950ff irq 11 at device 31.0 on pci0
                        Aug 22 17:24:25	kernel		pci3: <ACPI PCI bus> on pcib3
                        Aug 22 17:24:25	kernel		acpi_syscontainer0: <System Container> on acpi0
                        Aug 22 17:24:25	kernel		vmgenc0: <VM Generation Counter> on acpi0
                        Aug 22 17:24:25	kernel		acpi_syscontainer1: <System Container> port 0xaf00-0xaf0b on acpi0
                        Aug 22 17:24:25	kernel		acpi_syscontainer2: <System Container> port 0xafe0-0xafe3 on acpi0
                        Aug 22 17:24:25	kernel		acpi_syscontainer3: <System Container> port 0xae00-0xae17 on acpi0
                        Aug 22 17:24:25	kernel		atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
                        Aug 22 17:24:25	kernel		atkbd0: <AT Keyboard> irq 1 on atkbdc0
                        Aug 22 17:24:25	kernel		kbd0 at atkbd0
                        Aug 22 17:24:25	kernel		atkbd0: [GIANT-LOCKED]
                        Aug 22 17:24:25	kernel		psm0: <PS/2 Mouse> irq 12 on atkbdc0
                        Aug 22 17:24:25	kernel		psm0: [GIANT-LOCKED]
                        Aug 22 17:24:25	kernel		WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
                        Aug 22 17:24:25	kernel		psm0: model IntelliMouse Explorer, device ID 4
                        Aug 22 17:24:25	kernel		fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
                        Aug 22 17:24:25	kernel		fdc0: does not respond
                        Aug 22 17:24:25	kernel		device_attach: fdc0 attach returned 6
                        Aug 22 17:24:25	kernel		orm0: <ISA Option ROM> at iomem 0xe7800-0xeffff pnpid ORM0000 on isa0
                        Aug 22 17:24:25	kernel		vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
                        Aug 22 17:24:25	kernel		attimer0: <AT timer> at port 0x40 on isa0
                        Aug 22 17:24:25	kernel		Timecounter "i8254" frequency 1193182 Hz quality 0
                        Aug 22 17:24:25	kernel		Event timer "i8254" frequency 1193182 Hz quality 100
                        Aug 22 17:24:25	kernel		fdc0: No FDOUT register!
                        Aug 22 17:24:25	kernel		Timecounter "TSC-low" frequency 1247999989 Hz quality 800
                        Aug 22 17:24:25	kernel		Timecounters tick every 10.000 msec
                        Aug 22 17:24:25	kernel		usbus0: 12Mbps Full Speed USB v1.0
                        Aug 22 17:24:25	kernel		ZFS filesystem version: 5
                        Aug 22 17:24:25	kernel		ZFS storage pool version: features support (5000)
                        Aug 22 17:24:25	kernel		ugen0.1: <Intel UHCI root HUB> at usbus0
                        Aug 22 17:24:25	kernel		uhub0 on usbus0
                        Aug 22 17:24:25	kernel		uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
                        Aug 22 17:24:25	kernel		Trying to mount root from zfs:pfSense/ROOT/default []...
                        Aug 22 17:24:25	kernel		cd0 at ata1 bus 0 scbus1 target 0 lun 0
                        Aug 22 17:24:25	kernel		cd0: <QEMU QEMU DVD-ROM 2.5+> Removable CD-ROM SCSI device
                        Aug 22 17:24:25	kernel		cd0: Serial Number QM00003
                        Aug 22 17:24:25	kernel		cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes)
                        Aug 22 17:24:25	kernel		cd0: 1369MB (701060 2048 byte sectors)
                        Aug 22 17:24:25	kernel		da0 at vtscsi0 bus 0 scbus2 target 0 lun 0
                        Aug 22 17:24:25	kernel		da0: <QEMU QEMU HARDDISK 2.5+> Fixed Direct Access SPC-3 SCSI device
                        Aug 22 17:24:25	kernel		da0: 300.000MB/s transfers
                        Aug 22 17:24:25	kernel		da0: Command Queueing enabled
                        Aug 22 17:24:25	kernel		da0: 32768MB (67108864 512 byte sectors)
                        Aug 22 17:24:25	kernel		uhub0: 2 ports with 2 removable, self powered
                        Aug 22 17:24:25	kernel		ugen0.2: <QEMU QEMU USB Tablet> at usbus0
                        Aug 22 17:24:25	kernel		uhid0 on uhub0
                        Aug 22 17:24:25	kernel		uhid0: <QEMU QEMU USB Tablet, class 0/0, rev 2.00/0.00, addr 2> on usbus0
                        Aug 22 17:24:25	kernel		CPU: QEMU Virtual CPU version 2.5+ (2496.00-MHz K8-class CPU)
                        Aug 22 17:24:25	kernel		Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1
                        Aug 22 17:24:25	kernel		Features=0x78bfbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
                        Aug 22 17:24:25	kernel		Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV>
                        Aug 22 17:24:25	kernel		AMD Features=0x20100800<SYSCALL,NX,LM>
                        Aug 22 17:24:25	kernel		AMD Features2=0x1<LAHF>
                        Aug 22 17:24:25	kernel		Hypervisor: Origin = "KVMKVMKVM"
                        Aug 22 17:24:25	kernel		intsmb0: <Intel PIIX4 SMBUS Interface> irq 9 at device 1.3 on pci0
                        Aug 22 17:24:25	kernel		intsmb0: intr IRQ 9 enabled revision 0
                        Aug 22 17:24:25	kernel		smbus0: <System Management Bus> on intsmb0
                        Aug 22 17:24:25	kernel		lo0: link state changed to UP
                        Aug 22 17:24:25	kernel		done.
                        Aug 22 17:24:25	kernel		vtnet1: link state changed to UP
                        Aug 22 17:24:25	kernel		vtnet0: link state changed to UP
                        Aug 22 17:24:25	check_reload_status	445	Linkup starting vtnet1
                        Aug 22 17:24:25	check_reload_status	445	Linkup starting vtnet0
                        Aug 22 17:24:26	php-fpm	396	/rc.linkup: Ignoring link event during boot sequence.
                        Aug 22 17:25:26	php-cgi	465	rc.bootup: calling interface_dhcpv6_configure.
                        Aug 22 17:25:26	php-cgi	465	rc.bootup: Accept router advertisements on interface vtnet0
                        Aug 22 17:25:26	php-cgi	465	rc.bootup: Starting DHCP6 client for interfaces vtnet0 in DHCP6 without RA mode
                        Aug 22 17:25:26	php-cgi	465	rc.bootup: Starting rtsold process on wan(vtnet0)
                        Aug 22 17:25:28	php-cgi	465	rc.bootup: Resyncing OpenVPN instances.
                        Aug 22 17:25:28	kernel		done.
                        Aug 22 17:25:28	kernel		pflog0: promiscuous mode enabled
                        Aug 22 17:25:28	php-cgi	465	rc.bootup: Gateway, NONE AVAILABLE
                        Aug 22 17:25:28	kernel		.done.
                        Aug 22 17:25:28	kernel		done.
                        Aug 22 17:25:28	php-cgi	465	rc.bootup: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:25:29	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:30	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:31	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:32	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:33	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:34	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:35	php-cgi	465	rc.bootup: Unbound start waiting on dhcp6c.
                        Aug 22 17:25:35	php-fpm	396	/rc.newwanipv6: rc.newwanipv6: Info: starting on vtnet0.
                        Aug 22 17:25:35	php-fpm	396	/rc.newwanipv6: rc.newwanipv6: on (IP address: 2a0c:4f47:8030:2::1) (interface: wan) (real interface: vtnet0).
                        Aug 22 17:25:35	php-fpm	396	/rc.newwanipv6: Gateway, NONE AVAILABLE
                        Aug 22 17:25:35	php-fpm	396	/rc.newwanipv6: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:25:36	php-cgi	465	rc.bootup: dhcp6 init complete. Continuing
                        Aug 22 17:25:36	php-cgi	465	rc.bootup: sync unbound done.
                        Aug 22 17:25:36	kernel		done.
                        Aug 22 17:25:37	kernel		done.
                        Aug 22 17:26:07	kernel		done.
                        Aug 22 17:26:07	kernel		done.
                        Aug 22 17:26:07	php-cgi	465	rc.bootup: NTPD is starting up.
                        Aug 22 17:26:08	kernel		done.
                        Aug 22 17:26:08	check_reload_status	445	Updating all dyndns
                        Aug 22 17:26:09	kernel		....
                        Aug 22 17:26:09	php-cgi	465	rc.bootup: The command '/usr/local/sbin/strongswanrc stop' returned exit code '1', the output was 'strongswan not running? (check /var/run/daemon-charon.pid).'
                        Aug 22 17:26:09	kernel		.done.
                        Aug 22 17:26:13	php-cgi	465	rc.bootup: Creating rrd update script
                        Aug 22 17:26:13	syslogd		exiting on signal 15
                        Aug 22 17:26:13	syslogd		kernel boot file is /boot/kernel/kernel
                        Aug 22 17:26:13	kernel		done.
                        Aug 22 17:26:14	php-fpm	396	/rc.start_packages: Restarting/Starting all packages.
                        Aug 22 17:26:14	root	36514	Bootup complete
                        Aug 22 17:26:15	login	79662	login on ttyv0 as root
                        Aug 22 17:26:15	sshguard	81305	Now monitoring attacks.
                        Aug 22 17:36:33	check_reload_status	445	rc.newwanip starting vtnet0
                        Aug 22 17:36:34	php-fpm	396	/rc.newwanip: rc.newwanip: Info: starting on vtnet0.
                        Aug 22 17:36:34	php-fpm	396	/rc.newwanip: rc.newwanip: on (IP address: xxx.xxx.xxx.xxx) (interface: WAN[wan]) (real interface: vtnet0).
                        Aug 22 17:36:37	php-fpm	396	/rc.newwanip: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP'
                        Aug 22 17:36:37	php-fpm	396	/rc.newwanip: Default gateway setting Interface WAN_DHCP Gateway as default.
                        Aug 22 17:36:37	rc.gateway_alarm	58962	>>> Gateway alarm: WAN_DHCP (Addr:xxx.xxx.xxx.xxx Alarm:1 RTT:0ms RTTsd:0ms Loss:100%)
                        Aug 22 17:36:37	check_reload_status	445	updating dyndns WAN_DHCP
                        Aug 22 17:36:37	check_reload_status	445	Restarting IPsec tunnels
                        Aug 22 17:36:37	check_reload_status	445	Restarting OpenVPN tunnels/interfaces
                        Aug 22 17:36:37	check_reload_status	445	Reloading filter
                        Aug 22 17:36:37	php-fpm	396	/rc.newwanip: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:36:37	php-fpm	396	/rc.newwanip: IP Address has changed, killing states on former IP Address 0.0.0.0.
                        Aug 22 17:36:37	php-fpm	396	/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
                        Aug 22 17:36:37	php-fpm	396	/rc.newwanip: Creating rrd update script
                        Aug 22 17:36:38	php-fpm	75474	/rc.openvpn: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP'
                        Aug 22 17:36:38	php-fpm	75474	/rc.openvpn: Default gateway setting Interface WAN_DHCP Gateway as default.
                        Aug 22 17:36:38	php-fpm	75474	/rc.openvpn: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:36:39	php-fpm	396	/rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xxx.xxx.xxx.xxx - Restarting packages.
                        Aug 22 17:36:39	check_reload_status	445	Starting packages
                        Aug 22 17:36:39	check_reload_status	445	Reloading filter
                        Aug 22 17:36:40	php-fpm	75474	/rc.start_packages: Restarting/Starting all packages.
                        Aug 22 17:38:10	php-fpm	396	/index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database)
                        Aug 22 17:38:13	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:14	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:15	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:16	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:17	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:19	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:20	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:21	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:22	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:23	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:24	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:38:25	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:40:00	sshguard	81305	Exiting on signal.
                        Aug 22 17:40:00	sshguard	29094	Now monitoring attacks.
                        
                        
                        ----------- Toggled WAN on testVM ------------
                        
                        Aug 22 17:44:59	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:00	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:01	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:02	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:03	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:04	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:05	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:06	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:07	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:08	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:09	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:10	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                        Aug 22 17:45:31	kernel		vtnet0: link state changed to DOWN
                        Aug 22 17:45:31	check_reload_status	445	Linkup starting vtnet0
                        Aug 22 17:45:32	php-fpm	397	/rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp, 6: dhcp6)
                        Aug 22 17:45:32	php-fpm	397	/rc.linkup: DEVD Ethernet detached event for wan
                        Aug 22 17:45:34	check_reload_status	445	Reloading filter
                        Aug 22 17:45:34	rc.gateway_alarm	77152	>>> Gateway alarm: WAN_DHCP (Addr:xxx.xxx.xxx.xxx Alarm:down RTT:0ms RTTsd:0ms Loss:100%)
                        Aug 22 17:45:34	check_reload_status	445	updating dyndns WAN_DHCP
                        Aug 22 17:45:34	check_reload_status	445	Restarting IPsec tunnels
                        Aug 22 17:45:34	check_reload_status	445	Restarting OpenVPN tunnels/interfaces
                        Aug 22 17:45:34	check_reload_status	445	Reloading filter
                        Aug 22 17:45:36	check_reload_status	445	Linkup starting vtnet0
                        Aug 22 17:45:36	kernel		vtnet0: link state changed to UP
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp, 6: dhcp6)
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: DEVD Ethernet attached event for wan
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: HOTPLUG: Configuring interface wan
                        Aug 22 17:45:37	check_reload_status	445	rc.newwanip starting vtnet0
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: calling interface_dhcpv6_configure.
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: Accept router advertisements on interface vtnet0
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: Starting DHCP6 client for interfaces vtnet0 in DHCP6 without RA mode
                        Aug 22 17:45:37	php-fpm	396	/rc.linkup: Starting rtsold process on wan(vtnet0)
                        Aug 22 17:45:38	php-fpm	75474	/rc.newwanip: rc.newwanip: Info: starting on vtnet0.
                        Aug 22 17:45:38	php-fpm	75474	/rc.newwanip: rc.newwanip: on (IP address: xxx.xxx.xxx.xxx) (interface: WAN[wan]) (real interface: vtnet0).
                        Aug 22 17:45:39	php-fpm	397	/rc.newwanipv6: rc.newwanipv6: Info: starting on vtnet0.
                        Aug 22 17:45:39	php-fpm	397	/rc.newwanipv6: rc.newwanipv6: on (IP address: 2a0c:4f47:8030:2::1) (interface: wan) (real interface: vtnet0).
                        Aug 22 17:45:40	php-fpm	396	/rc.linkup: Gateway, NONE AVAILABLE
                        Aug 22 17:45:40	php-fpm	75474	/rc.newwanip: Gateway, NONE AVAILABLE
                        Aug 22 17:45:40	php-fpm	396	/rc.linkup: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:45:40	php-fpm	75474	/rc.newwanip: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:45:40	php-fpm	75474	/rc.newwanip: IP Address has changed, killing states on former IP Address 0.0.0.0.
                        Aug 22 17:45:40	check_reload_status	445	Restarting IPsec tunnels
                        Aug 22 17:45:40	php-fpm	75474	/rc.newwanip: Resyncing OpenVPN instances for interface WAN.
                        Aug 22 17:45:40	check_reload_status	445	updating dyndns wan
                        Aug 22 17:45:40	php-fpm	75474	/rc.newwanip: Creating rrd update script
                        Aug 22 17:45:40	check_reload_status	445	Reloading filter
                        Aug 22 17:45:40	php-fpm	397	/rc.newwanipv6: Gateway, NONE AVAILABLE
                        Aug 22 17:45:40	php-fpm	397	/rc.newwanipv6: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6'
                        Aug 22 17:45:40	check_reload_status	445	Reloading filter
                        Aug 22 17:45:40	php-fpm	397	/rc.newwanipv6: Resyncing OpenVPN instances for interface WAN.
                        Aug 22 17:45:40	php-fpm	397	/rc.newwanipv6: Creating rrd update script
                        Aug 22 17:45:40	php-fpm	397	/rc.newwanipv6: pfSense package system has detected an IP change or dynamic WAN reconnection - -> 2a0c:4f47:8030:2::1 - Restarting packages.
                        Aug 22 17:45:40	check_reload_status	445	Starting packages
                        Aug 22 17:45:41	php-fpm	397	/rc.start_packages: Restarting/Starting all packages.
                        Aug 22 17:45:42	php-fpm	75474	/rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xxx.xxx.xxx.xxx - Restarting packages.
                        Aug 22 17:45:42	check_reload_status	445	Starting packages
                        Aug 22 17:45:42	check_reload_status	445	Reloading filter
                        Aug 22 17:45:43	php-fpm	71050	/rc.start_packages: Restarting/Starting all packages.
                        
                        
                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          Hmm, so that too required bouncing the WAN before a default route was set?

                          That starts to look more like a race condition. Hmm.

                          What happened at this point when you logged in?

                          Aug 22 17:36:39	php-fpm	396	/rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xxx.xxx.xxx.xxx - Restarting packages.
                          Aug 22 17:36:39	check_reload_status	445	Starting packages
                          Aug 22 17:36:39	check_reload_status	445	Reloading filter
                          Aug 22 17:36:40	php-fpm	75474	/rc.start_packages: Restarting/Starting all packages.
                          Aug 22 17:38:10	php-fpm	396	/index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database)
                          Aug 22 17:38:13	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                          Aug 22 17:38:14	kernel		arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
                          

                          Did you do soemthing to trigger the arpresolve errors? And I assume the masked IP there is the WAN gateway?

                          randombitsR 1 Reply Last reply Reply Quote 0
                          • randombitsR
                            randombits @stephenw10
                            last edited by

                            @stephenw10 Apologies for the delay in replying time zones and family commitments !

                            I may have toggle the LAN so as to get an IP address the xxx's is my IP address. I just tried again but firing up another pfsense after turning of the first really messes things up. I think the switch gets confused.

                            I'm really not sure where to place the problem.

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              Hmm, if you don't login does it start throwing those errors? It could just be a timeout on the ARP cache but I wouldn't expect that if that's the local address rather than the gateway IP.

                              randombitsR 1 Reply Last reply Reply Quote 0
                              • randombitsR
                                randombits @stephenw10
                                last edited by

                                @stephenw10

                                This time I changed the ethernet type from virtio to intel that made no difference.

                                I rebooted via the the gui did nothing other than copy the log and toggle the WAN in Proxmox

                                
                                --------------reboot test VM -------------------
                                
                                Aug 23 14:50:01	php-fpm	397	/diag_reboot.php: Stopping all packages.
                                Aug 23 14:50:04	reboot	91077	rebooted by root
                                Aug 23 14:50:04	syslogd		exiting on signal 15
                                Aug 23 14:50:38	syslogd		kernel boot file is /boot/kernel/kernel
                                Aug 23 14:50:38	kernel		pflog0: promiscuous mode disabled
                                Aug 23 14:50:38	kernel		Waiting (max 60 seconds) for system process `vnlru' to stop... done
                                Aug 23 14:50:38	kernel		Waiting (max 60 seconds) for system process `syncer' to stop...
                                Aug 23 14:50:38	kernel		Syncing disks, vnodes remaining... 0 0 0 0 done
                                Aug 23 14:50:38	kernel		All buffers synced.
                                Aug 23 14:50:38	kernel		Uptime: 3m53s
                                Aug 23 14:50:38	kernel		Khelp module "ertt" can't unload until its refcount drops from 1 to 0.
                                Aug 23 14:50:38	kernel		uhid0: detached
                                Aug 23 14:50:38	kernel		uhub0: detached
                                Aug 23 14:50:38	kernel		Rebooting...
                                Aug 23 14:50:38	kernel		---<<BOOT>>---
                                Aug 23 14:50:38	kernel		Copyright (c) 1992-2023 The FreeBSD Project.
                                Aug 23 14:50:38	kernel		Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
                                Aug 23 14:50:38	kernel		The Regents of the University of California. All rights reserved.
                                Aug 23 14:50:38	kernel		FreeBSD is a registered trademark of The FreeBSD Foundation.
                                Aug 23 14:50:38	kernel		FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023
                                Aug 23 14:50:38	kernel		root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64
                                Aug 23 14:50:38	kernel		FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
                                Aug 23 14:50:38	kernel		VT(vga): text 80x25
                                Aug 23 14:50:38	kernel		CPU: QEMU Virtual CPU version 2.5+ (2496.06-MHz K8-class CPU)
                                Aug 23 14:50:38	kernel		Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1
                                Aug 23 14:50:38	kernel		Features=0x783fbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2>
                                Aug 23 14:50:38	kernel		Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV>
                                Aug 23 14:50:38	kernel		AMD Features=0x20100800<SYSCALL,NX,LM>
                                Aug 23 14:50:38	kernel		AMD Features2=0x1<LAHF>
                                Aug 23 14:50:38	kernel		Hypervisor: Origin = "KVMKVMKVM"
                                Aug 23 14:50:38	kernel		real memory = 2147483648 (2048 MB)
                                Aug 23 14:50:38	kernel		avail memory = 2016669696 (1923 MB)
                                Aug 23 14:50:38	kernel		Event timer "LAPIC" quality 100
                                Aug 23 14:50:38	kernel		ACPI APIC Table: <BOCHS BXPC >
                                Aug 23 14:50:38	kernel		random: unblocking device.
                                Aug 23 14:50:38	kernel		ioapic0 <Version 1.1> irqs 0-23
                                Aug 23 14:50:38	kernel		TCP_ratelimit: Is now initialized
                                Aug 23 14:50:38	kernel		wlan: mac acl policy registered
                                Aug 23 14:50:38	kernel		ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                Aug 23 14:50:38	kernel		ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                Aug 23 14:50:38	kernel		module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1
                                Aug 23 14:50:38	kernel		ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                Aug 23 14:50:38	kernel		ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                Aug 23 14:50:38	kernel		module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1
                                Aug 23 14:50:38	kernel		ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
                                Aug 23 14:50:38	kernel		ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
                                Aug 23 14:50:38	kernel		module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1
                                Aug 23 14:50:38	kernel		iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                Aug 23 14:50:38	kernel		iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                Aug 23 14:50:38	kernel		module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1
                                Aug 23 14:50:38	kernel		iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                Aug 23 14:50:38	kernel		iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                Aug 23 14:50:38	kernel		module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1
                                Aug 23 14:50:38	kernel		iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
                                Aug 23 14:50:38	kernel		iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
                                Aug 23 14:50:38	kernel		module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1
                                Aug 23 14:50:38	kernel		random: entropy device external interface
                                Aug 23 14:50:38	kernel		kbd1 at kbdmux0
                                Aug 23 14:50:38	kernel		WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
                                Aug 23 14:50:38	kernel		netgate0: <QEMU Guest>
                                Aug 23 14:50:38	kernel		kvmclock0: <KVM paravirtual clock>
                                Aug 23 14:50:38	kernel		Timecounter "kvmclock" frequency 1000000000 Hz quality 975
                                Aug 23 14:50:38	kernel		kvmclock0: registered as a time-of-day clock, resolution 0.000001s
                                Aug 23 14:50:38	kernel		vtvga0: <VT VGA driver>
                                Aug 23 14:50:38	kernel		smbios0: <System Management BIOS> at iomem 0xf5290-0xf52ae
                                Aug 23 14:50:38	kernel		smbios0: Version: 2.8, BCD Revision: 2.8
                                Aug 23 14:50:38	kernel		acpi0: <BOCHS BXPC>
                                Aug 23 14:50:38	kernel		acpi0: Power Button (fixed)
                                Aug 23 14:50:38	kernel		cpu0: <ACPI CPU> on acpi0
                                Aug 23 14:50:38	kernel		atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
                                Aug 23 14:50:38	kernel		atrtc0: registered as a time-of-day clock, resolution 1.000000s
                                Aug 23 14:50:38	kernel		Event timer "RTC" frequency 32768 Hz quality 0
                                Aug 23 14:50:38	kernel		hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
                                Aug 23 14:50:38	kernel		Timecounter "HPET" frequency 100000000 Hz quality 950
                                Aug 23 14:50:38	kernel		Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
                                Aug 23 14:50:38	kernel		acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
                                Aug 23 14:50:38	kernel		pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
                                Aug 23 14:50:38	kernel		pci0: <ACPI PCI bus> on pcib0
                                Aug 23 14:50:38	kernel		isab0: <PCI-ISA bridge> at device 1.0 on pci0
                                Aug 23 14:50:38	kernel		isa0: <ISA bus> on isab0
                                Aug 23 14:50:38	kernel		atapci0: <Intel PIIX3 WDMA2 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf0c0-0xf0cf at device 1.1 on pci0
                                Aug 23 14:50:38	kernel		ata0: <ATA channel> at channel 0 on atapci0
                                Aug 23 14:50:38	kernel		ata1: <ATA channel> at channel 1 on atapci0
                                Aug 23 14:50:38	kernel		uhci0: <Intel 82371SB (PIIX3) USB controller> port 0xf080-0xf09f irq 11 at device 1.2 on pci0
                                Aug 23 14:50:38	kernel		usbus0 on uhci0
                                Aug 23 14:50:38	kernel		pci0: <bridge> at device 1.3 (no driver attached)
                                Aug 23 14:50:38	kernel		vgapci0: <VGA-compatible display> mem 0xfc000000-0xfcffffff,0xfeab0000-0xfeab0fff at device 2.0 on pci0
                                Aug 23 14:50:38	kernel		vgapci0: Boot video device
                                Aug 23 14:50:38	kernel		virtio_pci0: <VirtIO PCI (legacy) Balloon adapter> port 0xf000-0xf03f mem 0xfd600000-0xfd603fff irq 11 at device 3.0 on pci0
                                Aug 23 14:50:38	kernel		vtballoon0: <VirtIO Balloon Adapter> on virtio_pci0
                                Aug 23 14:50:38	kernel		pcib1: <ACPI PCI-PCI bridge> mem 0xfeab1000-0xfeab10ff irq 10 at device 5.0 on pci0
                                Aug 23 14:50:38	kernel		pci1: <ACPI PCI bus> on pcib1
                                Aug 23 14:50:38	kernel		virtio_pci1: <VirtIO PCI (legacy) SCSI adapter> port 0xe000-0xe03f mem 0xfe800000-0xfe800fff,0xfd400000-0xfd403fff irq 10 at device 1.0 on pci1
                                Aug 23 14:50:38	kernel		vtscsi0: <VirtIO SCSI Adapter> on virtio_pci1
                                Aug 23 14:50:38	kernel		em0: <Intel(R) Legacy PRO/1000 MT 82540EM> port 0xf040-0xf07f mem 0xfea80000-0xfea9ffff irq 10 at device 18.0 on pci0
                                Aug 23 14:50:38	kernel		em0: Using 1024 TX descriptors and 1024 RX descriptors
                                Aug 23 14:50:38	kernel		em0: Ethernet address: 42:05:9b:43:45:49
                                Aug 23 14:50:38	kernel		em0: netmap queues/slots: TX 1/1024, RX 1/1024
                                Aug 23 14:50:38	kernel		virtio_pci2: <VirtIO PCI (legacy) Network adapter> port 0xf0a0-0xf0bf mem 0xfeab2000-0xfeab2fff,0xfd604000-0xfd607fff irq 11 at device 19.0 on pci0
                                Aug 23 14:50:38	kernel		vtnet0: <VirtIO Networking Adapter> on virtio_pci2
                                Aug 23 14:50:38	kernel		vtnet0: Ethernet address: be:bb:27:ef:48:57
                                Aug 23 14:50:38	kernel		vtnet0: netmap queues/slots: TX 1/256, RX 1/512
                                Aug 23 14:50:38	kernel		000.000761 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512
                                Aug 23 14:50:38	kernel		pcib2: <ACPI PCI-PCI bridge> mem 0xfeab3000-0xfeab30ff irq 10 at device 30.0 on pci0
                                Aug 23 14:50:38	kernel		pci2: <ACPI PCI bus> on pcib2
                                Aug 23 14:50:38	kernel		pcib3: <ACPI PCI-PCI bridge> mem 0xfeab4000-0xfeab40ff irq 11 at device 31.0 on pci0
                                Aug 23 14:50:38	kernel		pci3: <ACPI PCI bus> on pcib3
                                Aug 23 14:50:38	kernel		acpi_syscontainer0: <System Container> on acpi0
                                Aug 23 14:50:38	kernel		vmgenc0: <VM Generation Counter> on acpi0
                                Aug 23 14:50:38	kernel		acpi_syscontainer1: <System Container> port 0xaf00-0xaf0b on acpi0
                                Aug 23 14:50:38	kernel		acpi_syscontainer2: <System Container> port 0xafe0-0xafe3 on acpi0
                                Aug 23 14:50:38	kernel		acpi_syscontainer3: <System Container> port 0xae00-0xae17 on acpi0
                                Aug 23 14:50:38	kernel		atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
                                Aug 23 14:50:38	kernel		atkbd0: <AT Keyboard> irq 1 on atkbdc0
                                Aug 23 14:50:38	kernel		kbd0 at atkbd0
                                Aug 23 14:50:38	kernel		atkbd0: [GIANT-LOCKED]
                                Aug 23 14:50:38	kernel		psm0: <PS/2 Mouse> irq 12 on atkbdc0
                                Aug 23 14:50:38	kernel		psm0: [GIANT-LOCKED]
                                Aug 23 14:50:38	kernel		WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0.
                                Aug 23 14:50:38	kernel		psm0: model IntelliMouse Explorer, device ID 4
                                Aug 23 14:50:38	kernel		fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0
                                Aug 23 14:50:38	kernel		fdc0: does not respond
                                Aug 23 14:50:38	kernel		device_attach: fdc0 attach returned 6
                                Aug 23 14:50:38	kernel		orm0: <ISA Option ROM> at iomem 0xe7800-0xeffff pnpid ORM0000 on isa0
                                Aug 23 14:50:38	kernel		vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0
                                Aug 23 14:50:38	kernel		attimer0: <AT timer> at port 0x40 on isa0
                                Aug 23 14:50:38	kernel		Timecounter "i8254" frequency 1193182 Hz quality 0
                                Aug 23 14:50:38	kernel		Event timer "i8254" frequency 1193182 Hz quality 100
                                Aug 23 14:50:38	kernel		fdc0: No FDOUT register!
                                Aug 23 14:50:38	kernel		Timecounter "TSC-low" frequency 1248000764 Hz quality 800
                                Aug 23 14:50:38	kernel		Timecounters tick every 10.000 msec
                                Aug 23 14:50:38	kernel		usbus0: 12Mbps Full Speed USB v1.0
                                Aug 23 14:50:38	kernel		ZFS filesystem version: 5
                                Aug 23 14:50:38	kernel		ZFS storage pool version: features support (5000)
                                Aug 23 14:50:38	kernel		ugen0.1: <Intel UHCI root HUB> at usbus0
                                Aug 23 14:50:38	kernel		uhub0 on usbus0
                                Aug 23 14:50:38	kernel		uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
                                Aug 23 14:50:38	kernel		Trying to mount root from zfs:pfSense/ROOT/default []...
                                Aug 23 14:50:38	kernel		cd0 at ata1 bus 0 scbus1 target 0 lun 0
                                Aug 23 14:50:38	kernel		cd0: <QEMU QEMU DVD-ROM 2.5+> Removable CD-ROM SCSI device
                                Aug 23 14:50:38	kernel		cd0: Serial Number QM00003
                                Aug 23 14:50:38	kernel		cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes)
                                Aug 23 14:50:38	kernel		cd0: 1369MB (701060 2048 byte sectors)
                                Aug 23 14:50:38	kernel		da0 at vtscsi0 bus 0 scbus2 target 0 lun 0
                                Aug 23 14:50:38	kernel		da0: <QEMU QEMU HARDDISK 2.5+> Fixed Direct Access SPC-3 SCSI device
                                Aug 23 14:50:38	kernel		da0: 300.000MB/s transfers
                                Aug 23 14:50:38	kernel		da0: Command Queueing enabled
                                Aug 23 14:50:38	kernel		da0: 32768MB (67108864 512 byte sectors)
                                Aug 23 14:50:38	kernel		uhub0: 2 ports with 2 removable, self powered
                                Aug 23 14:50:38	kernel		ugen0.2: <QEMU QEMU USB Tablet> at usbus0
                                Aug 23 14:50:38	kernel		uhid0 on uhub0
                                Aug 23 14:50:38	kernel		uhid0: <QEMU QEMU USB Tablet, class 0/0, rev 2.00/0.00, addr 2> on usbus0
                                Aug 23 14:50:38	kernel		CPU: QEMU Virtual CPU version 2.5+ (2496.00-MHz K8-class CPU)
                                Aug 23 14:50:38	kernel		Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1
                                Aug 23 14:50:38	kernel		Features=0x78bfbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
                                Aug 23 14:50:38	kernel		Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV>
                                Aug 23 14:50:38	kernel		AMD Features=0x20100800<SYSCALL,NX,LM>
                                Aug 23 14:50:38	kernel		AMD Features2=0x1<LAHF>
                                Aug 23 14:50:38	kernel		Hypervisor: Origin = "KVMKVMKVM"
                                Aug 23 14:50:38	kernel		intsmb0: <Intel PIIX4 SMBUS Interface> irq 9 at device 1.3 on pci0
                                Aug 23 14:50:38	kernel		intsmb0: intr IRQ 9 enabled revision 0
                                Aug 23 14:50:38	kernel		smbus0: <System Management Bus> on intsmb0
                                Aug 23 14:50:38	kernel		lo0: link state changed to UP
                                Aug 23 14:50:38	kernel		done.
                                Aug 23 14:50:38	kernel		em0: link state changed to UP
                                Aug 23 14:50:38	php-cgi	465	rc.bootup: The command '/sbin/ifconfig 'em0' inet6 delete' returned exit code '1', the output was 'ifconfig: ioctl (SIOCDIFADDR): Can't assign requested address'
                                Aug 23 14:50:38	check_reload_status	445	Linkup starting em0
                                Aug 23 14:50:40	php-fpm	397	/rc.linkup: DHCP Client not running on wan (em0), reconfiguring dhclient.
                                Aug 23 14:50:40	php-cgi	465	rc.bootup: The command '/sbin/dhclient -c /var/etc/dhclient_wan.conf -p /var/run/dhclient.em0.pid em0 > /tmp/em0_output 2> /tmp/em0_error_output' returned exit code '1', the output was ''
                                Aug 23 14:50:40	check_reload_status	445	Linkup starting vtnet0
                                Aug 23 14:50:40	kernel		vtnet0: link state changed to UP
                                Aug 23 14:50:40	php-cgi	465	rc.bootup: Resyncing OpenVPN instances.
                                Aug 23 14:50:41	kernel		done.
                                Aug 23 14:50:41	kernel		pflog0: promiscuous mode enabled
                                Aug 23 14:50:41	php-fpm	398	/rc.linkup: Ignoring link event during boot sequence.
                                Aug 23 14:50:42	check_reload_status	445	rc.newwanip starting em0
                                Aug 23 14:50:42	kernel		.
                                Aug 23 14:50:42	kernel		done.
                                Aug 23 14:50:43	php-fpm	398	/rc.newwanip: rc.newwanip: Info: starting on em0.
                                Aug 23 14:50:43	php-fpm	398	/rc.newwanip: rc.newwanip: on (IP address: my fixed ip) (interface: WAN[wan]) (real interface: em0).
                                Aug 23 14:50:45	rc.gateway_alarm	14686	>>> Gateway alarm: WAN_DHCP (Addr:isp.gateway.ip Alarm:1 RTT:0ms RTTsd:0ms Loss:100%)
                                Aug 23 14:50:45	check_reload_status	445	updating dyndns WAN_DHCP
                                Aug 23 14:50:45	check_reload_status	445	Restarting IPsec tunnels
                                Aug 23 14:50:45	check_reload_status	445	Restarting OpenVPN tunnels/interfaces
                                Aug 23 14:50:45	check_reload_status	445	Reloading filter
                                Aug 23 14:50:45	php-cgi	465	rc.bootup: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP'
                                Aug 23 14:50:45	php-cgi	465	rc.bootup: Default gateway setting Interface WAN_DHCP Gateway as default.
                                Aug 23 14:50:45	php-cgi	465	rc.bootup: Gateway, NONE AVAILABLE
                                Aug 23 14:50:45	kernel		done.
                                Aug 23 14:50:46	php-cgi	465	rc.bootup: sync unbound done.
                                Aug 23 14:50:46	kernel		done.
                                Aug 23 14:50:48	kernel		done.
                                Aug 23 14:50:48	kernel		done.
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:11	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:12	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:18	php-cgi	465	rc.bootup: The command '/usr/bin/timeout -k 45 30 /usr/local/sbin/ntpd -g -q -c /dev/null 216.239.35.0 216.239.35.4 216.239.35.8 216.239.35.12' returned exit code '124', the output was '23 Aug 14:50:48 ntpd[69295]: ntpd 4.2.8p17@1.4004-o Fri Dec 8 16:52:11 UTC 2023 (1): Starting 23 Aug 14:50:48 ntpd[69295]: Command line: /usr/local/sbin/ntpd -g -q -c /dev/null 216.239.35.0 216.239.35.4 216.239.35.8 216.239.35.12 23 Aug 14:50:48 ntpd[69295]: ---------------------------------------------------- 23 Aug 14:50:48 ntpd[69295]: ntp-4 is maintained by Network Time Foundation, 23 Aug 14:50:48 ntpd[69295]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 23 Aug 14:50:48 ntpd[69295]: corporation. Support and training for ntp-4 are 23 Aug 14:50:48 ntpd[69295]: available at https://www.nwtime.org/support 23 Aug 14:50:48 ntpd[69295]: ---------------------------------------------------- 23 Aug 14:50:48 ntpd[69295]: proto: precision = 0.739 usec (-20) 23 Aug 14:50:48 ntpd[69295]: line 0 column 0 syntax error 23 Aug 14:50:48 ntpd[69295]: basedate set to 2023-11-26 23 Aug 14:50:48 ntpd[69295]: gps base set to 2023-11-26 (week 2290) 23 Aug 14:50:48 ntpd[69295]: Listen and drop on 0 v6wildcard [::]:123 23 Aug 14:50:48 ntpd[69295]: Listen and drop on 1 v4wildcard 0.0.0.0:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 2 em0 [fe80::3af8:f6ff:fef7:d570%1]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 3 em0 my fixed ip:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 4 vtnet0 [fe80::bcbb:27ff:feef:4857%2]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 5 vtnet0 192.168.2.210:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 6 lo0 [::1]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 7 lo0 [fe80::1%4]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 8 lo0 127.0.0.1:123 23 Aug 14:50:48 ntpd[69295]: Listening on routing socket on fd #29 for interface updates 23 Aug 14:51:18 ntpd[69295]: ntpd exiting on signal 15 (Terminated)'
                                Aug 23 14:51:18	php-cgi	465	rc.bootup: NTPD is starting up.
                                Aug 23 14:51:18	kernel		done.
                                Aug 23 14:51:19	check_reload_status	445	Updating all dyndns
                                Aug 23 14:51:19	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:19	kernel		....
                                Aug 23 14:51:20	php-cgi	465	rc.bootup: The command '/usr/local/sbin/strongswanrc stop' returned exit code '1', the output was 'strongswan not running? (check /var/run/daemon-charon.pid).'
                                Aug 23 14:51:20	kernel		.done.
                                Aug 23 14:51:20	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:21	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:24	php-cgi	465	rc.bootup: Creating rrd update script
                                Aug 23 14:51:24	syslogd		exiting on signal 15
                                Aug 23 14:51:24	syslogd		kernel boot file is /boot/kernel/kernel
                                Aug 23 14:51:24	kernel		done.
                                Aug 23 14:51:24	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:24	php-fpm	397	/rc.start_packages: Restarting/Starting all packages.
                                Aug 23 14:51:25	root	65478	Bootup complete
                                Aug 23 14:51:25	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:26	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:26	login	76089	login on ttyv0 as root
                                Aug 23 14:51:26	sshguard	79310	Now monitoring attacks.
                                Aug 23 14:51:27	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:27	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:28	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:28	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:29	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:29	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:32	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:32	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:35	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:35	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:36	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:37	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:37	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:38	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:40	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:41	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:41	php-fpm	397	/index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database)
                                Aug 23 14:51:42	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:43	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:43	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:44	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:44	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:44	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:45	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:45	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:45	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:46	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:48	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:48	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:49	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:49	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:50	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:51	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:51	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:52	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:52	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:53	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:53	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:54	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                Aug 23 14:51:55	kernel		arpresolve: can't allocate llinfo for isp.gateway.ip on em0
                                
                                ----------- toggled WAN  testVM
                                
                                Aug 23 14:57:31	kernel		em0: link state changed to DOWN
                                Aug 23 14:57:31	check_reload_status	445	Linkup starting em0
                                Aug 23 14:57:32	php-fpm	398	/rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp)
                                Aug 23 14:57:32	php-fpm	398	/rc.linkup: DEVD Ethernet detached event for wan
                                Aug 23 14:57:33	check_reload_status	445	Reloading filter
                                Aug 23 14:57:33	rc.gateway_alarm	73604	>>> Gateway alarm: WAN_DHCP (Addr:isp.gateway.ip Alarm:down RTT:0ms RTTsd:0ms Loss:100%)
                                Aug 23 14:57:33	check_reload_status	445	updating dyndns WAN_DHCP
                                Aug 23 14:57:33	check_reload_status	445	Restarting IPsec tunnels
                                Aug 23 14:57:33	check_reload_status	445	Restarting OpenVPN tunnels/interfaces
                                Aug 23 14:57:33	check_reload_status	445	Reloading filter
                                Aug 23 14:57:36	check_reload_status	445	Linkup starting em0
                                Aug 23 14:57:36	kernel		em0: link state changed to UP
                                Aug 23 14:57:37	php-fpm	84999	/rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp)
                                Aug 23 14:57:37	php-fpm	84999	/rc.linkup: DEVD Ethernet attached event for wan
                                Aug 23 14:57:37	php-fpm	84999	/rc.linkup: HOTPLUG: Configuring interface wan
                                Aug 23 14:57:37	check_reload_status	445	rc.newwanip starting em0
                                Aug 23 14:57:38	php-fpm	84999	/rc.linkup: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP'
                                Aug 23 14:57:38	php-fpm	84999	/rc.linkup: Gateway, NONE AVAILABLE
                                Aug 23 14:57:38	check_reload_status	445	Restarting IPsec tunnels
                                Aug 23 14:57:38	check_reload_status	445	updating dyndns wan
                                Aug 23 14:57:38	check_reload_status	445	Reloading filter
                                Aug 23 14:57:39	php-fpm	397	/rc.newwanip: rc.newwanip: Info: starting on em0.
                                Aug 23 14:57:39	php-fpm	397	/rc.newwanip: rc.newwanip: on (IP address: my.fixed.ip) (interface: WAN[wan]) (real interface: em0).
                                
                                GertjanG 1 Reply Last reply Reply Quote 0
                                • GertjanG
                                  Gertjan @randombits
                                  last edited by

                                  @randombits

                                  The dhcp client does it's work, the connection is created, dpinger is lauched to 'check' it, but .... this might be a simple one : yiour 'isp.gateway.ip' (your redacted WAN IP right ?) does not answer to ICMP or ping.
                                  And then , yeah, this will fail right away.

                                  A solution is : pick another IP for dpinger to use :
                                  Instead of
                                  a88dae2d-c6e4-46b1-a529-c3174c1f2a03-image.png

                                  do this :

                                  7f9d3df7-7e52-4c82-ad53-17c7460f2684-image.png

                                  ( half the planet uses 8.8.8.8 as this seems to be the IP the most close to their pfSense ...... 🤐 )

                                  or, why not, experiment with this :

                                  14284e85-fa6a-4fa5-8a31-ed2f11b2527b-image.png

                                  No "help me" PM's please. Use the forum, the community will thank you.
                                  Edit : and where are the logs ??

                                  1 Reply Last reply Reply Quote 0
                                  • stephenw10S
                                    stephenw10 Netgate Administrator
                                    last edited by

                                    @randombits said in WAN only connects on unplug and plug back in:

                                    Aug 23 14:50:40 php-cgi 465 rc.bootup: The command '/sbin/dhclient -c /var/etc/dhclient_wan.conf -p /var/run/dhclient.em0.pid em0 > /tmp/em0_output 2> /tmp/em0_error_output' returned exit code '1', the output was ''
                                    Aug 23 14:50:40 check_reload_status 445 Linkup starting vtnet0

                                    Are those error files still present? /tmp/em0_output and /tmp/em0_error_output

                                    It looks like it pulls a lease then dumps it during bootup. I think you said the IP and subnet were still present on the device before you bounce the link though? But the gateway was no longer in the ARP table?

                                    1 Reply Last reply Reply Quote 0
                                    • randombitsR
                                      randombits
                                      last edited by randombits

                                      @Gertjan I tried all those combinations and nothing worked - yes I deleted the gateway and my ip

                                      @stephenw10 none of the errors are in either of those locations.

                                      In the gui it says all's ok
                                      2024-08-23 17_07_25-pfSense.home.arpa - Status_ Dashboard.png

                                      But it's not until I bounce the interface.

                                      GertjanG stephenw10S 2 Replies Last reply Reply Quote 0
                                      • GertjanG
                                        Gertjan @randombits
                                        last edited by

                                        @randombits said in WAN only connects on unplug and plug back in:

                                        I tried all those combinations and nothing worked

                                        So, imho, it's not pfSense that takes your connection down. Whatever happens, its on the other side of the WAN cable.

                                        No "help me" PM's please. Use the forum, the community will thank you.
                                        Edit : and where are the logs ??

                                        1 Reply Last reply Reply Quote 0
                                        • stephenw10S
                                          stephenw10 Netgate Administrator @randombits
                                          last edited by

                                          @randombits said in WAN only connects on unplug and plug back in:

                                          In the gui it says all's ok

                                          Is that before bouncing the NIC in Proxmox?

                                          randombitsR 1 Reply Last reply Reply Quote 0
                                          • randombitsR
                                            randombits @stephenw10
                                            last edited by

                                            @stephenw10 yes

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.