WAN only connects on unplug and plug back in
-
This time I changed the ethernet type from virtio to intel that made no difference.
I rebooted via the the gui did nothing other than copy the log and toggle the WAN in Proxmox
--------------reboot test VM ------------------- Aug 23 14:50:01 php-fpm 397 /diag_reboot.php: Stopping all packages. Aug 23 14:50:04 reboot 91077 rebooted by root Aug 23 14:50:04 syslogd exiting on signal 15 Aug 23 14:50:38 syslogd kernel boot file is /boot/kernel/kernel Aug 23 14:50:38 kernel pflog0: promiscuous mode disabled Aug 23 14:50:38 kernel Waiting (max 60 seconds) for system process `vnlru' to stop... done Aug 23 14:50:38 kernel Waiting (max 60 seconds) for system process `syncer' to stop... Aug 23 14:50:38 kernel Syncing disks, vnodes remaining... 0 0 0 0 done Aug 23 14:50:38 kernel All buffers synced. Aug 23 14:50:38 kernel Uptime: 3m53s Aug 23 14:50:38 kernel Khelp module "ertt" can't unload until its refcount drops from 1 to 0. Aug 23 14:50:38 kernel uhid0: detached Aug 23 14:50:38 kernel uhub0: detached Aug 23 14:50:38 kernel Rebooting... Aug 23 14:50:38 kernel ---<<BOOT>>--- Aug 23 14:50:38 kernel Copyright (c) 1992-2023 The FreeBSD Project. Aug 23 14:50:38 kernel Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Aug 23 14:50:38 kernel The Regents of the University of California. All rights reserved. Aug 23 14:50:38 kernel FreeBSD is a registered trademark of The FreeBSD Foundation. Aug 23 14:50:38 kernel FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023 Aug 23 14:50:38 kernel root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64 Aug 23 14:50:38 kernel FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152) Aug 23 14:50:38 kernel VT(vga): text 80x25 Aug 23 14:50:38 kernel CPU: QEMU Virtual CPU version 2.5+ (2496.06-MHz K8-class CPU) Aug 23 14:50:38 kernel Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1 Aug 23 14:50:38 kernel Features=0x783fbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2> Aug 23 14:50:38 kernel Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV> Aug 23 14:50:38 kernel AMD Features=0x20100800<SYSCALL,NX,LM> Aug 23 14:50:38 kernel AMD Features2=0x1<LAHF> Aug 23 14:50:38 kernel Hypervisor: Origin = "KVMKVMKVM" Aug 23 14:50:38 kernel real memory = 2147483648 (2048 MB) Aug 23 14:50:38 kernel avail memory = 2016669696 (1923 MB) Aug 23 14:50:38 kernel Event timer "LAPIC" quality 100 Aug 23 14:50:38 kernel ACPI APIC Table: <BOCHS BXPC > Aug 23 14:50:38 kernel random: unblocking device. Aug 23 14:50:38 kernel ioapic0 <Version 1.1> irqs 0-23 Aug 23 14:50:38 kernel TCP_ratelimit: Is now initialized Aug 23 14:50:38 kernel wlan: mac acl policy registered Aug 23 14:50:38 kernel ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 23 14:50:38 kernel ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1 Aug 23 14:50:38 kernel ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 23 14:50:38 kernel ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1 Aug 23 14:50:38 kernel ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 23 14:50:38 kernel ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1 Aug 23 14:50:38 kernel iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 23 14:50:38 kernel iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1 Aug 23 14:50:38 kernel iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 23 14:50:38 kernel iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1 Aug 23 14:50:38 kernel iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 23 14:50:38 kernel iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1 Aug 23 14:50:38 kernel random: entropy device external interface Aug 23 14:50:38 kernel kbd1 at kbdmux0 Aug 23 14:50:38 kernel WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0. Aug 23 14:50:38 kernel netgate0: <QEMU Guest> Aug 23 14:50:38 kernel kvmclock0: <KVM paravirtual clock> Aug 23 14:50:38 kernel Timecounter "kvmclock" frequency 1000000000 Hz quality 975 Aug 23 14:50:38 kernel kvmclock0: registered as a time-of-day clock, resolution 0.000001s Aug 23 14:50:38 kernel vtvga0: <VT VGA driver> Aug 23 14:50:38 kernel smbios0: <System Management BIOS> at iomem 0xf5290-0xf52ae Aug 23 14:50:38 kernel smbios0: Version: 2.8, BCD Revision: 2.8 Aug 23 14:50:38 kernel acpi0: <BOCHS BXPC> Aug 23 14:50:38 kernel acpi0: Power Button (fixed) Aug 23 14:50:38 kernel cpu0: <ACPI CPU> on acpi0 Aug 23 14:50:38 kernel atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0 Aug 23 14:50:38 kernel atrtc0: registered as a time-of-day clock, resolution 1.000000s Aug 23 14:50:38 kernel Event timer "RTC" frequency 32768 Hz quality 0 Aug 23 14:50:38 kernel hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Aug 23 14:50:38 kernel Timecounter "HPET" frequency 100000000 Hz quality 950 Aug 23 14:50:38 kernel Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 Aug 23 14:50:38 kernel acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0 Aug 23 14:50:38 kernel pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 Aug 23 14:50:38 kernel pci0: <ACPI PCI bus> on pcib0 Aug 23 14:50:38 kernel isab0: <PCI-ISA bridge> at device 1.0 on pci0 Aug 23 14:50:38 kernel isa0: <ISA bus> on isab0 Aug 23 14:50:38 kernel atapci0: <Intel PIIX3 WDMA2 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf0c0-0xf0cf at device 1.1 on pci0 Aug 23 14:50:38 kernel ata0: <ATA channel> at channel 0 on atapci0 Aug 23 14:50:38 kernel ata1: <ATA channel> at channel 1 on atapci0 Aug 23 14:50:38 kernel uhci0: <Intel 82371SB (PIIX3) USB controller> port 0xf080-0xf09f irq 11 at device 1.2 on pci0 Aug 23 14:50:38 kernel usbus0 on uhci0 Aug 23 14:50:38 kernel pci0: <bridge> at device 1.3 (no driver attached) Aug 23 14:50:38 kernel vgapci0: <VGA-compatible display> mem 0xfc000000-0xfcffffff,0xfeab0000-0xfeab0fff at device 2.0 on pci0 Aug 23 14:50:38 kernel vgapci0: Boot video device Aug 23 14:50:38 kernel virtio_pci0: <VirtIO PCI (legacy) Balloon adapter> port 0xf000-0xf03f mem 0xfd600000-0xfd603fff irq 11 at device 3.0 on pci0 Aug 23 14:50:38 kernel vtballoon0: <VirtIO Balloon Adapter> on virtio_pci0 Aug 23 14:50:38 kernel pcib1: <ACPI PCI-PCI bridge> mem 0xfeab1000-0xfeab10ff irq 10 at device 5.0 on pci0 Aug 23 14:50:38 kernel pci1: <ACPI PCI bus> on pcib1 Aug 23 14:50:38 kernel virtio_pci1: <VirtIO PCI (legacy) SCSI adapter> port 0xe000-0xe03f mem 0xfe800000-0xfe800fff,0xfd400000-0xfd403fff irq 10 at device 1.0 on pci1 Aug 23 14:50:38 kernel vtscsi0: <VirtIO SCSI Adapter> on virtio_pci1 Aug 23 14:50:38 kernel em0: <Intel(R) Legacy PRO/1000 MT 82540EM> port 0xf040-0xf07f mem 0xfea80000-0xfea9ffff irq 10 at device 18.0 on pci0 Aug 23 14:50:38 kernel em0: Using 1024 TX descriptors and 1024 RX descriptors Aug 23 14:50:38 kernel em0: Ethernet address: 42:05:9b:43:45:49 Aug 23 14:50:38 kernel em0: netmap queues/slots: TX 1/1024, RX 1/1024 Aug 23 14:50:38 kernel virtio_pci2: <VirtIO PCI (legacy) Network adapter> port 0xf0a0-0xf0bf mem 0xfeab2000-0xfeab2fff,0xfd604000-0xfd607fff irq 11 at device 19.0 on pci0 Aug 23 14:50:38 kernel vtnet0: <VirtIO Networking Adapter> on virtio_pci2 Aug 23 14:50:38 kernel vtnet0: Ethernet address: be:bb:27:ef:48:57 Aug 23 14:50:38 kernel vtnet0: netmap queues/slots: TX 1/256, RX 1/512 Aug 23 14:50:38 kernel 000.000761 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512 Aug 23 14:50:38 kernel pcib2: <ACPI PCI-PCI bridge> mem 0xfeab3000-0xfeab30ff irq 10 at device 30.0 on pci0 Aug 23 14:50:38 kernel pci2: <ACPI PCI bus> on pcib2 Aug 23 14:50:38 kernel pcib3: <ACPI PCI-PCI bridge> mem 0xfeab4000-0xfeab40ff irq 11 at device 31.0 on pci0 Aug 23 14:50:38 kernel pci3: <ACPI PCI bus> on pcib3 Aug 23 14:50:38 kernel acpi_syscontainer0: <System Container> on acpi0 Aug 23 14:50:38 kernel vmgenc0: <VM Generation Counter> on acpi0 Aug 23 14:50:38 kernel acpi_syscontainer1: <System Container> port 0xaf00-0xaf0b on acpi0 Aug 23 14:50:38 kernel acpi_syscontainer2: <System Container> port 0xafe0-0xafe3 on acpi0 Aug 23 14:50:38 kernel acpi_syscontainer3: <System Container> port 0xae00-0xae17 on acpi0 Aug 23 14:50:38 kernel atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 Aug 23 14:50:38 kernel atkbd0: <AT Keyboard> irq 1 on atkbdc0 Aug 23 14:50:38 kernel kbd0 at atkbd0 Aug 23 14:50:38 kernel atkbd0: [GIANT-LOCKED] Aug 23 14:50:38 kernel psm0: <PS/2 Mouse> irq 12 on atkbdc0 Aug 23 14:50:38 kernel psm0: [GIANT-LOCKED] Aug 23 14:50:38 kernel WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0. Aug 23 14:50:38 kernel psm0: model IntelliMouse Explorer, device ID 4 Aug 23 14:50:38 kernel fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0 Aug 23 14:50:38 kernel fdc0: does not respond Aug 23 14:50:38 kernel device_attach: fdc0 attach returned 6 Aug 23 14:50:38 kernel orm0: <ISA Option ROM> at iomem 0xe7800-0xeffff pnpid ORM0000 on isa0 Aug 23 14:50:38 kernel vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0 Aug 23 14:50:38 kernel attimer0: <AT timer> at port 0x40 on isa0 Aug 23 14:50:38 kernel Timecounter "i8254" frequency 1193182 Hz quality 0 Aug 23 14:50:38 kernel Event timer "i8254" frequency 1193182 Hz quality 100 Aug 23 14:50:38 kernel fdc0: No FDOUT register! Aug 23 14:50:38 kernel Timecounter "TSC-low" frequency 1248000764 Hz quality 800 Aug 23 14:50:38 kernel Timecounters tick every 10.000 msec Aug 23 14:50:38 kernel usbus0: 12Mbps Full Speed USB v1.0 Aug 23 14:50:38 kernel ZFS filesystem version: 5 Aug 23 14:50:38 kernel ZFS storage pool version: features support (5000) Aug 23 14:50:38 kernel ugen0.1: <Intel UHCI root HUB> at usbus0 Aug 23 14:50:38 kernel uhub0 on usbus0 Aug 23 14:50:38 kernel uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 Aug 23 14:50:38 kernel Trying to mount root from zfs:pfSense/ROOT/default []... Aug 23 14:50:38 kernel cd0 at ata1 bus 0 scbus1 target 0 lun 0 Aug 23 14:50:38 kernel cd0: <QEMU QEMU DVD-ROM 2.5+> Removable CD-ROM SCSI device Aug 23 14:50:38 kernel cd0: Serial Number QM00003 Aug 23 14:50:38 kernel cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) Aug 23 14:50:38 kernel cd0: 1369MB (701060 2048 byte sectors) Aug 23 14:50:38 kernel da0 at vtscsi0 bus 0 scbus2 target 0 lun 0 Aug 23 14:50:38 kernel da0: <QEMU QEMU HARDDISK 2.5+> Fixed Direct Access SPC-3 SCSI device Aug 23 14:50:38 kernel da0: 300.000MB/s transfers Aug 23 14:50:38 kernel da0: Command Queueing enabled Aug 23 14:50:38 kernel da0: 32768MB (67108864 512 byte sectors) Aug 23 14:50:38 kernel uhub0: 2 ports with 2 removable, self powered Aug 23 14:50:38 kernel ugen0.2: <QEMU QEMU USB Tablet> at usbus0 Aug 23 14:50:38 kernel uhid0 on uhub0 Aug 23 14:50:38 kernel uhid0: <QEMU QEMU USB Tablet, class 0/0, rev 2.00/0.00, addr 2> on usbus0 Aug 23 14:50:38 kernel CPU: QEMU Virtual CPU version 2.5+ (2496.00-MHz K8-class CPU) Aug 23 14:50:38 kernel Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1 Aug 23 14:50:38 kernel Features=0x78bfbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2> Aug 23 14:50:38 kernel Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV> Aug 23 14:50:38 kernel AMD Features=0x20100800<SYSCALL,NX,LM> Aug 23 14:50:38 kernel AMD Features2=0x1<LAHF> Aug 23 14:50:38 kernel Hypervisor: Origin = "KVMKVMKVM" Aug 23 14:50:38 kernel intsmb0: <Intel PIIX4 SMBUS Interface> irq 9 at device 1.3 on pci0 Aug 23 14:50:38 kernel intsmb0: intr IRQ 9 enabled revision 0 Aug 23 14:50:38 kernel smbus0: <System Management Bus> on intsmb0 Aug 23 14:50:38 kernel lo0: link state changed to UP Aug 23 14:50:38 kernel done. Aug 23 14:50:38 kernel em0: link state changed to UP Aug 23 14:50:38 php-cgi 465 rc.bootup: The command '/sbin/ifconfig 'em0' inet6 delete' returned exit code '1', the output was 'ifconfig: ioctl (SIOCDIFADDR): Can't assign requested address' Aug 23 14:50:38 check_reload_status 445 Linkup starting em0 Aug 23 14:50:40 php-fpm 397 /rc.linkup: DHCP Client not running on wan (em0), reconfiguring dhclient. Aug 23 14:50:40 php-cgi 465 rc.bootup: The command '/sbin/dhclient -c /var/etc/dhclient_wan.conf -p /var/run/dhclient.em0.pid em0 > /tmp/em0_output 2> /tmp/em0_error_output' returned exit code '1', the output was '' Aug 23 14:50:40 check_reload_status 445 Linkup starting vtnet0 Aug 23 14:50:40 kernel vtnet0: link state changed to UP Aug 23 14:50:40 php-cgi 465 rc.bootup: Resyncing OpenVPN instances. Aug 23 14:50:41 kernel done. Aug 23 14:50:41 kernel pflog0: promiscuous mode enabled Aug 23 14:50:41 php-fpm 398 /rc.linkup: Ignoring link event during boot sequence. Aug 23 14:50:42 check_reload_status 445 rc.newwanip starting em0 Aug 23 14:50:42 kernel . Aug 23 14:50:42 kernel done. Aug 23 14:50:43 php-fpm 398 /rc.newwanip: rc.newwanip: Info: starting on em0. Aug 23 14:50:43 php-fpm 398 /rc.newwanip: rc.newwanip: on (IP address: my fixed ip) (interface: WAN[wan]) (real interface: em0). Aug 23 14:50:45 rc.gateway_alarm 14686 >>> Gateway alarm: WAN_DHCP (Addr:isp.gateway.ip Alarm:1 RTT:0ms RTTsd:0ms Loss:100%) Aug 23 14:50:45 check_reload_status 445 updating dyndns WAN_DHCP Aug 23 14:50:45 check_reload_status 445 Restarting IPsec tunnels Aug 23 14:50:45 check_reload_status 445 Restarting OpenVPN tunnels/interfaces Aug 23 14:50:45 check_reload_status 445 Reloading filter Aug 23 14:50:45 php-cgi 465 rc.bootup: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP' Aug 23 14:50:45 php-cgi 465 rc.bootup: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 23 14:50:45 php-cgi 465 rc.bootup: Gateway, NONE AVAILABLE Aug 23 14:50:45 kernel done. Aug 23 14:50:46 php-cgi 465 rc.bootup: sync unbound done. Aug 23 14:50:46 kernel done. Aug 23 14:50:48 kernel done. Aug 23 14:50:48 kernel done. Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:18 php-cgi 465 rc.bootup: The command '/usr/bin/timeout -k 45 30 /usr/local/sbin/ntpd -g -q -c /dev/null 216.239.35.0 216.239.35.4 216.239.35.8 216.239.35.12' returned exit code '124', the output was '23 Aug 14:50:48 ntpd[69295]: ntpd 4.2.8p17@1.4004-o Fri Dec 8 16:52:11 UTC 2023 (1): Starting 23 Aug 14:50:48 ntpd[69295]: Command line: /usr/local/sbin/ntpd -g -q -c /dev/null 216.239.35.0 216.239.35.4 216.239.35.8 216.239.35.12 23 Aug 14:50:48 ntpd[69295]: ---------------------------------------------------- 23 Aug 14:50:48 ntpd[69295]: ntp-4 is maintained by Network Time Foundation, 23 Aug 14:50:48 ntpd[69295]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 23 Aug 14:50:48 ntpd[69295]: corporation. Support and training for ntp-4 are 23 Aug 14:50:48 ntpd[69295]: available at https://www.nwtime.org/support 23 Aug 14:50:48 ntpd[69295]: ---------------------------------------------------- 23 Aug 14:50:48 ntpd[69295]: proto: precision = 0.739 usec (-20) 23 Aug 14:50:48 ntpd[69295]: line 0 column 0 syntax error 23 Aug 14:50:48 ntpd[69295]: basedate set to 2023-11-26 23 Aug 14:50:48 ntpd[69295]: gps base set to 2023-11-26 (week 2290) 23 Aug 14:50:48 ntpd[69295]: Listen and drop on 0 v6wildcard [::]:123 23 Aug 14:50:48 ntpd[69295]: Listen and drop on 1 v4wildcard 0.0.0.0:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 2 em0 [fe80::3af8:f6ff:fef7:d570%1]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 3 em0 my fixed ip:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 4 vtnet0 [fe80::bcbb:27ff:feef:4857%2]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 5 vtnet0 192.168.2.210:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 6 lo0 [::1]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 7 lo0 [fe80::1%4]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 8 lo0 127.0.0.1:123 23 Aug 14:50:48 ntpd[69295]: Listening on routing socket on fd #29 for interface updates 23 Aug 14:51:18 ntpd[69295]: ntpd exiting on signal 15 (Terminated)' Aug 23 14:51:18 php-cgi 465 rc.bootup: NTPD is starting up. Aug 23 14:51:18 kernel done. Aug 23 14:51:19 check_reload_status 445 Updating all dyndns Aug 23 14:51:19 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:19 kernel .... Aug 23 14:51:20 php-cgi 465 rc.bootup: The command '/usr/local/sbin/strongswanrc stop' returned exit code '1', the output was 'strongswan not running? (check /var/run/daemon-charon.pid).' Aug 23 14:51:20 kernel .done. Aug 23 14:51:20 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:21 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:24 php-cgi 465 rc.bootup: Creating rrd update script Aug 23 14:51:24 syslogd exiting on signal 15 Aug 23 14:51:24 syslogd kernel boot file is /boot/kernel/kernel Aug 23 14:51:24 kernel done. Aug 23 14:51:24 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:24 php-fpm 397 /rc.start_packages: Restarting/Starting all packages. Aug 23 14:51:25 root 65478 Bootup complete Aug 23 14:51:25 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:26 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:26 login 76089 login on ttyv0 as root Aug 23 14:51:26 sshguard 79310 Now monitoring attacks. Aug 23 14:51:27 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:27 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:28 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:28 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:29 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:29 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:32 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:32 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:35 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:35 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:36 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:37 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:37 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:38 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:40 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:41 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:41 php-fpm 397 /index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database) Aug 23 14:51:42 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:43 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:43 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:44 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:44 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:44 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:45 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:45 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:45 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:46 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:48 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:48 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:49 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:49 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:50 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:51 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:51 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:52 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:52 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:53 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:53 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:54 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:55 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 ----------- toggled WAN testVM Aug 23 14:57:31 kernel em0: link state changed to DOWN Aug 23 14:57:31 check_reload_status 445 Linkup starting em0 Aug 23 14:57:32 php-fpm 398 /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp) Aug 23 14:57:32 php-fpm 398 /rc.linkup: DEVD Ethernet detached event for wan Aug 23 14:57:33 check_reload_status 445 Reloading filter Aug 23 14:57:33 rc.gateway_alarm 73604 >>> Gateway alarm: WAN_DHCP (Addr:isp.gateway.ip Alarm:down RTT:0ms RTTsd:0ms Loss:100%) Aug 23 14:57:33 check_reload_status 445 updating dyndns WAN_DHCP Aug 23 14:57:33 check_reload_status 445 Restarting IPsec tunnels Aug 23 14:57:33 check_reload_status 445 Restarting OpenVPN tunnels/interfaces Aug 23 14:57:33 check_reload_status 445 Reloading filter Aug 23 14:57:36 check_reload_status 445 Linkup starting em0 Aug 23 14:57:36 kernel em0: link state changed to UP Aug 23 14:57:37 php-fpm 84999 /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp) Aug 23 14:57:37 php-fpm 84999 /rc.linkup: DEVD Ethernet attached event for wan Aug 23 14:57:37 php-fpm 84999 /rc.linkup: HOTPLUG: Configuring interface wan Aug 23 14:57:37 check_reload_status 445 rc.newwanip starting em0 Aug 23 14:57:38 php-fpm 84999 /rc.linkup: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP' Aug 23 14:57:38 php-fpm 84999 /rc.linkup: Gateway, NONE AVAILABLE Aug 23 14:57:38 check_reload_status 445 Restarting IPsec tunnels Aug 23 14:57:38 check_reload_status 445 updating dyndns wan Aug 23 14:57:38 check_reload_status 445 Reloading filter Aug 23 14:57:39 php-fpm 397 /rc.newwanip: rc.newwanip: Info: starting on em0. Aug 23 14:57:39 php-fpm 397 /rc.newwanip: rc.newwanip: on (IP address: my.fixed.ip) (interface: WAN[wan]) (real interface: em0). -
The dhcp client does it's work, the connection is created, dpinger is lauched to 'check' it, but .... this might be a simple one : yiour 'isp.gateway.ip' (your redacted WAN IP right ?) does not answer to ICMP or ping.
And then , yeah, this will fail right away.A solution is : pick another IP for dpinger to use :
Instead of
do this :
( half the planet uses 8.8.8.8 as this seems to be the IP the most close to their pfSense ......
)or, why not, experiment with this :
-
@randombits said in WAN only connects on unplug and plug back in:
Aug 23 14:50:40 php-cgi 465 rc.bootup: The command '/sbin/dhclient -c /var/etc/dhclient_wan.conf -p /var/run/dhclient.em0.pid em0 > /tmp/em0_output 2> /tmp/em0_error_output' returned exit code '1', the output was ''
Aug 23 14:50:40 check_reload_status 445 Linkup starting vtnet0Are those error files still present?
/tmp/em0_outputand/tmp/em0_error_outputIt looks like it pulls a lease then dumps it during bootup. I think you said the IP and subnet were still present on the device before you bounce the link though? But the gateway was no longer in the ARP table?
-
@Gertjan I tried all those combinations and nothing worked - yes I deleted the gateway and my ip
@stephenw10 none of the errors are in either of those locations.
In the gui it says all's ok
But it's not until I bounce the interface.
-
@randombits said in WAN only connects on unplug and plug back in:
I tried all those combinations and nothing worked
So, imho, it's not pfSense that takes your connection down. Whatever happens, its on the other side of the WAN cable.
-
@randombits said in WAN only connects on unplug and plug back in:
In the gui it says all's ok
Is that before bouncing the NIC in Proxmox?
-
@stephenw10 yes
-
Oh right we went through this already. Too many threads!
At that stage it can ping the gateway but has no default route.
When it starts throwing:
Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0I would expect that gateway to show as down in the dashboard?
When that happens the WAN must be losing it's lease because the firewall ends up without an IP in the gateway subnet.
This must be a timing issue. Though it shouldn't be possible.
You can almost certainly workaround this with a shellmd in the mean time.
When it's in the failed state try running these commands at the CLI:
/etc/rc.newroutedns
/etc/rc.newwanipCheck in between if either of those re-add the required default route. If so you can add them as a shellcmd so it runs at boot.
-
@stephenw10 Neither of those commands did anything, /etc/rc.newwanip did take a while though.
-
Hmm, try:
/etc/rc.reload_interfaces wan -
@stephenw10 YES!! That did it !
Now after my over exuberance how do I add that into a reboots .... ?(It was all a bit worry given that the phone here (FreePBX VM) goes over the internet and we do get power blips that can cause reboots and no phone. Mobiles are very poor in this area)
-
Add it as a shellmd. The easiest way to do that it to install the Shellcmd package then add the command like:
-
SOLVED !
@stephenw10 Well that worked !.
Many thanks for bearing with me on this. The whole thing is weird as to why it started to happen. I can sleep better thinking everything will come back up after a power failure or backup.
The first I noticed it is when Proxmox does it's twice it's week back overnight and the internet would be down in the morning. I set pfSense to backup on early Fridays mornings and on Saturdays Docker would update containers - Watchtower. And then on early Sunday mornings Proxmox would do another back.
Thanks Stephen for all your help I appreciate it.
Dave.
-
Ah, cool! Shouldn't be required though, be good to find out what's actually causing that. Someday!
Anyway glad we were able to get a workaround in place.
