WAN only connects on unplug and plug back in
-
Hmm, this starts to feel like a timing issue. I'm testing pretty much exactly that setup though without using VLANs.
Your WAN is pulling a DHCP lease from the ISP directly?
Does your test VM come up correctly if it pulls a lease from a local server?
-
@stephenw10 Yes, the WAN address is coming from the ISP directly, the ISP told me to set DHCP and set PNP - not a good idea so I didn't.
Not tested the local test VM other than setting it's WAN & LAN. It messed up a bit with my current pfSense running and every thing got a bit confused ... I'll have another go in a moment with the test VM.
I first conntacted my ISP with the issue and as expected they weren't a great deal of help. I'm maybe only one of very few that use a different router than the supplied Adtran - the ONT is Adtran too.
I set the test VM to get it's WAN from the main pfSense LAN and that worked, got an IP for it and can ping out.
The main pfSense gets an IP but no internet. One thing I thought is I wonder if the ISP has updated the firmware in the ONT or OLT, I asked but answer on that. Incidentally the supplied ISP's router connects ok
------------ rebooted test VM ----------- Aug 22 17:24:25 syslogd kernel boot file is /boot/kernel/kernel Aug 22 17:24:25 kernel ---<<BOOT>>--- Aug 22 17:24:25 kernel Copyright (c) 1992-2023 The FreeBSD Project. Aug 22 17:24:25 kernel Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Aug 22 17:24:25 kernel The Regents of the University of California. All rights reserved. Aug 22 17:24:25 kernel FreeBSD is a registered trademark of The FreeBSD Foundation. Aug 22 17:24:25 kernel FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023 Aug 22 17:24:25 kernel root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64 Aug 22 17:24:25 kernel FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152) Aug 22 17:24:25 kernel VT(vga): text 80x25 Aug 22 17:24:25 kernel CPU: QEMU Virtual CPU version 2.5+ (2496.09-MHz K8-class CPU) Aug 22 17:24:25 kernel Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1 Aug 22 17:24:25 kernel Features=0x783fbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2> Aug 22 17:24:25 kernel Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV> Aug 22 17:24:25 kernel AMD Features=0x20100800<SYSCALL,NX,LM> Aug 22 17:24:25 kernel AMD Features2=0x1<LAHF> Aug 22 17:24:25 kernel Hypervisor: Origin = "KVMKVMKVM" Aug 22 17:24:25 kernel real memory = 2147483648 (2048 MB) Aug 22 17:24:25 kernel avail memory = 2016673792 (1923 MB) Aug 22 17:24:25 kernel Event timer "LAPIC" quality 100 Aug 22 17:24:25 kernel ACPI APIC Table: <BOCHS BXPC > Aug 22 17:24:25 kernel random: unblocking device. Aug 22 17:24:25 kernel ioapic0 <Version 1.1> irqs 0-23 Aug 22 17:24:25 kernel TCP_ratelimit: Is now initialized Aug 22 17:24:25 kernel wlan: mac acl policy registered Aug 22 17:24:25 kernel ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 22 17:24:25 kernel ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 22 17:24:25 kernel module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1 Aug 22 17:24:25 kernel ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 22 17:24:25 kernel ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 22 17:24:25 kernel module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1 Aug 22 17:24:25 kernel ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 22 17:24:25 kernel ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 22 17:24:25 kernel module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1 Aug 22 17:24:25 kernel iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 22 17:24:25 kernel iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 22 17:24:25 kernel module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1 Aug 22 17:24:25 kernel iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 22 17:24:25 kernel iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 22 17:24:25 kernel module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1 Aug 22 17:24:25 kernel iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 22 17:24:25 kernel iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 22 17:24:25 kernel module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1 Aug 22 17:24:25 kernel random: entropy device external interface Aug 22 17:24:25 kernel kbd1 at kbdmux0 Aug 22 17:24:25 kernel WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0. Aug 22 17:24:25 kernel netgate0: <QEMU Guest> Aug 22 17:24:25 kernel kvmclock0: <KVM paravirtual clock> Aug 22 17:24:25 kernel Timecounter "kvmclock" frequency 1000000000 Hz quality 975 Aug 22 17:24:25 kernel kvmclock0: registered as a time-of-day clock, resolution 0.000001s Aug 22 17:24:25 kernel vtvga0: <VT VGA driver> Aug 22 17:24:25 kernel smbios0: <System Management BIOS> at iomem 0xf5290-0xf52ae Aug 22 17:24:25 kernel smbios0: Version: 2.8, BCD Revision: 2.8 Aug 22 17:24:25 kernel acpi0: <BOCHS BXPC> Aug 22 17:24:25 kernel acpi0: Power Button (fixed) Aug 22 17:24:25 kernel cpu0: <ACPI CPU> on acpi0 Aug 22 17:24:25 kernel atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0 Aug 22 17:24:25 kernel atrtc0: registered as a time-of-day clock, resolution 1.000000s Aug 22 17:24:25 kernel Event timer "RTC" frequency 32768 Hz quality 0 Aug 22 17:24:25 kernel hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Aug 22 17:24:25 kernel Timecounter "HPET" frequency 100000000 Hz quality 950 Aug 22 17:24:25 kernel Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 Aug 22 17:24:25 kernel acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0 Aug 22 17:24:25 kernel pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 Aug 22 17:24:25 kernel pci0: <ACPI PCI bus> on pcib0 Aug 22 17:24:25 kernel isab0: <PCI-ISA bridge> at device 1.0 on pci0 Aug 22 17:24:25 kernel isa0: <ISA bus> on isab0 Aug 22 17:24:25 kernel atapci0: <Intel PIIX3 WDMA2 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf0a0-0xf0af at device 1.1 on pci0 Aug 22 17:24:25 kernel ata0: <ATA channel> at channel 0 on atapci0 Aug 22 17:24:25 kernel ata1: <ATA channel> at channel 1 on atapci0 Aug 22 17:24:25 kernel uhci0: <Intel 82371SB (PIIX3) USB controller> port 0xf040-0xf05f irq 11 at device 1.2 on pci0 Aug 22 17:24:25 kernel usbus0 on uhci0 Aug 22 17:24:25 kernel pci0: <bridge> at device 1.3 (no driver attached) Aug 22 17:24:25 kernel vgapci0: <VGA-compatible display> mem 0xfc000000-0xfcffffff,0xfea90000-0xfea90fff at device 2.0 on pci0 Aug 22 17:24:25 kernel vgapci0: Boot video device Aug 22 17:24:25 kernel virtio_pci0: <VirtIO PCI (legacy) Balloon adapter> port 0xf000-0xf03f mem 0xfd600000-0xfd603fff irq 11 at device 3.0 on pci0 Aug 22 17:24:25 kernel vtballoon0: <VirtIO Balloon Adapter> on virtio_pci0 Aug 22 17:24:25 kernel pcib1: <ACPI PCI-PCI bridge> mem 0xfea91000-0xfea910ff irq 10 at device 5.0 on pci0 Aug 22 17:24:25 kernel pci1: <ACPI PCI bus> on pcib1 Aug 22 17:24:25 kernel virtio_pci1: <VirtIO PCI (legacy) SCSI adapter> port 0xe000-0xe03f mem 0xfe800000-0xfe800fff,0xfd400000-0xfd403fff irq 10 at device 1.0 on pci1 Aug 22 17:24:25 kernel vtscsi0: <VirtIO SCSI Adapter> on virtio_pci1 Aug 22 17:24:25 kernel virtio_pci2: <VirtIO PCI (legacy) Network adapter> port 0xf060-0xf07f mem 0xfea92000-0xfea92fff,0xfd604000-0xfd607fff irq 10 at device 18.0 on pci0 Aug 22 17:24:25 kernel vtnet0: <VirtIO Networking Adapter> on virtio_pci2 Aug 22 17:24:25 kernel vtnet0: Ethernet address: bc:24:11:23:6c:e0 Aug 22 17:24:25 kernel vtnet0: netmap queues/slots: TX 1/256, RX 1/512 Aug 22 17:24:25 kernel 000.000761 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512 Aug 22 17:24:25 kernel virtio_pci3: <VirtIO PCI (legacy) Network adapter> port 0xf080-0xf09f mem 0xfea93000-0xfea93fff,0xfd608000-0xfd60bfff irq 11 at device 19.0 on pci0 Aug 22 17:24:25 kernel vtnet1: <VirtIO Networking Adapter> on virtio_pci3 Aug 22 17:24:25 kernel vtnet1: Ethernet address: bc:24:11:95:85:5e Aug 22 17:24:25 kernel vtnet1: netmap queues/slots: TX 1/256, RX 1/512 Aug 22 17:24:25 kernel 000.000762 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512 Aug 22 17:24:25 kernel pcib2: <ACPI PCI-PCI bridge> mem 0xfea94000-0xfea940ff irq 10 at device 30.0 on pci0 Aug 22 17:24:25 kernel pci2: <ACPI PCI bus> on pcib2 Aug 22 17:24:25 kernel pcib3: <ACPI PCI-PCI bridge> mem 0xfea95000-0xfea950ff irq 11 at device 31.0 on pci0 Aug 22 17:24:25 kernel pci3: <ACPI PCI bus> on pcib3 Aug 22 17:24:25 kernel acpi_syscontainer0: <System Container> on acpi0 Aug 22 17:24:25 kernel vmgenc0: <VM Generation Counter> on acpi0 Aug 22 17:24:25 kernel acpi_syscontainer1: <System Container> port 0xaf00-0xaf0b on acpi0 Aug 22 17:24:25 kernel acpi_syscontainer2: <System Container> port 0xafe0-0xafe3 on acpi0 Aug 22 17:24:25 kernel acpi_syscontainer3: <System Container> port 0xae00-0xae17 on acpi0 Aug 22 17:24:25 kernel atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 Aug 22 17:24:25 kernel atkbd0: <AT Keyboard> irq 1 on atkbdc0 Aug 22 17:24:25 kernel kbd0 at atkbd0 Aug 22 17:24:25 kernel atkbd0: [GIANT-LOCKED] Aug 22 17:24:25 kernel psm0: <PS/2 Mouse> irq 12 on atkbdc0 Aug 22 17:24:25 kernel psm0: [GIANT-LOCKED] Aug 22 17:24:25 kernel WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0. Aug 22 17:24:25 kernel psm0: model IntelliMouse Explorer, device ID 4 Aug 22 17:24:25 kernel fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0 Aug 22 17:24:25 kernel fdc0: does not respond Aug 22 17:24:25 kernel device_attach: fdc0 attach returned 6 Aug 22 17:24:25 kernel orm0: <ISA Option ROM> at iomem 0xe7800-0xeffff pnpid ORM0000 on isa0 Aug 22 17:24:25 kernel vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0 Aug 22 17:24:25 kernel attimer0: <AT timer> at port 0x40 on isa0 Aug 22 17:24:25 kernel Timecounter "i8254" frequency 1193182 Hz quality 0 Aug 22 17:24:25 kernel Event timer "i8254" frequency 1193182 Hz quality 100 Aug 22 17:24:25 kernel fdc0: No FDOUT register! Aug 22 17:24:25 kernel Timecounter "TSC-low" frequency 1247999989 Hz quality 800 Aug 22 17:24:25 kernel Timecounters tick every 10.000 msec Aug 22 17:24:25 kernel usbus0: 12Mbps Full Speed USB v1.0 Aug 22 17:24:25 kernel ZFS filesystem version: 5 Aug 22 17:24:25 kernel ZFS storage pool version: features support (5000) Aug 22 17:24:25 kernel ugen0.1: <Intel UHCI root HUB> at usbus0 Aug 22 17:24:25 kernel uhub0 on usbus0 Aug 22 17:24:25 kernel uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 Aug 22 17:24:25 kernel Trying to mount root from zfs:pfSense/ROOT/default []... Aug 22 17:24:25 kernel cd0 at ata1 bus 0 scbus1 target 0 lun 0 Aug 22 17:24:25 kernel cd0: <QEMU QEMU DVD-ROM 2.5+> Removable CD-ROM SCSI device Aug 22 17:24:25 kernel cd0: Serial Number QM00003 Aug 22 17:24:25 kernel cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) Aug 22 17:24:25 kernel cd0: 1369MB (701060 2048 byte sectors) Aug 22 17:24:25 kernel da0 at vtscsi0 bus 0 scbus2 target 0 lun 0 Aug 22 17:24:25 kernel da0: <QEMU QEMU HARDDISK 2.5+> Fixed Direct Access SPC-3 SCSI device Aug 22 17:24:25 kernel da0: 300.000MB/s transfers Aug 22 17:24:25 kernel da0: Command Queueing enabled Aug 22 17:24:25 kernel da0: 32768MB (67108864 512 byte sectors) Aug 22 17:24:25 kernel uhub0: 2 ports with 2 removable, self powered Aug 22 17:24:25 kernel ugen0.2: <QEMU QEMU USB Tablet> at usbus0 Aug 22 17:24:25 kernel uhid0 on uhub0 Aug 22 17:24:25 kernel uhid0: <QEMU QEMU USB Tablet, class 0/0, rev 2.00/0.00, addr 2> on usbus0 Aug 22 17:24:25 kernel CPU: QEMU Virtual CPU version 2.5+ (2496.00-MHz K8-class CPU) Aug 22 17:24:25 kernel Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1 Aug 22 17:24:25 kernel Features=0x78bfbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2> Aug 22 17:24:25 kernel Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV> Aug 22 17:24:25 kernel AMD Features=0x20100800<SYSCALL,NX,LM> Aug 22 17:24:25 kernel AMD Features2=0x1<LAHF> Aug 22 17:24:25 kernel Hypervisor: Origin = "KVMKVMKVM" Aug 22 17:24:25 kernel intsmb0: <Intel PIIX4 SMBUS Interface> irq 9 at device 1.3 on pci0 Aug 22 17:24:25 kernel intsmb0: intr IRQ 9 enabled revision 0 Aug 22 17:24:25 kernel smbus0: <System Management Bus> on intsmb0 Aug 22 17:24:25 kernel lo0: link state changed to UP Aug 22 17:24:25 kernel done. Aug 22 17:24:25 kernel vtnet1: link state changed to UP Aug 22 17:24:25 kernel vtnet0: link state changed to UP Aug 22 17:24:25 check_reload_status 445 Linkup starting vtnet1 Aug 22 17:24:25 check_reload_status 445 Linkup starting vtnet0 Aug 22 17:24:26 php-fpm 396 /rc.linkup: Ignoring link event during boot sequence. Aug 22 17:25:26 php-cgi 465 rc.bootup: calling interface_dhcpv6_configure. Aug 22 17:25:26 php-cgi 465 rc.bootup: Accept router advertisements on interface vtnet0 Aug 22 17:25:26 php-cgi 465 rc.bootup: Starting DHCP6 client for interfaces vtnet0 in DHCP6 without RA mode Aug 22 17:25:26 php-cgi 465 rc.bootup: Starting rtsold process on wan(vtnet0) Aug 22 17:25:28 php-cgi 465 rc.bootup: Resyncing OpenVPN instances. Aug 22 17:25:28 kernel done. Aug 22 17:25:28 kernel pflog0: promiscuous mode enabled Aug 22 17:25:28 php-cgi 465 rc.bootup: Gateway, NONE AVAILABLE Aug 22 17:25:28 kernel .done. Aug 22 17:25:28 kernel done. Aug 22 17:25:28 php-cgi 465 rc.bootup: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:25:29 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:30 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:31 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:32 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:33 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:34 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:35 php-cgi 465 rc.bootup: Unbound start waiting on dhcp6c. Aug 22 17:25:35 php-fpm 396 /rc.newwanipv6: rc.newwanipv6: Info: starting on vtnet0. Aug 22 17:25:35 php-fpm 396 /rc.newwanipv6: rc.newwanipv6: on (IP address: 2a0c:4f47:8030:2::1) (interface: wan) (real interface: vtnet0). Aug 22 17:25:35 php-fpm 396 /rc.newwanipv6: Gateway, NONE AVAILABLE Aug 22 17:25:35 php-fpm 396 /rc.newwanipv6: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:25:36 php-cgi 465 rc.bootup: dhcp6 init complete. Continuing Aug 22 17:25:36 php-cgi 465 rc.bootup: sync unbound done. Aug 22 17:25:36 kernel done. Aug 22 17:25:37 kernel done. Aug 22 17:26:07 kernel done. Aug 22 17:26:07 kernel done. Aug 22 17:26:07 php-cgi 465 rc.bootup: NTPD is starting up. Aug 22 17:26:08 kernel done. Aug 22 17:26:08 check_reload_status 445 Updating all dyndns Aug 22 17:26:09 kernel .... Aug 22 17:26:09 php-cgi 465 rc.bootup: The command '/usr/local/sbin/strongswanrc stop' returned exit code '1', the output was 'strongswan not running? (check /var/run/daemon-charon.pid).' Aug 22 17:26:09 kernel .done. Aug 22 17:26:13 php-cgi 465 rc.bootup: Creating rrd update script Aug 22 17:26:13 syslogd exiting on signal 15 Aug 22 17:26:13 syslogd kernel boot file is /boot/kernel/kernel Aug 22 17:26:13 kernel done. Aug 22 17:26:14 php-fpm 396 /rc.start_packages: Restarting/Starting all packages. Aug 22 17:26:14 root 36514 Bootup complete Aug 22 17:26:15 login 79662 login on ttyv0 as root Aug 22 17:26:15 sshguard 81305 Now monitoring attacks. Aug 22 17:36:33 check_reload_status 445 rc.newwanip starting vtnet0 Aug 22 17:36:34 php-fpm 396 /rc.newwanip: rc.newwanip: Info: starting on vtnet0. Aug 22 17:36:34 php-fpm 396 /rc.newwanip: rc.newwanip: on (IP address: xxx.xxx.xxx.xxx) (interface: WAN[wan]) (real interface: vtnet0). Aug 22 17:36:37 php-fpm 396 /rc.newwanip: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP' Aug 22 17:36:37 php-fpm 396 /rc.newwanip: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 22 17:36:37 rc.gateway_alarm 58962 >>> Gateway alarm: WAN_DHCP (Addr:xxx.xxx.xxx.xxx Alarm:1 RTT:0ms RTTsd:0ms Loss:100%) Aug 22 17:36:37 check_reload_status 445 updating dyndns WAN_DHCP Aug 22 17:36:37 check_reload_status 445 Restarting IPsec tunnels Aug 22 17:36:37 check_reload_status 445 Restarting OpenVPN tunnels/interfaces Aug 22 17:36:37 check_reload_status 445 Reloading filter Aug 22 17:36:37 php-fpm 396 /rc.newwanip: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:36:37 php-fpm 396 /rc.newwanip: IP Address has changed, killing states on former IP Address 0.0.0.0. Aug 22 17:36:37 php-fpm 396 /rc.newwanip: Resyncing OpenVPN instances for interface WAN. Aug 22 17:36:37 php-fpm 396 /rc.newwanip: Creating rrd update script Aug 22 17:36:38 php-fpm 75474 /rc.openvpn: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP' Aug 22 17:36:38 php-fpm 75474 /rc.openvpn: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 22 17:36:38 php-fpm 75474 /rc.openvpn: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:36:39 php-fpm 396 /rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xxx.xxx.xxx.xxx - Restarting packages. Aug 22 17:36:39 check_reload_status 445 Starting packages Aug 22 17:36:39 check_reload_status 445 Reloading filter Aug 22 17:36:40 php-fpm 75474 /rc.start_packages: Restarting/Starting all packages. Aug 22 17:38:10 php-fpm 396 /index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database) Aug 22 17:38:13 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:14 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:15 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:16 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:17 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:19 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:20 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:21 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:22 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:23 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:24 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:25 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:40:00 sshguard 81305 Exiting on signal. Aug 22 17:40:00 sshguard 29094 Now monitoring attacks. ----------- Toggled WAN on testVM ------------ Aug 22 17:44:59 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:00 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:01 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:02 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:03 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:04 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:05 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:06 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:07 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:08 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:09 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:10 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:45:31 kernel vtnet0: link state changed to DOWN Aug 22 17:45:31 check_reload_status 445 Linkup starting vtnet0 Aug 22 17:45:32 php-fpm 397 /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp, 6: dhcp6) Aug 22 17:45:32 php-fpm 397 /rc.linkup: DEVD Ethernet detached event for wan Aug 22 17:45:34 check_reload_status 445 Reloading filter Aug 22 17:45:34 rc.gateway_alarm 77152 >>> Gateway alarm: WAN_DHCP (Addr:xxx.xxx.xxx.xxx Alarm:down RTT:0ms RTTsd:0ms Loss:100%) Aug 22 17:45:34 check_reload_status 445 updating dyndns WAN_DHCP Aug 22 17:45:34 check_reload_status 445 Restarting IPsec tunnels Aug 22 17:45:34 check_reload_status 445 Restarting OpenVPN tunnels/interfaces Aug 22 17:45:34 check_reload_status 445 Reloading filter Aug 22 17:45:36 check_reload_status 445 Linkup starting vtnet0 Aug 22 17:45:36 kernel vtnet0: link state changed to UP Aug 22 17:45:37 php-fpm 396 /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp, 6: dhcp6) Aug 22 17:45:37 php-fpm 396 /rc.linkup: DEVD Ethernet attached event for wan Aug 22 17:45:37 php-fpm 396 /rc.linkup: HOTPLUG: Configuring interface wan Aug 22 17:45:37 check_reload_status 445 rc.newwanip starting vtnet0 Aug 22 17:45:37 php-fpm 396 /rc.linkup: calling interface_dhcpv6_configure. Aug 22 17:45:37 php-fpm 396 /rc.linkup: Accept router advertisements on interface vtnet0 Aug 22 17:45:37 php-fpm 396 /rc.linkup: Starting DHCP6 client for interfaces vtnet0 in DHCP6 without RA mode Aug 22 17:45:37 php-fpm 396 /rc.linkup: Starting rtsold process on wan(vtnet0) Aug 22 17:45:38 php-fpm 75474 /rc.newwanip: rc.newwanip: Info: starting on vtnet0. Aug 22 17:45:38 php-fpm 75474 /rc.newwanip: rc.newwanip: on (IP address: xxx.xxx.xxx.xxx) (interface: WAN[wan]) (real interface: vtnet0). Aug 22 17:45:39 php-fpm 397 /rc.newwanipv6: rc.newwanipv6: Info: starting on vtnet0. Aug 22 17:45:39 php-fpm 397 /rc.newwanipv6: rc.newwanipv6: on (IP address: 2a0c:4f47:8030:2::1) (interface: wan) (real interface: vtnet0). Aug 22 17:45:40 php-fpm 396 /rc.linkup: Gateway, NONE AVAILABLE Aug 22 17:45:40 php-fpm 75474 /rc.newwanip: Gateway, NONE AVAILABLE Aug 22 17:45:40 php-fpm 396 /rc.linkup: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:45:40 php-fpm 75474 /rc.newwanip: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:45:40 php-fpm 75474 /rc.newwanip: IP Address has changed, killing states on former IP Address 0.0.0.0. Aug 22 17:45:40 check_reload_status 445 Restarting IPsec tunnels Aug 22 17:45:40 php-fpm 75474 /rc.newwanip: Resyncing OpenVPN instances for interface WAN. Aug 22 17:45:40 check_reload_status 445 updating dyndns wan Aug 22 17:45:40 php-fpm 75474 /rc.newwanip: Creating rrd update script Aug 22 17:45:40 check_reload_status 445 Reloading filter Aug 22 17:45:40 php-fpm 397 /rc.newwanipv6: Gateway, NONE AVAILABLE Aug 22 17:45:40 php-fpm 397 /rc.newwanipv6: Gateway, none 'available' for inet6, use the first one configured. 'WAN_DHCP6' Aug 22 17:45:40 check_reload_status 445 Reloading filter Aug 22 17:45:40 php-fpm 397 /rc.newwanipv6: Resyncing OpenVPN instances for interface WAN. Aug 22 17:45:40 php-fpm 397 /rc.newwanipv6: Creating rrd update script Aug 22 17:45:40 php-fpm 397 /rc.newwanipv6: pfSense package system has detected an IP change or dynamic WAN reconnection - -> 2a0c:4f47:8030:2::1 - Restarting packages. Aug 22 17:45:40 check_reload_status 445 Starting packages Aug 22 17:45:41 php-fpm 397 /rc.start_packages: Restarting/Starting all packages. Aug 22 17:45:42 php-fpm 75474 /rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xxx.xxx.xxx.xxx - Restarting packages. Aug 22 17:45:42 check_reload_status 445 Starting packages Aug 22 17:45:42 check_reload_status 445 Reloading filter Aug 22 17:45:43 php-fpm 71050 /rc.start_packages: Restarting/Starting all packages.
-
Hmm, so that too required bouncing the WAN before a default route was set?
That starts to look more like a race condition. Hmm.
What happened at this point when you logged in?
Aug 22 17:36:39 php-fpm 396 /rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> xxx.xxx.xxx.xxx - Restarting packages. Aug 22 17:36:39 check_reload_status 445 Starting packages Aug 22 17:36:39 check_reload_status 445 Reloading filter Aug 22 17:36:40 php-fpm 75474 /rc.start_packages: Restarting/Starting all packages. Aug 22 17:38:10 php-fpm 396 /index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database) Aug 22 17:38:13 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0 Aug 22 17:38:14 kernel arpresolve: can't allocate llinfo for xxx.xxx.xxx.xxx on vtnet0
Did you do soemthing to trigger the arpresolve errors? And I assume the masked IP there is the WAN gateway?
-
@stephenw10 Apologies for the delay in replying time zones and family commitments !
I may have toggle the LAN so as to get an IP address the xxx's is my IP address. I just tried again but firing up another pfsense after turning of the first really messes things up. I think the switch gets confused.
I'm really not sure where to place the problem.
-
Hmm, if you don't login does it start throwing those errors? It could just be a timeout on the ARP cache but I wouldn't expect that if that's the local address rather than the gateway IP.
-
This time I changed the ethernet type from virtio to intel that made no difference.
I rebooted via the the gui did nothing other than copy the log and toggle the WAN in Proxmox
--------------reboot test VM ------------------- Aug 23 14:50:01 php-fpm 397 /diag_reboot.php: Stopping all packages. Aug 23 14:50:04 reboot 91077 rebooted by root Aug 23 14:50:04 syslogd exiting on signal 15 Aug 23 14:50:38 syslogd kernel boot file is /boot/kernel/kernel Aug 23 14:50:38 kernel pflog0: promiscuous mode disabled Aug 23 14:50:38 kernel Waiting (max 60 seconds) for system process `vnlru' to stop... done Aug 23 14:50:38 kernel Waiting (max 60 seconds) for system process `syncer' to stop... Aug 23 14:50:38 kernel Syncing disks, vnodes remaining... 0 0 0 0 done Aug 23 14:50:38 kernel All buffers synced. Aug 23 14:50:38 kernel Uptime: 3m53s Aug 23 14:50:38 kernel Khelp module "ertt" can't unload until its refcount drops from 1 to 0. Aug 23 14:50:38 kernel uhid0: detached Aug 23 14:50:38 kernel uhub0: detached Aug 23 14:50:38 kernel Rebooting... Aug 23 14:50:38 kernel ---<<BOOT>>--- Aug 23 14:50:38 kernel Copyright (c) 1992-2023 The FreeBSD Project. Aug 23 14:50:38 kernel Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Aug 23 14:50:38 kernel The Regents of the University of California. All rights reserved. Aug 23 14:50:38 kernel FreeBSD is a registered trademark of The FreeBSD Foundation. Aug 23 14:50:38 kernel FreeBSD 14.0-CURRENT amd64 1400094 #1 RELENG_2_7_2-n255948-8d2b56da39c: Wed Dec 6 20:45:47 UTC 2023 Aug 23 14:50:38 kernel root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/obj/amd64/StdASW5b/var/jenkins/workspace/pfSense-CE-snapshots-2_7_2-main/sources/FreeBSD-src-RELENG_2_7_2/amd64.amd64/sys/pfSense amd64 Aug 23 14:50:38 kernel FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152) Aug 23 14:50:38 kernel VT(vga): text 80x25 Aug 23 14:50:38 kernel CPU: QEMU Virtual CPU version 2.5+ (2496.06-MHz K8-class CPU) Aug 23 14:50:38 kernel Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1 Aug 23 14:50:38 kernel Features=0x783fbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2> Aug 23 14:50:38 kernel Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV> Aug 23 14:50:38 kernel AMD Features=0x20100800<SYSCALL,NX,LM> Aug 23 14:50:38 kernel AMD Features2=0x1<LAHF> Aug 23 14:50:38 kernel Hypervisor: Origin = "KVMKVMKVM" Aug 23 14:50:38 kernel real memory = 2147483648 (2048 MB) Aug 23 14:50:38 kernel avail memory = 2016669696 (1923 MB) Aug 23 14:50:38 kernel Event timer "LAPIC" quality 100 Aug 23 14:50:38 kernel ACPI APIC Table: <BOCHS BXPC > Aug 23 14:50:38 kernel random: unblocking device. Aug 23 14:50:38 kernel ioapic0 <Version 1.1> irqs 0-23 Aug 23 14:50:38 kernel TCP_ratelimit: Is now initialized Aug 23 14:50:38 kernel wlan: mac acl policy registered Aug 23 14:50:38 kernel ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 23 14:50:38 kernel ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff807475a0, 0) error 1 Aug 23 14:50:38 kernel ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 23 14:50:38 kernel ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff80747650, 0) error 1 Aug 23 14:50:38 kernel ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. Aug 23 14:50:38 kernel ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80747700, 0) error 1 Aug 23 14:50:38 kernel iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 23 14:50:38 kernel iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80765180, 0) error 1 Aug 23 14:50:38 kernel iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 23 14:50:38 kernel iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80765230, 0) error 1 Aug 23 14:50:38 kernel iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. Aug 23 14:50:38 kernel iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. Aug 23 14:50:38 kernel module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff807652e0, 0) error 1 Aug 23 14:50:38 kernel random: entropy device external interface Aug 23 14:50:38 kernel kbd1 at kbdmux0 Aug 23 14:50:38 kernel WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0. Aug 23 14:50:38 kernel netgate0: <QEMU Guest> Aug 23 14:50:38 kernel kvmclock0: <KVM paravirtual clock> Aug 23 14:50:38 kernel Timecounter "kvmclock" frequency 1000000000 Hz quality 975 Aug 23 14:50:38 kernel kvmclock0: registered as a time-of-day clock, resolution 0.000001s Aug 23 14:50:38 kernel vtvga0: <VT VGA driver> Aug 23 14:50:38 kernel smbios0: <System Management BIOS> at iomem 0xf5290-0xf52ae Aug 23 14:50:38 kernel smbios0: Version: 2.8, BCD Revision: 2.8 Aug 23 14:50:38 kernel acpi0: <BOCHS BXPC> Aug 23 14:50:38 kernel acpi0: Power Button (fixed) Aug 23 14:50:38 kernel cpu0: <ACPI CPU> on acpi0 Aug 23 14:50:38 kernel atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0 Aug 23 14:50:38 kernel atrtc0: registered as a time-of-day clock, resolution 1.000000s Aug 23 14:50:38 kernel Event timer "RTC" frequency 32768 Hz quality 0 Aug 23 14:50:38 kernel hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Aug 23 14:50:38 kernel Timecounter "HPET" frequency 100000000 Hz quality 950 Aug 23 14:50:38 kernel Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 Aug 23 14:50:38 kernel acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0 Aug 23 14:50:38 kernel pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 Aug 23 14:50:38 kernel pci0: <ACPI PCI bus> on pcib0 Aug 23 14:50:38 kernel isab0: <PCI-ISA bridge> at device 1.0 on pci0 Aug 23 14:50:38 kernel isa0: <ISA bus> on isab0 Aug 23 14:50:38 kernel atapci0: <Intel PIIX3 WDMA2 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf0c0-0xf0cf at device 1.1 on pci0 Aug 23 14:50:38 kernel ata0: <ATA channel> at channel 0 on atapci0 Aug 23 14:50:38 kernel ata1: <ATA channel> at channel 1 on atapci0 Aug 23 14:50:38 kernel uhci0: <Intel 82371SB (PIIX3) USB controller> port 0xf080-0xf09f irq 11 at device 1.2 on pci0 Aug 23 14:50:38 kernel usbus0 on uhci0 Aug 23 14:50:38 kernel pci0: <bridge> at device 1.3 (no driver attached) Aug 23 14:50:38 kernel vgapci0: <VGA-compatible display> mem 0xfc000000-0xfcffffff,0xfeab0000-0xfeab0fff at device 2.0 on pci0 Aug 23 14:50:38 kernel vgapci0: Boot video device Aug 23 14:50:38 kernel virtio_pci0: <VirtIO PCI (legacy) Balloon adapter> port 0xf000-0xf03f mem 0xfd600000-0xfd603fff irq 11 at device 3.0 on pci0 Aug 23 14:50:38 kernel vtballoon0: <VirtIO Balloon Adapter> on virtio_pci0 Aug 23 14:50:38 kernel pcib1: <ACPI PCI-PCI bridge> mem 0xfeab1000-0xfeab10ff irq 10 at device 5.0 on pci0 Aug 23 14:50:38 kernel pci1: <ACPI PCI bus> on pcib1 Aug 23 14:50:38 kernel virtio_pci1: <VirtIO PCI (legacy) SCSI adapter> port 0xe000-0xe03f mem 0xfe800000-0xfe800fff,0xfd400000-0xfd403fff irq 10 at device 1.0 on pci1 Aug 23 14:50:38 kernel vtscsi0: <VirtIO SCSI Adapter> on virtio_pci1 Aug 23 14:50:38 kernel em0: <Intel(R) Legacy PRO/1000 MT 82540EM> port 0xf040-0xf07f mem 0xfea80000-0xfea9ffff irq 10 at device 18.0 on pci0 Aug 23 14:50:38 kernel em0: Using 1024 TX descriptors and 1024 RX descriptors Aug 23 14:50:38 kernel em0: Ethernet address: 42:05:9b:43:45:49 Aug 23 14:50:38 kernel em0: netmap queues/slots: TX 1/1024, RX 1/1024 Aug 23 14:50:38 kernel virtio_pci2: <VirtIO PCI (legacy) Network adapter> port 0xf0a0-0xf0bf mem 0xfeab2000-0xfeab2fff,0xfd604000-0xfd607fff irq 11 at device 19.0 on pci0 Aug 23 14:50:38 kernel vtnet0: <VirtIO Networking Adapter> on virtio_pci2 Aug 23 14:50:38 kernel vtnet0: Ethernet address: be:bb:27:ef:48:57 Aug 23 14:50:38 kernel vtnet0: netmap queues/slots: TX 1/256, RX 1/512 Aug 23 14:50:38 kernel 000.000761 [ 452] vtnet_netmap_attach vtnet attached txq=1, txd=256 rxq=1, rxd=512 Aug 23 14:50:38 kernel pcib2: <ACPI PCI-PCI bridge> mem 0xfeab3000-0xfeab30ff irq 10 at device 30.0 on pci0 Aug 23 14:50:38 kernel pci2: <ACPI PCI bus> on pcib2 Aug 23 14:50:38 kernel pcib3: <ACPI PCI-PCI bridge> mem 0xfeab4000-0xfeab40ff irq 11 at device 31.0 on pci0 Aug 23 14:50:38 kernel pci3: <ACPI PCI bus> on pcib3 Aug 23 14:50:38 kernel acpi_syscontainer0: <System Container> on acpi0 Aug 23 14:50:38 kernel vmgenc0: <VM Generation Counter> on acpi0 Aug 23 14:50:38 kernel acpi_syscontainer1: <System Container> port 0xaf00-0xaf0b on acpi0 Aug 23 14:50:38 kernel acpi_syscontainer2: <System Container> port 0xafe0-0xafe3 on acpi0 Aug 23 14:50:38 kernel acpi_syscontainer3: <System Container> port 0xae00-0xae17 on acpi0 Aug 23 14:50:38 kernel atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 Aug 23 14:50:38 kernel atkbd0: <AT Keyboard> irq 1 on atkbdc0 Aug 23 14:50:38 kernel kbd0 at atkbd0 Aug 23 14:50:38 kernel atkbd0: [GIANT-LOCKED] Aug 23 14:50:38 kernel psm0: <PS/2 Mouse> irq 12 on atkbdc0 Aug 23 14:50:38 kernel psm0: [GIANT-LOCKED] Aug 23 14:50:38 kernel WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0. Aug 23 14:50:38 kernel psm0: model IntelliMouse Explorer, device ID 4 Aug 23 14:50:38 kernel fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0 Aug 23 14:50:38 kernel fdc0: does not respond Aug 23 14:50:38 kernel device_attach: fdc0 attach returned 6 Aug 23 14:50:38 kernel orm0: <ISA Option ROM> at iomem 0xe7800-0xeffff pnpid ORM0000 on isa0 Aug 23 14:50:38 kernel vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff pnpid PNP0900 on isa0 Aug 23 14:50:38 kernel attimer0: <AT timer> at port 0x40 on isa0 Aug 23 14:50:38 kernel Timecounter "i8254" frequency 1193182 Hz quality 0 Aug 23 14:50:38 kernel Event timer "i8254" frequency 1193182 Hz quality 100 Aug 23 14:50:38 kernel fdc0: No FDOUT register! Aug 23 14:50:38 kernel Timecounter "TSC-low" frequency 1248000764 Hz quality 800 Aug 23 14:50:38 kernel Timecounters tick every 10.000 msec Aug 23 14:50:38 kernel usbus0: 12Mbps Full Speed USB v1.0 Aug 23 14:50:38 kernel ZFS filesystem version: 5 Aug 23 14:50:38 kernel ZFS storage pool version: features support (5000) Aug 23 14:50:38 kernel ugen0.1: <Intel UHCI root HUB> at usbus0 Aug 23 14:50:38 kernel uhub0 on usbus0 Aug 23 14:50:38 kernel uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0 Aug 23 14:50:38 kernel Trying to mount root from zfs:pfSense/ROOT/default []... Aug 23 14:50:38 kernel cd0 at ata1 bus 0 scbus1 target 0 lun 0 Aug 23 14:50:38 kernel cd0: <QEMU QEMU DVD-ROM 2.5+> Removable CD-ROM SCSI device Aug 23 14:50:38 kernel cd0: Serial Number QM00003 Aug 23 14:50:38 kernel cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) Aug 23 14:50:38 kernel cd0: 1369MB (701060 2048 byte sectors) Aug 23 14:50:38 kernel da0 at vtscsi0 bus 0 scbus2 target 0 lun 0 Aug 23 14:50:38 kernel da0: <QEMU QEMU HARDDISK 2.5+> Fixed Direct Access SPC-3 SCSI device Aug 23 14:50:38 kernel da0: 300.000MB/s transfers Aug 23 14:50:38 kernel da0: Command Queueing enabled Aug 23 14:50:38 kernel da0: 32768MB (67108864 512 byte sectors) Aug 23 14:50:38 kernel uhub0: 2 ports with 2 removable, self powered Aug 23 14:50:38 kernel ugen0.2: <QEMU QEMU USB Tablet> at usbus0 Aug 23 14:50:38 kernel uhid0 on uhub0 Aug 23 14:50:38 kernel uhid0: <QEMU QEMU USB Tablet, class 0/0, rev 2.00/0.00, addr 2> on usbus0 Aug 23 14:50:38 kernel CPU: QEMU Virtual CPU version 2.5+ (2496.00-MHz K8-class CPU) Aug 23 14:50:38 kernel Origin="GenuineIntel" Id=0x60fb1 Family=0xf Model=0x6b Stepping=1 Aug 23 14:50:38 kernel Features=0x78bfbfd<FPU,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2> Aug 23 14:50:38 kernel Features2=0x82b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AESNI,HV> Aug 23 14:50:38 kernel AMD Features=0x20100800<SYSCALL,NX,LM> Aug 23 14:50:38 kernel AMD Features2=0x1<LAHF> Aug 23 14:50:38 kernel Hypervisor: Origin = "KVMKVMKVM" Aug 23 14:50:38 kernel intsmb0: <Intel PIIX4 SMBUS Interface> irq 9 at device 1.3 on pci0 Aug 23 14:50:38 kernel intsmb0: intr IRQ 9 enabled revision 0 Aug 23 14:50:38 kernel smbus0: <System Management Bus> on intsmb0 Aug 23 14:50:38 kernel lo0: link state changed to UP Aug 23 14:50:38 kernel done. Aug 23 14:50:38 kernel em0: link state changed to UP Aug 23 14:50:38 php-cgi 465 rc.bootup: The command '/sbin/ifconfig 'em0' inet6 delete' returned exit code '1', the output was 'ifconfig: ioctl (SIOCDIFADDR): Can't assign requested address' Aug 23 14:50:38 check_reload_status 445 Linkup starting em0 Aug 23 14:50:40 php-fpm 397 /rc.linkup: DHCP Client not running on wan (em0), reconfiguring dhclient. Aug 23 14:50:40 php-cgi 465 rc.bootup: The command '/sbin/dhclient -c /var/etc/dhclient_wan.conf -p /var/run/dhclient.em0.pid em0 > /tmp/em0_output 2> /tmp/em0_error_output' returned exit code '1', the output was '' Aug 23 14:50:40 check_reload_status 445 Linkup starting vtnet0 Aug 23 14:50:40 kernel vtnet0: link state changed to UP Aug 23 14:50:40 php-cgi 465 rc.bootup: Resyncing OpenVPN instances. Aug 23 14:50:41 kernel done. Aug 23 14:50:41 kernel pflog0: promiscuous mode enabled Aug 23 14:50:41 php-fpm 398 /rc.linkup: Ignoring link event during boot sequence. Aug 23 14:50:42 check_reload_status 445 rc.newwanip starting em0 Aug 23 14:50:42 kernel . Aug 23 14:50:42 kernel done. Aug 23 14:50:43 php-fpm 398 /rc.newwanip: rc.newwanip: Info: starting on em0. Aug 23 14:50:43 php-fpm 398 /rc.newwanip: rc.newwanip: on (IP address: my fixed ip) (interface: WAN[wan]) (real interface: em0). Aug 23 14:50:45 rc.gateway_alarm 14686 >>> Gateway alarm: WAN_DHCP (Addr:isp.gateway.ip Alarm:1 RTT:0ms RTTsd:0ms Loss:100%) Aug 23 14:50:45 check_reload_status 445 updating dyndns WAN_DHCP Aug 23 14:50:45 check_reload_status 445 Restarting IPsec tunnels Aug 23 14:50:45 check_reload_status 445 Restarting OpenVPN tunnels/interfaces Aug 23 14:50:45 check_reload_status 445 Reloading filter Aug 23 14:50:45 php-cgi 465 rc.bootup: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP' Aug 23 14:50:45 php-cgi 465 rc.bootup: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 23 14:50:45 php-cgi 465 rc.bootup: Gateway, NONE AVAILABLE Aug 23 14:50:45 kernel done. Aug 23 14:50:46 php-cgi 465 rc.bootup: sync unbound done. Aug 23 14:50:46 kernel done. Aug 23 14:50:48 kernel done. Aug 23 14:50:48 kernel done. Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:12 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:18 php-cgi 465 rc.bootup: The command '/usr/bin/timeout -k 45 30 /usr/local/sbin/ntpd -g -q -c /dev/null 216.239.35.0 216.239.35.4 216.239.35.8 216.239.35.12' returned exit code '124', the output was '23 Aug 14:50:48 ntpd[69295]: ntpd 4.2.8p17@1.4004-o Fri Dec 8 16:52:11 UTC 2023 (1): Starting 23 Aug 14:50:48 ntpd[69295]: Command line: /usr/local/sbin/ntpd -g -q -c /dev/null 216.239.35.0 216.239.35.4 216.239.35.8 216.239.35.12 23 Aug 14:50:48 ntpd[69295]: ---------------------------------------------------- 23 Aug 14:50:48 ntpd[69295]: ntp-4 is maintained by Network Time Foundation, 23 Aug 14:50:48 ntpd[69295]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 23 Aug 14:50:48 ntpd[69295]: corporation. Support and training for ntp-4 are 23 Aug 14:50:48 ntpd[69295]: available at https://www.nwtime.org/support 23 Aug 14:50:48 ntpd[69295]: ---------------------------------------------------- 23 Aug 14:50:48 ntpd[69295]: proto: precision = 0.739 usec (-20) 23 Aug 14:50:48 ntpd[69295]: line 0 column 0 syntax error 23 Aug 14:50:48 ntpd[69295]: basedate set to 2023-11-26 23 Aug 14:50:48 ntpd[69295]: gps base set to 2023-11-26 (week 2290) 23 Aug 14:50:48 ntpd[69295]: Listen and drop on 0 v6wildcard [::]:123 23 Aug 14:50:48 ntpd[69295]: Listen and drop on 1 v4wildcard 0.0.0.0:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 2 em0 [fe80::3af8:f6ff:fef7:d570%1]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 3 em0 my fixed ip:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 4 vtnet0 [fe80::bcbb:27ff:feef:4857%2]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 5 vtnet0 192.168.2.210:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 6 lo0 [::1]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 7 lo0 [fe80::1%4]:123 23 Aug 14:50:48 ntpd[69295]: Listen normally on 8 lo0 127.0.0.1:123 23 Aug 14:50:48 ntpd[69295]: Listening on routing socket on fd #29 for interface updates 23 Aug 14:51:18 ntpd[69295]: ntpd exiting on signal 15 (Terminated)' Aug 23 14:51:18 php-cgi 465 rc.bootup: NTPD is starting up. Aug 23 14:51:18 kernel done. Aug 23 14:51:19 check_reload_status 445 Updating all dyndns Aug 23 14:51:19 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:19 kernel .... Aug 23 14:51:20 php-cgi 465 rc.bootup: The command '/usr/local/sbin/strongswanrc stop' returned exit code '1', the output was 'strongswan not running? (check /var/run/daemon-charon.pid).' Aug 23 14:51:20 kernel .done. Aug 23 14:51:20 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:21 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:24 php-cgi 465 rc.bootup: Creating rrd update script Aug 23 14:51:24 syslogd exiting on signal 15 Aug 23 14:51:24 syslogd kernel boot file is /boot/kernel/kernel Aug 23 14:51:24 kernel done. Aug 23 14:51:24 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:24 php-fpm 397 /rc.start_packages: Restarting/Starting all packages. Aug 23 14:51:25 root 65478 Bootup complete Aug 23 14:51:25 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:26 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:26 login 76089 login on ttyv0 as root Aug 23 14:51:26 sshguard 79310 Now monitoring attacks. Aug 23 14:51:27 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:27 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:28 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:28 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:29 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:29 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:32 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:32 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:35 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:35 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:36 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:37 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:37 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:38 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:40 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:41 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:41 php-fpm 397 /index.php: Successful login for user 'admin' from: 192.168.2.21 (Local Database) Aug 23 14:51:42 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:43 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:43 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:44 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:44 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:44 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:45 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:45 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:45 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:46 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:48 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:48 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:49 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:49 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:50 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:51 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:51 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:52 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:52 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:53 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:53 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:54 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:55 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 ----------- toggled WAN testVM Aug 23 14:57:31 kernel em0: link state changed to DOWN Aug 23 14:57:31 check_reload_status 445 Linkup starting em0 Aug 23 14:57:32 php-fpm 398 /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp) Aug 23 14:57:32 php-fpm 398 /rc.linkup: DEVD Ethernet detached event for wan Aug 23 14:57:33 check_reload_status 445 Reloading filter Aug 23 14:57:33 rc.gateway_alarm 73604 >>> Gateway alarm: WAN_DHCP (Addr:isp.gateway.ip Alarm:down RTT:0ms RTTsd:0ms Loss:100%) Aug 23 14:57:33 check_reload_status 445 updating dyndns WAN_DHCP Aug 23 14:57:33 check_reload_status 445 Restarting IPsec tunnels Aug 23 14:57:33 check_reload_status 445 Restarting OpenVPN tunnels/interfaces Aug 23 14:57:33 check_reload_status 445 Reloading filter Aug 23 14:57:36 check_reload_status 445 Linkup starting em0 Aug 23 14:57:36 kernel em0: link state changed to UP Aug 23 14:57:37 php-fpm 84999 /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp) Aug 23 14:57:37 php-fpm 84999 /rc.linkup: DEVD Ethernet attached event for wan Aug 23 14:57:37 php-fpm 84999 /rc.linkup: HOTPLUG: Configuring interface wan Aug 23 14:57:37 check_reload_status 445 rc.newwanip starting em0 Aug 23 14:57:38 php-fpm 84999 /rc.linkup: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP' Aug 23 14:57:38 php-fpm 84999 /rc.linkup: Gateway, NONE AVAILABLE Aug 23 14:57:38 check_reload_status 445 Restarting IPsec tunnels Aug 23 14:57:38 check_reload_status 445 updating dyndns wan Aug 23 14:57:38 check_reload_status 445 Reloading filter Aug 23 14:57:39 php-fpm 397 /rc.newwanip: rc.newwanip: Info: starting on em0. Aug 23 14:57:39 php-fpm 397 /rc.newwanip: rc.newwanip: on (IP address: my.fixed.ip) (interface: WAN[wan]) (real interface: em0).
-
The dhcp client does it's work, the connection is created, dpinger is lauched to 'check' it, but .... this might be a simple one : yiour 'isp.gateway.ip' (your redacted WAN IP right ?) does not answer to ICMP or ping.
And then , yeah, this will fail right away.A solution is : pick another IP for dpinger to use :
Instead of
do this :
( half the planet uses 8.8.8.8 as this seems to be the IP the most close to their pfSense ...... )
or, why not, experiment with this :
-
@randombits said in WAN only connects on unplug and plug back in:
Aug 23 14:50:40 php-cgi 465 rc.bootup: The command '/sbin/dhclient -c /var/etc/dhclient_wan.conf -p /var/run/dhclient.em0.pid em0 > /tmp/em0_output 2> /tmp/em0_error_output' returned exit code '1', the output was ''
Aug 23 14:50:40 check_reload_status 445 Linkup starting vtnet0Are those error files still present?
/tmp/em0_output
and/tmp/em0_error_output
It looks like it pulls a lease then dumps it during bootup. I think you said the IP and subnet were still present on the device before you bounce the link though? But the gateway was no longer in the ARP table?
-
@Gertjan I tried all those combinations and nothing worked - yes I deleted the gateway and my ip
@stephenw10 none of the errors are in either of those locations.
In the gui it says all's ok
But it's not until I bounce the interface.
-
@randombits said in WAN only connects on unplug and plug back in:
I tried all those combinations and nothing worked
So, imho, it's not pfSense that takes your connection down. Whatever happens, its on the other side of the WAN cable.
-
@randombits said in WAN only connects on unplug and plug back in:
In the gui it says all's ok
Is that before bouncing the NIC in Proxmox?
-
@stephenw10 yes
-
Oh right we went through this already. Too many threads!
At that stage it can ping the gateway but has no default route.
When it starts throwing:
Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0 Aug 23 14:51:11 kernel arpresolve: can't allocate llinfo for isp.gateway.ip on em0
I would expect that gateway to show as down in the dashboard?
When that happens the WAN must be losing it's lease because the firewall ends up without an IP in the gateway subnet.
This must be a timing issue. Though it shouldn't be possible.
You can almost certainly workaround this with a shellmd in the mean time.
When it's in the failed state try running these commands at the CLI:
/etc/rc.newroutedns
/etc/rc.newwanip
Check in between if either of those re-add the required default route. If so you can add them as a shellcmd so it runs at boot.
-
@stephenw10 Neither of those commands did anything, /etc/rc.newwanip did take a while though.
-
Hmm, try:
/etc/rc.reload_interfaces wan
-
@stephenw10 YES!! That did it ! Now after my over exuberance how do I add that into a reboots .... ?
(It was all a bit worry given that the phone here (FreePBX VM) goes over the internet and we do get power blips that can cause reboots and no phone. Mobiles are very poor in this area)
-
Add it as a shellmd. The easiest way to do that it to install the Shellcmd package then add the command like:
-
SOLVED !
@stephenw10 Well that worked !.
Many thanks for bearing with me on this. The whole thing is weird as to why it started to happen. I can sleep better thinking everything will come back up after a power failure or backup.
The first I noticed it is when Proxmox does it's twice it's week back overnight and the internet would be down in the morning. I set pfSense to backup on early Fridays mornings and on Saturdays Docker would update containers - Watchtower. And then on early Sunday mornings Proxmox would do another back.
Thanks Stephen for all your help I appreciate it.
Dave.
-
Ah, cool! Shouldn't be required though, be good to find out what's actually causing that. Someday!
Anyway glad we were able to get a workaround in place.