Panic String: bpf_mcopy

erode · Dec 15, 2021, 7:29 PM

@stephenw10 Thanks! The problem was fixed, apparently some initial installation or configuration issue, after the reinstallation we had no problems. But the problems were indeed caused by the 10 GB motherboard, luckily it did not have to be changed. Just reinstall. Thanks for the help.

erode · Feb 8, 2022, 5:12 PM

@stephenw10 said in Panic String: bpf_mcopy:

Yes, it should be disabled but the that NIC is quite complex. I expect it has a bunch of offload options.
Run ifconfig -vm against it. That will list the enabled options.

Steve

Hello! how are you? Unfortunately we continue with this kernel panic, in this last month it appeared 3 times. We could not identify why it happens, since at the time of the crash we are not touching anything on the device.

We have two identical Lenovo sr250 computers, and it happens randomly on both of them. The only thing I could see is that the minute the crash occurs, the cpu consumption shoots up a lot.

I have the backtrace, but I don't really know how to read it. I leave it attached, could you give me an indication of where to start looking? we are about to go into production with this equipment to replace mikrotik, but now we are in serious trouble.

erode · Feb 8, 2022, 9:58 PM

@stephenw10 said in Panic String: bpf_mcopy:

Yes, it should be disabled but the that NIC is quite complex. I expect it has a bunch of offload options.
Run ifconfig -vm against it. That will list the enabled options.

Steve

Crash report begins.  Anonymous machine information:

amd64
12.2-STABLE
FreeBSD 12.2-STABLE fd0f54f44b5c(RELENG_2_5_0) pfSense

Crash report details:

No PHP errors found.

Filename: /var/crash/info.0
Dump header from device: /dev/ada0p3
  Architecture: amd64
  Architecture Version: 4
  Dump Length: 101376
  Blocksize: 512
  Compression: none
  Dumptime: Tue Feb  8 12:38:47 2022
  Hostname: jd.domain.com.ar
  Magic: FreeBSD Text Dump
  Version String: FreeBSD 12.2-STABLE fd0f54f44b5c(RELENG_2_5_0) pfSense
  Panic String: bpf_mcopy
  Dump Parity: 3354687337
  Bounds: 0
  Dump Status: good

Filename: /var/crash/textdump.tar.0
ddb.txt06000014000014200507207  7067 ustarrootwheeldb:0:kdb.enter.default>  run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo>  show alllocks
No such command; use "help" to list available commands
db:1:lockinfo>  show lockedvnods
Locked vnodes
db:0:kdb.enter.default>  show pcpu
cpuid        = 3
dynamic pcpu = 0xfffffe0080d99380
curthread    = 0xfffff80140906000: pid 51869 tid 100576 "openvpn"
curpcb       = 0xfffff801409065a0
fpcurthread  = 0xfffff80140906000: pid 51869 "openvpn"
idlethread   = 0xfffff80005617740: tid 100006 "idle: cpu3"
curpmap      = 0xfffff802e19a0138
tssp         = 0xffffffff83717758
commontssp   = 0xffffffff83717758
rsp0         = 0xfffffe009333dbc0
kcr3         = 0x800000018eb296b5
ucr3         = 0x800000018e96beb5
scr3         = 0x3ae00ef02
gs32p        = 0xffffffff8371df70
ldt          = 0xffffffff8371dfb0
tss          = 0xffffffff8371dfa0
tlb gen      = 58597308
curvnet      = 0xfffff80005090b80
db:0:kdb.enter.default>  bt
Tracing pid 51869 tid 100576 td 0xfffff80140906000
kdb_enter() at kdb_enter+0x37/frame 0xfffffe009333cff0
vpanic() at vpanic+0x197/frame 0xfffffe009333d040
panic() at panic+0x43/frame 0xfffffe009333d0a0
bpf_buffer_append_mbuf() at bpf_buffer_append_mbuf+0x64/frame 0xfffffe009333d0d0
catchpacket() at catchpacket+0x4fd/frame 0xfffffe009333d170
bpf_mtap2() at bpf_mtap2+0x1f0/frame 0xfffffe009333d270
ether_vlan_mtap() at ether_vlan_mtap+0xa3/frame 0xfffffe009333d3b0
oce_multiq_transmit() at oce_multiq_transmit+0x112/frame 0xfffffe009333d410
oce_multiq_start() at oce_multiq_start+0x76/frame 0xfffffe009333d440
vlan_transmit() at vlan_transmit+0xda/frame 0xfffffe009333d4b0
ether_output_frame() at ether_output_frame+0xb4/frame 0xfffffe009333d4e0
ether_output() at ether_output+0x676/frame 0xfffffe009333d560
ip_output() at ip_output+0x131c/frame 0xfffffe009333d6a0
ip_forward() at ip_forward+0x366/frame 0xfffffe009333d770
ip_input() at ip_input+0x7db/frame 0xfffffe009333d820
netisr_dispatch_src() at netisr_dispatch_src+0xca/frame 0xfffffe009333d870
tunwrite() at tunwrite+0x31f/frame 0xfffffe009333d8b0
devfs_write_f() at devfs_write_f+0xda/frame 0xfffffe009333d920
dofilewrite() at dofilewrite+0xb0/frame 0xfffffe009333d970
sys_writev() at sys_writev+0x6e/frame 0xfffffe009333d9c0
amd64_syscall() at amd64_syscall+0x387/frame 0xfffffe009333daf0
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe009333daf0
--- syscall (121, FreeBSD ELF64, sys_writev), rip = 0x80088e75a, rsp = 0x7fffffffcb48, rbp = 0x7fffffffcb80 ---

stephenw10 · Feb 8, 2022, 9:59 PM

@erode said in Panic String: bpf_mcopy:

Run ifconfig -vm against it. That will list the enabled options.

Did you try that yet? Did you disable hardware options?

Steve

erode · Feb 8, 2022, 11:16 PM

@stephenw10
Hi Steve, nice to talk to you again, thank you very much for your reply. I enclose the configurations that I have about what you tell me. if you see rare ips it is because I modified them for security

bge0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WANMETROTEL
	options=80098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:60
	inet6 fe80::be97:e1ff:fe86:60%bge0 prefixlen 64 scopeid 0x1
	inet 120.121.136.19 netmask 0xfffffff8 broadcast 124.112.196.13
	inet 140.141.296.21 netmask 0xfffffff8 broadcast 144.441.144.13 vhid 5
	carp: MASTER vhid 5 advbase 1 advskew 0
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:61
	media: Ethernet autoselect
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:62
	media: Ethernet autoselect
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge3: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:63
	media: Ethernet autoselect
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce0: flags=8002<BROADCAST,MULTICAST> metric 0 mtu 1500
	options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
	capabilities=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
	ether 00:10:9b:9d:2f:60
	media: Ethernet autoselect
	status: no carrier
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: LAN
	options=500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO>
	capabilities=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1 prefixlen 64 scopeid 0x6
	inet 30.30.30.200 netmask 0xffffff00 broadcast 30.30.30.255
	inet 30.30.30.204 netmask 0xffffff00 broadcast 30.30.30.255 vhid 2
	carp: MASTER vhid 2 advbase 1 advskew 0
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	plugged: SFP/SFP+/SFP28 10G Base-LR (LC)
	vendor: OEM PN: SFP+-10G-BX20-D SN: 202105060164 DATE: 2021-05-06
	module temperature: 46.54 C Voltage: 3.32 Volts
	RX: 0.81 mW (-0.89 dBm) TX: 1.11 mW (0.49 dBm)
bge4: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WAN_CLARO
	options=80098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 7c:8a:e1:ce:b8:46
	inet6 fe80::7e8a:e1ff:fece:b846%bge4 prefixlen 64 scopeid 0x7
	inet 30.30.30.194 netmask 0xfffffff8 broadcast 30.30.30.199
	inet 30.30.30.197 netmask 0xfffffff8 broadcast 30.30.30.199 vhid 1
	inet 30.30.30.198 netmask 0xfffffff8 broadcast 30.30.30.199 vhid 12
	carp: MASTER vhid 1 advbase 1 advskew 0
	carp: MASTER vhid 12 advbase 1 advskew 0
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge5: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: SYNC
	options=80098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 7c:8a:e1:ce:b8:47
	inet6 fe80::7e8a:e1ff:fece:b847%bge5 prefixlen 64 scopeid 0x8
	inet 10.0.1.1 netmask 0xfffffffc broadcast 10.0.1.3
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
enc0: flags=41<UP,RUNNING> metric 0 mtu 1536
	groups: enc
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	capabilities=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa
	inet 127.0.0.1 netmask 0xff000000
	inet 30.30.30 netmask 0xffffffff
	groups: lo
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
pflog0: flags=100<PROMISC> metric 0 mtu 33160
	groups: pflog
pfsync0: flags=41<UP,RUNNING> metric 0 mtu 1500
	pfsync: syncdev: bge5 maxupd: 128 defer: off
	syncok: 1
	groups: pfsync
oce1.150: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: Servers
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.150 prefixlen 64 scopeid 0xd
	inet 30.30.30.2 netmask 0xffffff00 broadcast 30.30.30.255
	inet 30.30.30.4 netmask 0xffffff00 broadcast 30.30.30.255 vhid 4
	groups: vlan
	carp: MASTER vhid 4 advbase 1 advskew 0
	vlan: 150 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.180: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 1500
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.180 prefixlen 64 scopeid 0xe
	groups: vlan
	vlan: 180 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.200: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: VoIP
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.200 prefixlen 64 scopeid 0xf
	inet 10.21.21.2 netmask 0xffffff00 broadcast 10.21.21.255
	inet 10.21.21.4 netmask 0xffffff00 broadcast 10.21.21.255 vhid 7
	groups: vlan
	carp: MASTER vhid 7 advbase 1 advskew 0
	vlan: 200 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.250: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: Solar
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.250 prefixlen 64 scopeid 0x10
	inet 30.30.30.2 netmask 0xffffff00 broadcast 30.30.30.255
	inet 30.30.30.4 netmask 0xffffff00 broadcast 30.30.30.255 vhid 10
	groups: vlan
	carp: MASTER vhid 10 advbase 1 advskew 0
	vlan: 250 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

stephenw10 · Feb 9, 2022, 3:51 PM

@erode said in Panic String: bpf_mcopy:

options=500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO>

Hmm, well you might try disabling the hardware VLAN off-loading options on oce1 there. The panic looks like it could be in one of them.

Do you see mbuf being used excessively? Check the Monitoring Graphs. It appears there have been issues in the driver previously.

This looks almost identical but no solution shown:
https://forum.netgate.com/topic/147078/pfsense-reboot-kernel-panic-bpf_mcopy-v2-4-4-p3

Steve

erode · Feb 9, 2022, 3:51 PM

@stephenw10 Good morning Steve :) thanks for your time and your answer.
From what I can understand, according to the configuration I have, I already have off-loading disabled, am I right? look at this image:

We already had this enabled and we already restarted the computer several times with this option checked. The strange thing is that when doing the ifconfig -vm, it shows enabled on the 10 gb main board, and also on the vlans that are mounted on this board:

oce0: flags=8002<BROADCAST,MULTICAST> metric 0 mtu 1500
options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
capabilities=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>

(vlan:)

oce1.250: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
description: Solar
capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>

Sorry for the inconvenience, but from where else could I disable what you tell me? try doing it with: ifconfig oce1.250 -vlanhwtso -tso4 -tso -lro

but then when I run ifconfig -vm oce1.250 it still shows me the tso options, it doesn't change anything. Try to restart also after executing these commands by console, but I was not successful either, I still see them the same.

The question would be what would be the way to disable it? taking into account that I already have that option marked in the image that I showed you. Also, do you have any idea if the Emulex VFA5.2 2x10 GbE SFP + PCIe Adapter board supports pfsense? Is there a list of compatible motherboards so I can check?

Regarding what you tell me about mbuf, we have monitored the use with zabbix and it never reaches saturation. We have also raised the maximum value of mbuf to 1000000, and we also increased this value:

here we can see the use of the mbuf in the last 2 days, yesterday before 1 pm, the kernel panic occurred (a drop in the line is noted). but I understand that this would not be generating problems.

Steve, thank you very much in advance for your help.

stephenw10 · Feb 9, 2022, 4:53 PM

You still see those enabled on oce0 because it's not assigned and enabled in pfSense so no default settings are applied.

The vlans inherit their options from the parent interface so disable that vlan hardware offloading on oce1.

Steve

erode · Feb 9, 2022, 5:09 PM

@stephenw10

Thanks again Steve! the oce1 network card (emulex) has the lan network assigned, then I have mounted the other vlans on oce1 as well, I show you the configuration:

It's strange that it's not assigned and it's not applying the changes, since I have the option "hardware tcp segmentation offloading" and "hardware lardge recieve offloading" checked several weeks ago, and the server has been restarted several times.
When you tell me to disable hardware download in oce1, where should I do it? Since I understand that this is done by checking the "hardware tcp segmentation offloading" option in system -> advanced, is there any other way to do it? Thank you very much Steve, sorry for the inconvenience

stephenw10 · Feb 9, 2022, 5:20 PM

oce0 is not assigned though which is what you showed above.

I would not expect to see TSO or LRO enabled on oce1 since it is assigned.

Steve

erode · Feb 9, 2022, 5:24 PM

@stephenw10 Thanks Steve, sorry for the confusion! oce0 is currently disabled as we don't have any cables connected to this board as we don't plan to use it. Should I enable it anyway? I understand that if the vlans are in oce1 they should inherit from there, or if I need to assign plates, this off-loading option is not applied? thanks again Steve!!

stephenw10 · Feb 9, 2022, 6:06 PM

It should be applied there but I can't see because you haven't posted the ifconfig output showing oce1.

erode · Feb 9, 2022, 6:36 PM

@stephenw10 Sorry Steve, I'm sending you here the complete result of ifconfig -vm (I had to hide the ips, in case you see 11.11.11.11 on all boards)
Thank you for all this help you are giving us!

bge0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WANMETROTEL
	options=80098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:60
	inet6 fe80::be97:e1ff:fe86:60%bge0 prefixlen 64 scopeid 0x1
	inet 11.11.11.11.59 netmask 0xfffffff8 broadcast 11.11.11.11.63
	inet 11.11.11.11.61 netmask 0xfffffff8 broadcast 11.11.11.11.63 vhid 5
	carp: MASTER vhid 5 advbase 1 advskew 0
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:61
	media: Ethernet autoselect
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:62
	media: Ethernet autoselect
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge3: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
	options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether bc:97:e1:86:00:63
	media: Ethernet autoselect
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce0: flags=8002<BROADCAST,MULTICAST> metric 0 mtu 1500
	options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
	capabilities=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
	ether 00:10:9b:9d:2f:60
	media: Ethernet autoselect
	status: no carrier
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: LAN
	options=500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO>
	capabilities=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1 prefixlen 64 scopeid 0x6
	inet 11.11.11.11.200 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.204 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 2
	carp: MASTER vhid 2 advbase 1 advskew 0
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	plugged: SFP/SFP+/SFP28 10G Base-LR (LC)
	vendor: OEM PN: SFP+-10G-BX20-D SN: 202105060164 DATE: 2021-05-06
	module temperature: 46.54 C Voltage: 3.32 Volts
	RX: 0.81 mW (-0.90 dBm) TX: 1.12 mW (0.49 dBm)
bge4: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WAN_CLARO
	options=80098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 7c:8a:e1:ce:b8:46
	inet6 fe80::7e8a:e1ff:fece:b846%bge4 prefixlen 64 scopeid 0x7
	inet 11.11.11.11.194 netmask 0xfffffff8 broadcast 11.11.11.11.199
	inet 11.11.11.11.197 netmask 0xfffffff8 broadcast 11.11.11.11.199 vhid 1
	inet 11.11.11.11.198 netmask 0xfffffff8 broadcast 11.11.11.11.199 vhid 12
	carp: MASTER vhid 1 advbase 1 advskew 0
	carp: MASTER vhid 12 advbase 1 advskew 0
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bge5: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: SYNC
	options=80098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,LINKSTATE>
	capabilities=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
	ether 7c:8a:e1:ce:b8:47
	inet6 fe80::7e8a:e1ff:fece:b847%bge5 prefixlen 64 scopeid 0x8
	inet 10.0.1.1 netmask 0xfffffffc broadcast 10.0.1.3
	media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
	supported media:
		media autoselect mediaopt flowcontrol
		media autoselect
		media 1000baseT mediaopt full-duplex,master
		media 1000baseT mediaopt full-duplex
		media 1000baseT mediaopt master
		media 1000baseT
		media 100baseTX mediaopt full-duplex
		media 100baseTX
		media 10baseT/UTP mediaopt full-duplex
		media 10baseT/UTP
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
enc0: flags=41<UP,RUNNING> metric 0 mtu 1536
	groups: enc
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
	options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	capabilities=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
	inet6 ::1 prefixlen 128
	inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa
	inet 127.0.0.1 netmask 0xff000000
	inet 11.11.11.11.1 netmask 0xffffffff
	groups: lo
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
pflog0: flags=100<PROMISC> metric 0 mtu 33160
	groups: pflog
pfsync0: flags=41<UP,RUNNING> metric 0 mtu 1500
	pfsync: syncdev: bge5 maxupd: 128 defer: off
	syncok: 1
	groups: pfsync
oce1.150: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: Servers
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.150 prefixlen 64 scopeid 0xd
	inet 11.11.11.11.2 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.4 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 4
	groups: vlan
	carp: MASTER vhid 4 advbase 1 advskew 0
	vlan: 150 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.180: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 1500
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.180 prefixlen 64 scopeid 0xe
	groups: vlan
	vlan: 180 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.200: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: VoIP
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.200 prefixlen 64 scopeid 0xf
	inet 11.11.11.11.2 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.4 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 7
	groups: vlan
	carp: MASTER vhid 7 advbase 1 advskew 0
	vlan: 200 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.250: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: Solar
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.250 prefixlen 64 scopeid 0x10
	inet 11.11.11.11.2 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.4 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 10
	groups: vlan
	carp: MASTER vhid 10 advbase 1 advskew 0
	vlan: 250 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.300: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: WiFi
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.300 prefixlen 64 scopeid 0x11
	inet 11.11.11.11.2 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.5 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 8
	groups: vlan
	carp: MASTER vhid 8 advbase 1 advskew 0
	vlan: 300 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.310: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 1500
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.310 prefixlen 64 scopeid 0x12
	groups: vlan
	vlan: 310 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.400: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: Camaras
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.400 prefixlen 64 scopeid 0x13
	inet 11.11.11.11.2 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.4 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 11
	groups: vlan
	carp: MASTER vhid 11 advbase 1 advskew 0
	vlan: 400 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.600: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
	description: Printers
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.600 prefixlen 64 scopeid 0x14
	inet 11.11.11.11.2 netmask 0xffffff00 broadcast 11.11.11.11.255
	inet 11.11.11.11.4 netmask 0xffffff00 broadcast 11.11.11.11.255 vhid 6
	groups: vlan
	carp: MASTER vhid 6 advbase 1 advskew 0
	vlan: 600 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.700: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 1500
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.700 prefixlen 64 scopeid 0x15
	groups: vlan
	vlan: 700 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
oce1.333: flags=8043<UP,BROADCAST,RUNNING,MULTICAST> metric 0 mtu 1500
	capabilities=703<RXCSUM,TXCSUM,TSO4,TSO6,LRO>
	ether 00:10:9b:9d:2f:68
	inet6 fe80::210:9bff:fe9d:2f68%oce1.333 prefixlen 64 scopeid 0x16
	groups: vlan
	vlan: 333 vlanpcp: 0 parent interface: oce1
	media: Ethernet autoselect (10Gbase-SR <full-duplex>)
	status: active
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
ovpns1: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1500
	options=80000<LINKSTATE>
	capabilities=80000<LINKSTATE>
	inet6 fe80::be97:e1ff:fe86:60%ovpns1 prefixlen 64 scopeid 0x17
	inet 11.11.11.11.1 --> 11.11.11.11.2 netmask 0xffffff00
	groups: tun openvpn
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	Opened by PID 36943
ovpns2: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> metric 0 mtu 1500
	options=80000<LINKSTATE>
	capabilities=80000<LINKSTATE>
	inet6 fe80::be97:e1ff:fe86:60%ovpns2 prefixlen 64 scopeid 0x18
	inet 11.11.11.11.1 --> 11.11.11.11.2 netmask 0xffffff00
	groups: tun openvpn
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	Opened by PID 71363

stephenw10 · Feb 9, 2022, 6:39 PM

@erode said in Panic String: bpf_mcopy:

oce1: flags=8143<UP,BROADCAST,RUNNING,PROMISC,MULTICAST> metric 0 mtu 1500
description: LAN
options=500b8<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO>

I'm sorry you did actually post that already above.

But, that's what I expect to see. The TSO and LRO options are disabled already.

The VLAN hardware options are not though which is why I suggested disabling them manually as a test.

Steve

erode · Feb 10, 2022, 3:20 PM

@stephenw10 Hi Steve, good morning! How are you? thanks for taking the time to help me :)

I tried to disable TSO4,TSO6 and LRO in vlan oce1.310, first I did an ifconfig -vm oce1.310 so you can see how its status is, then I ran the ifconfig commands oce1.310 -tso4 (and others) and then run ifconfig -vm oce1.310 again so you can see how it looks.

What I notice is that when I run ifconfig to remove the tso and lro options, it doesn't apply the changes. It is worth clarifying that I saw how to do this in the freebsd documentation that explains everything (https://www.freebsd.org/cgi/man.cgi?ifconfig)

Here's a picture of what I did so you can see it:

Am I correct or am I doing the procedure wrong? This has me a bit lost, we have spent a lot of money to be able to buy two computers and use pfsense, but so far your help is a great guide for me. Thank you!

stephenw10 · Feb 10, 2022, 3:25 PM

You need to do that on oce1 directly not the VLANs on it.

erode · Feb 10, 2022, 4:06 PM

@stephenw10 Thanks Steve! this is the result in the oce1:

It seems that it is not applying either :(

stephenw10 · Feb 10, 2022, 5:45 PM

No TSO and LRO are already disabled on oce1. You need to check oce1 again after disabling the VLAN hardware off loading.

The output from the vlan interfaces is just listing the capabilities not what's actually enabled.

Steve

erode · Feb 10, 2022, 6:27 PM

@stephenw10 I do it this way and this is the result, should I do it another way?

On the other hand, you know that looking at the boot log, I found this on the computer:

apei0: <ACPI Platform Error Interface>

Do you think it could be something relevant? appears at startup, but once it starts, the computer can go several days without doing the dump until it does. this week he did it twice.

Thanks!

stephenw10 · Feb 10, 2022, 6:43 PM

Hmm, well that doesn't appear to have disabled VLAN HW TSO as an option for some reason.
The other things were already disabled, there's no need to disable them again there.
Try any of the other VLAN HW options.

ACPI errors are unfortunately common. Manufacturers often only test Windows and the BIOS tables can be full of errors for other OSes.

Steve