2.1.1/2.1.2 - Unable to connect LAN from power off without firewall reboot

stephenw10

Hmm. If you run ifconfig at the console do the bridge member interfaces show as 'promiscuous mode'?

Why are arp replies from LAN not appearing on OPT2? Perhaps because the bridge device thinks it has a route the main PC via some other interface? Maybe try packet captures on other bridge members to see if replies are ending up on the wrong interface. Just speculation. ;)

Steve

ESPNSTI

The first post shows output from ifconfig, it shows PROMISC in the interfaces flags of the bridge member interfaces.
I will re-run it next time to make sure.

I will run package captures on the other interfaces next time to see if the replies end up elsewhere.

Thanks for the suggestions.

ESPNSTI

Packet captures on other interfaces don't show the missing ARP replies.

I re-ran ifconfig, and it shows the same info as in the first post.

However, I had success coaxing the connection back to life without a reboot.

I ran "ifconfig em2 down" and "ifconfig em2 up" and I think that got it going again.
However, I am not 100% sure, since I also played around with "ifconfig em2 -promisc" and "ifconfig em2 promisc", but nothing seemed to happen when I ran those.

Edit:
Tried it on a different PC, and it's the "ifconfig em3 up" after the "ifconfig em3 down" that does it.

Here is the log, I ran the ifconfig commands at 07:22:09 and 07:22:13.
It came back to life shortly after 07:22:13.

Apr 21 07:22:19 	php: rc.newwanip: Interface does not have an IP address, nothing to do.
Apr 21 07:22:19 	php: rc.newwanip: rc.newwanip: Informational is starting em3.
Apr 21 07:22:16 	check_reload_status: rc.newwanip starting em3
Apr 21 07:22:15 	php: rc.linkup: Hotplug event detected for OPT3(opt3) but ignoring since interface is configured with static IP ( )
Apr 21 07:22:13 	php: rc.linkup: Hotplug event detected for OPT3(opt3) but ignoring since interface is configured with static IP ( )
Apr 21 07:22:13 	check_reload_status: Linkup starting em3
Apr 21 07:22:13 	kernel: em3: link state changed to UP
Apr 21 07:22:09 	kernel: em3: link state changed to DOWN
Apr 21 07:22:09 	check_reload_status: Linkup starting em3
Apr 21 07:20:05 	php: rc.newwanip: Interface does not have an IP address, nothing to do.
Apr 21 07:20:05 	php: rc.newwanip: rc.newwanip: Informational is starting em3.
Apr 21 07:20:01 	check_reload_status: rc.newwanip starting em3
Apr 21 07:20:00 	php: rc.linkup: Hotplug event detected for OPT3(opt3) but ignoring since interface is configured with static IP ( )
Apr 21 07:19:57 	kernel: em3: link state changed to UP
Apr 21 07:19:57 	check_reload_status: Linkup starting em3

stephenw10

Hmm, interesting. I wonder why the interface stops responding yet nothing in the logs. :-
Can you bring the interface back by unplugging and re-plugging the cable?

Steve

ESPNSTI

When I tried it in the past, unplugging and re-plugging the cable didn't make a difference, neither did switching to a different port.
I will try that again though next time.

I am wondering if it's not some sort of sleep or power saving mode that is enabled in the 2.1.1 nic driver that isn't in 2.1.0 (if such a thing exists)?
I haven't narrowed down the exact time threshold, but it seems consistent somewhere between 4 and 5 hours, so maybe it's some sort of sleep time setting (although I would think that would be much shorter).

stephenw10

Good question. The em drivers were updated for 2.1.1 so that's a distinct possibility. What are the actual chips in the NICs you have? Anything relevant in hw.em? This looks a likely suspect:

[2.1.2-RELEASE][root@pfsense.fire.box]/root(3): sysctl hw.em.smart_pwr_down
hw.em.smart_pwr_down: 0

Anything suspect in dev.em?

Steve

ESPNSTI

The nics are all Intel 82574L.

$ sysctl hw.em
hw.em.num_queues: 0
hw.em.eee_setting: 1
hw.em.rx_process_limit: 100
hw.em.enable_msix: 1
hw.em.sbp: 0
hw.em.smart_pwr_down: 0
hw.em.txd: 1024
hw.em.rxd: 1024
hw.em.rx_abs_int_delay: 66
hw.em.tx_abs_int_delay: 66
hw.em.rx_int_delay: 0
hw.em.tx_int_delay: 66

$ sysctl dev.em
dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.0.%driver: em
dev.em.0.%location: slot=0 function=0
dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.0.%parent: pci5
dev.em.0.nvm: -1
dev.em.0.debug: -1
dev.em.0.fc: 3
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.itr: 488
dev.em.0.rx_processing_limit: 100
dev.em.0.eee_control: 1
dev.em.0.link_irq: 3
dev.em.0.mbuf_alloc_fail: 0
dev.em.0.cluster_alloc_fail: 0
dev.em.0.dropped: 0
dev.em.0.tx_dma_fail: 0
dev.em.0.rx_overruns: 0
dev.em.0.watchdog_timeouts: 0
dev.em.0.device_control: 1074790984
dev.em.0.rx_control: 67141658
dev.em.0.fc_high_water: 18432
dev.em.0.fc_low_water: 16932
dev.em.0.queue0.txd_head: 66
dev.em.0.queue0.txd_tail: 66
dev.em.0.queue0.tx_irq: 1332941
dev.em.0.queue0.no_desc_avail: 0
dev.em.0.queue0.rxd_head: 543
dev.em.0.queue0.rxd_tail: 542
dev.em.0.queue0.rx_irq: 2110549
dev.em.0.mac_stats.excess_coll: 0
dev.em.0.mac_stats.single_coll: 0
dev.em.0.mac_stats.multiple_coll: 0
dev.em.0.mac_stats.late_coll: 0
dev.em.0.mac_stats.collision_count: 0
dev.em.0.mac_stats.symbol_errors: 0
dev.em.0.mac_stats.sequence_errors: 0
dev.em.0.mac_stats.defer_count: 0
dev.em.0.mac_stats.missed_packets: 0
dev.em.0.mac_stats.recv_no_buff: 0
dev.em.0.mac_stats.recv_undersize: 0
dev.em.0.mac_stats.recv_fragmented: 0
dev.em.0.mac_stats.recv_oversize: 14
dev.em.0.mac_stats.recv_jabber: 0
dev.em.0.mac_stats.recv_errs: 1
dev.em.0.mac_stats.crc_errs: 1616
dev.em.0.mac_stats.alignment_errs: 0
dev.em.0.mac_stats.coll_ext_errs: 0
dev.em.0.mac_stats.xon_recvd: 0
dev.em.0.mac_stats.xon_txd: 0
dev.em.0.mac_stats.xoff_recvd: 0
dev.em.0.mac_stats.xoff_txd: 0
dev.em.0.mac_stats.total_pkts_recvd: 2601085
dev.em.0.mac_stats.good_pkts_recvd: 2599455
dev.em.0.mac_stats.bcast_pkts_recvd: 86896
dev.em.0.mac_stats.mcast_pkts_recvd: 144132
dev.em.0.mac_stats.rx_frames_64: 207244
dev.em.0.mac_stats.rx_frames_65_127: 839440
dev.em.0.mac_stats.rx_frames_128_255: 225214
dev.em.0.mac_stats.rx_frames_256_511: 121557
dev.em.0.mac_stats.rx_frames_512_1023: 43046
dev.em.0.mac_stats.rx_frames_1024_1522: 1162954
dev.em.0.mac_stats.good_octets_recvd: 1925347696
dev.em.0.mac_stats.good_octets_txd: 265656113
dev.em.0.mac_stats.total_pkts_txd: 2281444
dev.em.0.mac_stats.good_pkts_txd: 2281444
dev.em.0.mac_stats.bcast_pkts_txd: 19
dev.em.0.mac_stats.mcast_pkts_txd: 5
dev.em.0.mac_stats.tx_frames_64: 401078
dev.em.0.mac_stats.tx_frames_65_127: 1682199
dev.em.0.mac_stats.tx_frames_128_255: 59450
dev.em.0.mac_stats.tx_frames_256_511: 57767
dev.em.0.mac_stats.tx_frames_512_1023: 37172
dev.em.0.mac_stats.tx_frames_1024_1522: 43778
dev.em.0.mac_stats.tso_txd: 0
dev.em.0.mac_stats.tso_ctx_fail: 0
dev.em.0.interrupts.asserts: 5
dev.em.0.interrupts.rx_pkt_timer: 0
dev.em.0.interrupts.rx_abs_timer: 0
dev.em.0.interrupts.tx_pkt_timer: 0
dev.em.0.interrupts.tx_abs_timer: 0
dev.em.0.interrupts.tx_queue_empty: 0
dev.em.0.interrupts.tx_queue_min_thresh: 0
dev.em.0.interrupts.rx_desc_min_thresh: 0
dev.em.0.interrupts.rx_overrun: 0
dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.1.%driver: em
dev.em.1.%location: slot=0 function=0
dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.1.%parent: pci6
dev.em.1.nvm: -1
dev.em.1.debug: -1
dev.em.1.fc: 3
dev.em.1.rx_int_delay: 0
dev.em.1.tx_int_delay: 66
dev.em.1.rx_abs_int_delay: 66
dev.em.1.tx_abs_int_delay: 66
dev.em.1.itr: 488
dev.em.1.rx_processing_limit: 100
dev.em.1.eee_control: 1
dev.em.1.link_irq: 13
dev.em.1.mbuf_alloc_fail: 0
dev.em.1.cluster_alloc_fail: 0
dev.em.1.dropped: 0
dev.em.1.tx_dma_fail: 0
dev.em.1.rx_overruns: 0
dev.em.1.watchdog_timeouts: 0
dev.em.1.device_control: 1477444168
dev.em.1.rx_control: 67141658
dev.em.1.fc_high_water: 18432
dev.em.1.fc_low_water: 16932
dev.em.1.queue0.txd_head: 829
dev.em.1.queue0.txd_tail: 829
dev.em.1.queue0.tx_irq: 1680542
dev.em.1.queue0.no_desc_avail: 0
dev.em.1.queue0.rxd_head: 18
dev.em.1.queue0.rxd_tail: 17
dev.em.1.queue0.rx_irq: 1377586
dev.em.1.mac_stats.excess_coll: 0
dev.em.1.mac_stats.single_coll: 0
dev.em.1.mac_stats.multiple_coll: 0
dev.em.1.mac_stats.late_coll: 0
dev.em.1.mac_stats.collision_count: 0
dev.em.1.mac_stats.symbol_errors: 0
dev.em.1.mac_stats.sequence_errors: 0
dev.em.1.mac_stats.defer_count: 0
dev.em.1.mac_stats.missed_packets: 0
dev.em.1.mac_stats.recv_no_buff: 0
dev.em.1.mac_stats.recv_undersize: 0
dev.em.1.mac_stats.recv_fragmented: 0
dev.em.1.mac_stats.recv_oversize: 0
dev.em.1.mac_stats.recv_jabber: 0
dev.em.1.mac_stats.recv_errs: 0
dev.em.1.mac_stats.crc_errs: 0
dev.em.1.mac_stats.alignment_errs: 0
dev.em.1.mac_stats.coll_ext_errs: 0
dev.em.1.mac_stats.xon_recvd: 0
dev.em.1.mac_stats.xon_txd: 0
dev.em.1.mac_stats.xoff_recvd: 0
dev.em.1.mac_stats.xoff_txd: 0
dev.em.1.mac_stats.total_pkts_recvd: 6054930
dev.em.1.mac_stats.good_pkts_recvd: 6054930
dev.em.1.mac_stats.bcast_pkts_recvd: 814
dev.em.1.mac_stats.mcast_pkts_recvd: 18
dev.em.1.mac_stats.rx_frames_64: 3394973
dev.em.1.mac_stats.rx_frames_65_127: 1581197
dev.em.1.mac_stats.rx_frames_128_255: 145932
dev.em.1.mac_stats.rx_frames_256_511: 68688
dev.em.1.mac_stats.rx_frames_512_1023: 57308
dev.em.1.mac_stats.rx_frames_1024_1522: 806832
dev.em.1.mac_stats.good_octets_recvd: 1643667828
dev.em.1.mac_stats.good_octets_txd: 10924986586
dev.em.1.mac_stats.total_pkts_txd: 8607743
dev.em.1.mac_stats.good_pkts_txd: 8607743
dev.em.1.mac_stats.bcast_pkts_txd: 16764
dev.em.1.mac_stats.mcast_pkts_txd: 8128
dev.em.1.mac_stats.tx_frames_64: 435053
dev.em.1.mac_stats.tx_frames_65_127: 621579
dev.em.1.mac_stats.tx_frames_128_255: 326492
dev.em.1.mac_stats.tx_frames_256_511: 104439
dev.em.1.mac_stats.tx_frames_512_1023: 44603
dev.em.1.mac_stats.tx_frames_1024_1522: 7075577
dev.em.1.mac_stats.tso_txd: 0
dev.em.1.mac_stats.tso_ctx_fail: 0
dev.em.1.interrupts.asserts: 7
dev.em.1.interrupts.rx_pkt_timer: 0
dev.em.1.interrupts.rx_abs_timer: 0
dev.em.1.interrupts.tx_pkt_timer: 0
dev.em.1.interrupts.tx_abs_timer: 0
dev.em.1.interrupts.tx_queue_empty: 0
dev.em.1.interrupts.tx_queue_min_thresh: 0
dev.em.1.interrupts.rx_desc_min_thresh: 0
dev.em.1.interrupts.rx_overrun: 0
dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.2.%driver: em
dev.em.2.%location: slot=0 function=0
dev.em.2.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.2.%parent: pci10
dev.em.2.nvm: -1
dev.em.2.debug: -1
dev.em.2.fc: 3
dev.em.2.rx_int_delay: 0
dev.em.2.tx_int_delay: 66
dev.em.2.rx_abs_int_delay: 66
dev.em.2.tx_abs_int_delay: 66
dev.em.2.itr: 488
dev.em.2.rx_processing_limit: 100
dev.em.2.eee_control: 1
dev.em.2.link_irq: 57
dev.em.2.mbuf_alloc_fail: 0
dev.em.2.cluster_alloc_fail: 0
dev.em.2.dropped: 0
dev.em.2.tx_dma_fail: 0
dev.em.2.rx_overruns: 0
dev.em.2.watchdog_timeouts: 0
dev.em.2.device_control: 1074790984
dev.em.2.rx_control: 67141658
dev.em.2.fc_high_water: 18432
dev.em.2.fc_low_water: 16932
dev.em.2.queue0.txd_head: 475
dev.em.2.queue0.txd_tail: 475
dev.em.2.queue0.tx_irq: 1314386
dev.em.2.queue0.no_desc_avail: 4
dev.em.2.queue0.rxd_head: 565
dev.em.2.queue0.rxd_tail: 564
dev.em.2.queue0.rx_irq: 1025355
dev.em.2.mac_stats.excess_coll: 0
dev.em.2.mac_stats.single_coll: 0
dev.em.2.mac_stats.multiple_coll: 0
dev.em.2.mac_stats.late_coll: 0
dev.em.2.mac_stats.collision_count: 0
dev.em.2.mac_stats.symbol_errors: 0
dev.em.2.mac_stats.sequence_errors: 0
dev.em.2.mac_stats.defer_count: 0
dev.em.2.mac_stats.missed_packets: 0
dev.em.2.mac_stats.recv_no_buff: 0
dev.em.2.mac_stats.recv_undersize: 0
dev.em.2.mac_stats.recv_fragmented: 0
dev.em.2.mac_stats.recv_oversize: 0
dev.em.2.mac_stats.recv_jabber: 0
dev.em.2.mac_stats.recv_errs: 0
dev.em.2.mac_stats.crc_errs: 0
dev.em.2.mac_stats.alignment_errs: 0
dev.em.2.mac_stats.coll_ext_errs: 0
dev.em.2.mac_stats.xon_recvd: 0
dev.em.2.mac_stats.xon_txd: 67
dev.em.2.mac_stats.xoff_recvd: 0
dev.em.2.mac_stats.xoff_txd: 67
dev.em.2.mac_stats.total_pkts_recvd: 7579284
dev.em.2.mac_stats.good_pkts_recvd: 7579284
dev.em.2.mac_stats.bcast_pkts_recvd: 4056
dev.em.2.mac_stats.mcast_pkts_recvd: 1894
dev.em.2.mac_stats.rx_frames_64: 732927
dev.em.2.mac_stats.rx_frames_65_127: 127308
dev.em.2.mac_stats.rx_frames_128_255: 236522
dev.em.2.mac_stats.rx_frames_256_511: 32858
dev.em.2.mac_stats.rx_frames_512_1023: 70604
dev.em.2.mac_stats.rx_frames_1024_1522: 6379065
dev.em.2.mac_stats.good_octets_recvd: 9847640417
dev.em.2.mac_stats.good_octets_txd: 2161810275
dev.em.2.mac_stats.total_pkts_txd: 5162048
dev.em.2.mac_stats.good_pkts_txd: 5161914
dev.em.2.mac_stats.bcast_pkts_txd: 5818
dev.em.2.mac_stats.mcast_pkts_txd: 3845
dev.em.2.mac_stats.tx_frames_64: 3311268
dev.em.2.mac_stats.tx_frames_65_127: 402284
dev.em.2.mac_stats.tx_frames_128_255: 129308
dev.em.2.mac_stats.tx_frames_256_511: 25539
dev.em.2.mac_stats.tx_frames_512_1023: 92406
dev.em.2.mac_stats.tx_frames_1024_1522: 1201109
dev.em.2.mac_stats.tso_txd: 0
dev.em.2.mac_stats.tso_ctx_fail: 0
dev.em.2.interrupts.asserts: 36
dev.em.2.interrupts.rx_pkt_timer: 0
dev.em.2.interrupts.rx_abs_timer: 0
dev.em.2.interrupts.tx_pkt_timer: 0
dev.em.2.interrupts.tx_abs_timer: 0
dev.em.2.interrupts.tx_queue_empty: 0
dev.em.2.interrupts.tx_queue_min_thresh: 0
dev.em.2.interrupts.rx_desc_min_thresh: 0
dev.em.2.interrupts.rx_overrun: 0
dev.em.3.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.3.%driver: em
dev.em.3.%location: slot=0 function=0
dev.em.3.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.3.%parent: pci11
dev.em.3.nvm: -1
dev.em.3.debug: -1
dev.em.3.fc: 3
dev.em.3.rx_int_delay: 0
dev.em.3.tx_int_delay: 66
dev.em.3.rx_abs_int_delay: 66
dev.em.3.tx_abs_int_delay: 66
dev.em.3.itr: 488
dev.em.3.rx_processing_limit: 100
dev.em.3.eee_control: 1
dev.em.3.link_irq: 13
dev.em.3.mbuf_alloc_fail: 0
dev.em.3.cluster_alloc_fail: 0
dev.em.3.dropped: 0
dev.em.3.tx_dma_fail: 0
dev.em.3.rx_overruns: 0
dev.em.3.watchdog_timeouts: 0
dev.em.3.device_control: 1074790984
dev.em.3.rx_control: 67141658
dev.em.3.fc_high_water: 18432
dev.em.3.fc_low_water: 16932
dev.em.3.queue0.txd_head: 386
dev.em.3.queue0.txd_tail: 386
dev.em.3.queue0.tx_irq: 276
dev.em.3.queue0.no_desc_avail: 0
dev.em.3.queue0.rxd_head: 218
dev.em.3.queue0.rxd_tail: 217
dev.em.3.queue0.rx_irq: 978
dev.em.3.mac_stats.excess_coll: 0
dev.em.3.mac_stats.single_coll: 0
dev.em.3.mac_stats.multiple_coll: 0
dev.em.3.mac_stats.late_coll: 0
dev.em.3.mac_stats.collision_count: 0
dev.em.3.mac_stats.symbol_errors: 0
dev.em.3.mac_stats.sequence_errors: 0
dev.em.3.mac_stats.defer_count: 0
dev.em.3.mac_stats.missed_packets: 0
dev.em.3.mac_stats.recv_no_buff: 0
dev.em.3.mac_stats.recv_undersize: 0
dev.em.3.mac_stats.recv_fragmented: 0
dev.em.3.mac_stats.recv_oversize: 0
dev.em.3.mac_stats.recv_jabber: 0
dev.em.3.mac_stats.recv_errs: 0
dev.em.3.mac_stats.crc_errs: 0
dev.em.3.mac_stats.alignment_errs: 0
dev.em.3.mac_stats.coll_ext_errs: 0
dev.em.3.mac_stats.xon_recvd: 0
dev.em.3.mac_stats.xon_txd: 0
dev.em.3.mac_stats.xoff_recvd: 0
dev.em.3.mac_stats.xoff_txd: 0
dev.em.3.mac_stats.total_pkts_recvd: 979
dev.em.3.mac_stats.good_pkts_recvd: 979
dev.em.3.mac_stats.bcast_pkts_recvd: 616
dev.em.3.mac_stats.mcast_pkts_recvd: 158
dev.em.3.mac_stats.rx_frames_64: 63
dev.em.3.mac_stats.rx_frames_65_127: 163
dev.em.3.mac_stats.rx_frames_128_255: 112
dev.em.3.mac_stats.rx_frames_256_511: 641
dev.em.3.mac_stats.rx_frames_512_1023: 0
dev.em.3.mac_stats.rx_frames_1024_1522: 0
dev.em.3.mac_stats.good_octets_recvd: 255346
dev.em.3.mac_stats.good_octets_txd: 55615
dev.em.3.mac_stats.total_pkts_txd: 303
dev.em.3.mac_stats.good_pkts_txd: 303
dev.em.3.mac_stats.bcast_pkts_txd: 79
dev.em.3.mac_stats.mcast_pkts_txd: 32
dev.em.3.mac_stats.tx_frames_64: 32
dev.em.3.mac_stats.tx_frames_65_127: 229
dev.em.3.mac_stats.tx_frames_128_255: 9
dev.em.3.mac_stats.tx_frames_256_511: 14
dev.em.3.mac_stats.tx_frames_512_1023: 1
dev.em.3.mac_stats.tx_frames_1024_1522: 18
dev.em.3.mac_stats.tso_txd: 0
dev.em.3.mac_stats.tso_ctx_fail: 0
dev.em.3.interrupts.asserts: 9
dev.em.3.interrupts.rx_pkt_timer: 0
dev.em.3.interrupts.rx_abs_timer: 0
dev.em.3.interrupts.tx_pkt_timer: 0
dev.em.3.interrupts.tx_abs_timer: 0
dev.em.3.interrupts.tx_queue_empty: 0
dev.em.3.interrupts.tx_queue_min_thresh: 0
dev.em.3.interrupts.rx_desc_min_thresh: 0
dev.em.3.interrupts.rx_overrun: 0
dev.em.4.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.4.%driver: em
dev.em.4.%location: slot=0 function=0
dev.em.4.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.4.%parent: pci15
dev.em.4.nvm: -1
dev.em.4.debug: -1
dev.em.4.fc: 3
dev.em.4.rx_int_delay: 0
dev.em.4.tx_int_delay: 66
dev.em.4.rx_abs_int_delay: 66
dev.em.4.tx_abs_int_delay: 66
dev.em.4.itr: 488
dev.em.4.rx_processing_limit: 100
dev.em.4.eee_control: 1
dev.em.4.link_irq: 0
dev.em.4.mbuf_alloc_fail: 0
dev.em.4.cluster_alloc_fail: 0
dev.em.4.dropped: 0
dev.em.4.tx_dma_fail: 0
dev.em.4.rx_overruns: 0
dev.em.4.watchdog_timeouts: 0
dev.em.4.device_control: 1074790984
dev.em.4.rx_control: 67141658
dev.em.4.fc_high_water: 18432
dev.em.4.fc_low_water: 16932
dev.em.4.queue0.txd_head: 0
dev.em.4.queue0.txd_tail: 0
dev.em.4.queue0.tx_irq: 0
dev.em.4.queue0.no_desc_avail: 0
dev.em.4.queue0.rxd_head: 0
dev.em.4.queue0.rxd_tail: 1023
dev.em.4.queue0.rx_irq: 0
dev.em.4.mac_stats.excess_coll: 0
dev.em.4.mac_stats.single_coll: 0
dev.em.4.mac_stats.multiple_coll: 0
dev.em.4.mac_stats.late_coll: 0
dev.em.4.mac_stats.collision_count: 0
dev.em.4.mac_stats.symbol_errors: 0
dev.em.4.mac_stats.sequence_errors: 0
dev.em.4.mac_stats.defer_count: 0
dev.em.4.mac_stats.missed_packets: 0
dev.em.4.mac_stats.recv_no_buff: 0
dev.em.4.mac_stats.recv_undersize: 0
dev.em.4.mac_stats.recv_fragmented: 0
dev.em.4.mac_stats.recv_oversize: 0
dev.em.4.mac_stats.recv_jabber: 0
dev.em.4.mac_stats.recv_errs: 0
dev.em.4.mac_stats.crc_errs: 0
dev.em.4.mac_stats.alignment_errs: 0
dev.em.4.mac_stats.coll_ext_errs: 0
dev.em.4.mac_stats.xon_recvd: 0
dev.em.4.mac_stats.xon_txd: 0
dev.em.4.mac_stats.xoff_recvd: 0
dev.em.4.mac_stats.xoff_txd: 0
dev.em.4.mac_stats.total_pkts_recvd: 0
dev.em.4.mac_stats.good_pkts_recvd: 0
dev.em.4.mac_stats.bcast_pkts_recvd: 0
dev.em.4.mac_stats.mcast_pkts_recvd: 0
dev.em.4.mac_stats.rx_frames_64: 0
dev.em.4.mac_stats.rx_frames_65_127: 0
dev.em.4.mac_stats.rx_frames_128_255: 0
dev.em.4.mac_stats.rx_frames_256_511: 0
dev.em.4.mac_stats.rx_frames_512_1023: 0
dev.em.4.mac_stats.rx_frames_1024_1522: 0
dev.em.4.mac_stats.good_octets_recvd: 0
dev.em.4.mac_stats.good_octets_txd: 0
dev.em.4.mac_stats.total_pkts_txd: 0
dev.em.4.mac_stats.good_pkts_txd: 0
dev.em.4.mac_stats.bcast_pkts_txd: 0
dev.em.4.mac_stats.mcast_pkts_txd: 0
dev.em.4.mac_stats.tx_frames_64: 0
dev.em.4.mac_stats.tx_frames_65_127: 0
dev.em.4.mac_stats.tx_frames_128_255: 0
dev.em.4.mac_stats.tx_frames_256_511: 0
dev.em.4.mac_stats.tx_frames_512_1023: 0
dev.em.4.mac_stats.tx_frames_1024_1522: 0
dev.em.4.mac_stats.tso_txd: 0
dev.em.4.mac_stats.tso_ctx_fail: 0
dev.em.4.interrupts.asserts: 0
dev.em.4.interrupts.rx_pkt_timer: 0
dev.em.4.interrupts.rx_abs_timer: 0
dev.em.4.interrupts.tx_pkt_timer: 0
dev.em.4.interrupts.tx_abs_timer: 0
dev.em.4.interrupts.tx_queue_empty: 0
dev.em.4.interrupts.tx_queue_min_thresh: 0
dev.em.4.interrupts.rx_desc_min_thresh: 0
dev.em.4.interrupts.rx_overrun: 0
dev.em.5.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.5.%driver: em
dev.em.5.%location: slot=0 function=0
dev.em.5.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.5.%parent: pci16
dev.em.5.nvm: -1
dev.em.5.debug: -1
dev.em.5.fc: 3
dev.em.5.rx_int_delay: 0
dev.em.5.tx_int_delay: 66
dev.em.5.rx_abs_int_delay: 66
dev.em.5.tx_abs_int_delay: 66
dev.em.5.itr: 488
dev.em.5.rx_processing_limit: 100
dev.em.5.eee_control: 1
dev.em.5.link_irq: 14
dev.em.5.mbuf_alloc_fail: 0
dev.em.5.cluster_alloc_fail: 0
dev.em.5.dropped: 0
dev.em.5.tx_dma_fail: 0
dev.em.5.rx_overruns: 0
dev.em.5.watchdog_timeouts: 0
dev.em.5.device_control: 1477444168
dev.em.5.rx_control: 67141658
dev.em.5.fc_high_water: 18432
dev.em.5.fc_low_water: 16932
dev.em.5.queue0.txd_head: 1015
dev.em.5.queue0.txd_tail: 1015
dev.em.5.queue0.tx_irq: 31244
dev.em.5.queue0.no_desc_avail: 0
dev.em.5.queue0.rxd_head: 771
dev.em.5.queue0.rxd_tail: 770
dev.em.5.queue0.rx_irq: 29384
dev.em.5.mac_stats.excess_coll: 0
dev.em.5.mac_stats.single_coll: 0
dev.em.5.mac_stats.multiple_coll: 0
dev.em.5.mac_stats.late_coll: 0
dev.em.5.mac_stats.collision_count: 0
dev.em.5.mac_stats.symbol_errors: 0
dev.em.5.mac_stats.sequence_errors: 0
dev.em.5.mac_stats.defer_count: 0
dev.em.5.mac_stats.missed_packets: 0
dev.em.5.mac_stats.recv_no_buff: 0
dev.em.5.mac_stats.recv_undersize: 0
dev.em.5.mac_stats.recv_fragmented: 0
dev.em.5.mac_stats.recv_oversize: 0
dev.em.5.mac_stats.recv_jabber: 0
dev.em.5.mac_stats.recv_errs: 0
dev.em.5.mac_stats.crc_errs: 0
dev.em.5.mac_stats.alignment_errs: 0
dev.em.5.mac_stats.coll_ext_errs: 0
dev.em.5.mac_stats.xon_recvd: 0
dev.em.5.mac_stats.xon_txd: 0
dev.em.5.mac_stats.xoff_recvd: 0
dev.em.5.mac_stats.xoff_txd: 0
dev.em.5.mac_stats.total_pkts_recvd: 29443
dev.em.5.mac_stats.good_pkts_recvd: 29443
dev.em.5.mac_stats.bcast_pkts_recvd: 10091
dev.em.5.mac_stats.mcast_pkts_recvd: 6055
dev.em.5.mac_stats.rx_frames_64: 10733
dev.em.5.mac_stats.rx_frames_65_127: 10674
dev.em.5.mac_stats.rx_frames_128_255: 408
dev.em.5.mac_stats.rx_frames_256_511: 6155
dev.em.5.mac_stats.rx_frames_512_1023: 409
dev.em.5.mac_stats.rx_frames_1024_1522: 1064
dev.em.5.mac_stats.good_octets_recvd: 5941407
dev.em.5.mac_stats.good_octets_txd: 5567151
dev.em.5.mac_stats.total_pkts_txd: 31914
dev.em.5.mac_stats.good_pkts_txd: 31914
dev.em.5.mac_stats.bcast_pkts_txd: 7475
dev.em.5.mac_stats.mcast_pkts_txd: 2087
dev.em.5.mac_stats.tx_frames_64: 14358
dev.em.5.mac_stats.tx_frames_65_127: 13797
dev.em.5.mac_stats.tx_frames_128_255: 790
dev.em.5.mac_stats.tx_frames_256_511: 681
dev.em.5.mac_stats.tx_frames_512_1023: 274
dev.em.5.mac_stats.tx_frames_1024_1522: 2014
dev.em.5.mac_stats.tso_txd: 0
dev.em.5.mac_stats.tso_ctx_fail: 0
dev.em.5.interrupts.asserts: 9
dev.em.5.interrupts.rx_pkt_timer: 0
dev.em.5.interrupts.rx_abs_timer: 0
dev.em.5.interrupts.tx_pkt_timer: 0
dev.em.5.interrupts.tx_abs_timer: 0
dev.em.5.interrupts.tx_queue_empty: 0
dev.em.5.interrupts.tx_queue_min_thresh: 0
dev.em.5.interrupts.rx_desc_min_thresh: 0
dev.em.5.interrupts.rx_overrun: 0
dev.em.6.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.6.%driver: em
dev.em.6.%location: slot=0 function=0
dev.em.6.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.6.%parent: pci17
dev.em.6.nvm: -1
dev.em.6.debug: -1
dev.em.6.fc: 3
dev.em.6.rx_int_delay: 0
dev.em.6.tx_int_delay: 66
dev.em.6.rx_abs_int_delay: 66
dev.em.6.tx_abs_int_delay: 66
dev.em.6.itr: 488
dev.em.6.rx_processing_limit: 100
dev.em.6.eee_control: 1
dev.em.6.link_irq: 17
dev.em.6.mbuf_alloc_fail: 0
dev.em.6.cluster_alloc_fail: 0
dev.em.6.dropped: 0
dev.em.6.tx_dma_fail: 0
dev.em.6.rx_overruns: 0
dev.em.6.watchdog_timeouts: 0
dev.em.6.device_control: 1477444168
dev.em.6.rx_control: 67141658
dev.em.6.fc_high_water: 18432
dev.em.6.fc_low_water: 16932
dev.em.6.queue0.txd_head: 817
dev.em.6.queue0.txd_tail: 817
dev.em.6.queue0.tx_irq: 81780
dev.em.6.queue0.no_desc_avail: 0
dev.em.6.queue0.rxd_head: 348
dev.em.6.queue0.rxd_tail: 347
dev.em.6.queue0.rx_irq: 36669
dev.em.6.mac_stats.excess_coll: 0
dev.em.6.mac_stats.single_coll: 0
dev.em.6.mac_stats.multiple_coll: 0
dev.em.6.mac_stats.late_coll: 0
dev.em.6.mac_stats.collision_count: 0
dev.em.6.mac_stats.symbol_errors: 0
dev.em.6.mac_stats.sequence_errors: 0
dev.em.6.mac_stats.defer_count: 0
dev.em.6.mac_stats.missed_packets: 0
dev.em.6.mac_stats.recv_no_buff: 0
dev.em.6.mac_stats.recv_undersize: 0
dev.em.6.mac_stats.recv_fragmented: 0
dev.em.6.mac_stats.recv_oversize: 0
dev.em.6.mac_stats.recv_jabber: 0
dev.em.6.mac_stats.recv_errs: 0
dev.em.6.mac_stats.crc_errs: 0
dev.em.6.mac_stats.alignment_errs: 0
dev.em.6.mac_stats.coll_ext_errs: 0
dev.em.6.mac_stats.xon_recvd: 0
dev.em.6.mac_stats.xon_txd: 0
dev.em.6.mac_stats.xoff_recvd: 0
dev.em.6.mac_stats.xoff_txd: 0
dev.em.6.mac_stats.total_pkts_recvd: 40284
dev.em.6.mac_stats.good_pkts_recvd: 40284
dev.em.6.mac_stats.bcast_pkts_recvd: 420
dev.em.6.mac_stats.mcast_pkts_recvd: 376
dev.em.6.mac_stats.rx_frames_64: 28074
dev.em.6.mac_stats.rx_frames_65_127: 8076
dev.em.6.mac_stats.rx_frames_128_255: 927
dev.em.6.mac_stats.rx_frames_256_511: 800
dev.em.6.mac_stats.rx_frames_512_1023: 843
dev.em.6.mac_stats.rx_frames_1024_1522: 1564
dev.em.6.mac_stats.good_octets_recvd: 5925684
dev.em.6.mac_stats.good_octets_txd: 87073020
dev.em.6.mac_stats.total_pkts_txd: 88589
dev.em.6.mac_stats.good_pkts_txd: 88589
dev.em.6.mac_stats.bcast_pkts_txd: 17191
dev.em.6.mac_stats.mcast_pkts_txd: 7828
dev.em.6.mac_stats.tx_frames_64: 15737
dev.em.6.mac_stats.tx_frames_65_127: 8968
dev.em.6.mac_stats.tx_frames_128_255: 2483
dev.em.6.mac_stats.tx_frames_256_511: 6989
dev.em.6.mac_stats.tx_frames_512_1023: 704
dev.em.6.mac_stats.tx_frames_1024_1522: 53708
dev.em.6.mac_stats.tso_txd: 0
dev.em.6.mac_stats.tso_ctx_fail: 0
dev.em.6.interrupts.asserts: 11
dev.em.6.interrupts.rx_pkt_timer: 0
dev.em.6.interrupts.rx_abs_timer: 0
dev.em.6.interrupts.tx_pkt_timer: 0
dev.em.6.interrupts.tx_abs_timer: 0
dev.em.6.interrupts.tx_queue_empty: 0
dev.em.6.interrupts.tx_queue_min_thresh: 0
dev.em.6.interrupts.rx_desc_min_thresh: 0
dev.em.6.interrupts.rx_overrun: 0
dev.em.7.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.7.%driver: em
dev.em.7.%location: slot=0 function=0
dev.em.7.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.7.%parent: pci18
dev.em.7.nvm: -1
dev.em.7.debug: -1
dev.em.7.fc: 3
dev.em.7.rx_int_delay: 0
dev.em.7.tx_int_delay: 66
dev.em.7.rx_abs_int_delay: 66
dev.em.7.tx_abs_int_delay: 66
dev.em.7.itr: 488
dev.em.7.rx_processing_limit: 100
dev.em.7.eee_control: 1
dev.em.7.link_irq: 0
dev.em.7.mbuf_alloc_fail: 0
dev.em.7.cluster_alloc_fail: 0
dev.em.7.dropped: 0
dev.em.7.tx_dma_fail: 0
dev.em.7.rx_overruns: 0
dev.em.7.watchdog_timeouts: 0
dev.em.7.device_control: 1074790984
dev.em.7.rx_control: 67141658
dev.em.7.fc_high_water: 18432
dev.em.7.fc_low_water: 16932
dev.em.7.queue0.txd_head: 0
dev.em.7.queue0.txd_tail: 0
dev.em.7.queue0.tx_irq: 0
dev.em.7.queue0.no_desc_avail: 0
dev.em.7.queue0.rxd_head: 0
dev.em.7.queue0.rxd_tail: 1023
dev.em.7.queue0.rx_irq: 0
dev.em.7.mac_stats.excess_coll: 0
dev.em.7.mac_stats.single_coll: 0
dev.em.7.mac_stats.multiple_coll: 0
dev.em.7.mac_stats.late_coll: 0
dev.em.7.mac_stats.collision_count: 0
dev.em.7.mac_stats.symbol_errors: 0
dev.em.7.mac_stats.sequence_errors: 0
dev.em.7.mac_stats.defer_count: 0
dev.em.7.mac_stats.missed_packets: 0
dev.em.7.mac_stats.recv_no_buff: 0
dev.em.7.mac_stats.recv_undersize: 0
dev.em.7.mac_stats.recv_fragmented: 0
dev.em.7.mac_stats.recv_oversize: 0
dev.em.7.mac_stats.recv_jabber: 0
dev.em.7.mac_stats.recv_errs: 0
dev.em.7.mac_stats.crc_errs: 0
dev.em.7.mac_stats.alignment_errs: 0
dev.em.7.mac_stats.coll_ext_errs: 0
dev.em.7.mac_stats.xon_recvd: 0
dev.em.7.mac_stats.xon_txd: 0
dev.em.7.mac_stats.xoff_recvd: 0
dev.em.7.mac_stats.xoff_txd: 0
dev.em.7.mac_stats.total_pkts_recvd: 0
dev.em.7.mac_stats.good_pkts_recvd: 0
dev.em.7.mac_stats.bcast_pkts_recvd: 0
dev.em.7.mac_stats.mcast_pkts_recvd: 0
dev.em.7.mac_stats.rx_frames_64: 0
dev.em.7.mac_stats.rx_frames_65_127: 0
dev.em.7.mac_stats.rx_frames_128_255: 0
dev.em.7.mac_stats.rx_frames_256_511: 0
dev.em.7.mac_stats.rx_frames_512_1023: 0
dev.em.7.mac_stats.rx_frames_1024_1522: 0
dev.em.7.mac_stats.good_octets_recvd: 0
dev.em.7.mac_stats.good_octets_txd: 0
dev.em.7.mac_stats.total_pkts_txd: 0
dev.em.7.mac_stats.good_pkts_txd: 0
dev.em.7.mac_stats.bcast_pkts_txd: 0
dev.em.7.mac_stats.mcast_pkts_txd: 0
dev.em.7.mac_stats.tx_frames_64: 0
dev.em.7.mac_stats.tx_frames_65_127: 0
dev.em.7.mac_stats.tx_frames_128_255: 0
dev.em.7.mac_stats.tx_frames_256_511: 0
dev.em.7.mac_stats.tx_frames_512_1023: 0
dev.em.7.mac_stats.tx_frames_1024_1522: 0
dev.em.7.mac_stats.tso_txd: 0
dev.em.7.mac_stats.tso_ctx_fail: 0
dev.em.7.interrupts.asserts: 0
dev.em.7.interrupts.rx_pkt_timer: 0
dev.em.7.interrupts.rx_abs_timer: 0
dev.em.7.interrupts.tx_pkt_timer: 0
dev.em.7.interrupts.tx_abs_timer: 0
dev.em.7.interrupts.tx_queue_empty: 0
dev.em.7.interrupts.tx_queue_min_thresh: 0
dev.em.7.interrupts.rx_desc_min_thresh: 0
dev.em.7.interrupts.rx_overrun: 0

I'm not sure what to watch for.
FYI, this was not taken while the problem was occurring.

stephenw10

Hmm, very common NIC so should be reported if it was a driver issue.
You have a lot of CRC errors on em0. Which interface is giving trouble?
Try to get a set of data when it's stopped responding.

Steve

ESPNSTI

The nic may be common, but perhaps not a lot of people use pfsense the way I do?
Meaning, directly connecting PCs to the pfSense box rather than having a switch in the middle, in combination with completely unplugging the PC rather than leaving it powered off, but not unplugged.

My main PC is connected to em2, but I have reproduced the problem with it connected to other interfaces and with other PCs on other interfaces.

My WAN interface is em0, which is connected using WiMAX, don't know if that explains the number of CRC errors or not.

I will try to get dev.em data the next time the problem happens.

Edit:

I tried unplugging and re-plugging the connection, that does not seem to solve the problem, but ifconfig em2 down followed by ifconfig em2 up does.

Here is the dev.em data while the problem happens:

$ sysctl dev.em
dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.0.%driver: em
dev.em.0.%location: slot=0 function=0
dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.0.%parent: pci5
dev.em.0.nvm: -1
dev.em.0.debug: -1
dev.em.0.fc: 3
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.itr: 488
dev.em.0.rx_processing_limit: 100
dev.em.0.eee_control: 1
dev.em.0.link_irq: 3
dev.em.0.mbuf_alloc_fail: 0
dev.em.0.cluster_alloc_fail: 0
dev.em.0.dropped: 0
dev.em.0.tx_dma_fail: 0
dev.em.0.rx_overruns: 0
dev.em.0.watchdog_timeouts: 0
dev.em.0.device_control: 1074790984
dev.em.0.rx_control: 67141658
dev.em.0.fc_high_water: 18432
dev.em.0.fc_low_water: 16932
dev.em.0.queue0.txd_head: 955
dev.em.0.queue0.txd_tail: 955
dev.em.0.queue0.tx_irq: 1353023
dev.em.0.queue0.no_desc_avail: 0
dev.em.0.queue0.rxd_head: 646
dev.em.0.queue0.rxd_tail: 645
dev.em.0.queue0.rx_irq: 2194821
dev.em.0.mac_stats.excess_coll: 0
dev.em.0.mac_stats.single_coll: 0
dev.em.0.mac_stats.multiple_coll: 0
dev.em.0.mac_stats.late_coll: 0
dev.em.0.mac_stats.collision_count: 0
dev.em.0.mac_stats.symbol_errors: 0
dev.em.0.mac_stats.sequence_errors: 0
dev.em.0.mac_stats.defer_count: 0
dev.em.0.mac_stats.missed_packets: 0
dev.em.0.mac_stats.recv_no_buff: 0
dev.em.0.mac_stats.recv_undersize: 0
dev.em.0.mac_stats.recv_fragmented: 0
dev.em.0.mac_stats.recv_oversize: 14
dev.em.0.mac_stats.recv_jabber: 0
dev.em.0.mac_stats.recv_errs: 1
dev.em.0.mac_stats.crc_errs: 1858
dev.em.0.mac_stats.alignment_errs: 0
dev.em.0.mac_stats.coll_ext_errs: 0
dev.em.0.mac_stats.xon_recvd: 0
dev.em.0.mac_stats.xon_txd: 0
dev.em.0.mac_stats.xoff_recvd: 0
dev.em.0.mac_stats.xoff_txd: 0
dev.em.0.mac_stats.total_pkts_recvd: 2693590
dev.em.0.mac_stats.good_pkts_recvd: 2691718
dev.em.0.mac_stats.bcast_pkts_recvd: 114676
dev.em.0.mac_stats.mcast_pkts_recvd: 169968
dev.em.0.mac_stats.rx_frames_64: 230759
dev.em.0.mac_stats.rx_frames_65_127: 881015
dev.em.0.mac_stats.rx_frames_128_255: 240095
dev.em.0.mac_stats.rx_frames_256_511: 127210
dev.em.0.mac_stats.rx_frames_512_1023: 43897
dev.em.0.mac_stats.rx_frames_1024_1522: 1168742
dev.em.0.mac_stats.good_octets_recvd: 1944245208
dev.em.0.mac_stats.good_octets_txd: 267430581
dev.em.0.mac_stats.total_pkts_txd: 2301786
dev.em.0.mac_stats.good_pkts_txd: 2301786
dev.em.0.mac_stats.bcast_pkts_txd: 21
dev.em.0.mac_stats.mcast_pkts_txd: 5
dev.em.0.mac_stats.tx_frames_64: 401303
dev.em.0.mac_stats.tx_frames_65_127: 1701968
dev.em.0.mac_stats.tx_frames_128_255: 59555
dev.em.0.mac_stats.tx_frames_256_511: 57933
dev.em.0.mac_stats.tx_frames_512_1023: 37200
dev.em.0.mac_stats.tx_frames_1024_1522: 43827
dev.em.0.mac_stats.tso_txd: 0
dev.em.0.mac_stats.tso_ctx_fail: 0
dev.em.0.interrupts.asserts: 5
dev.em.0.interrupts.rx_pkt_timer: 0
dev.em.0.interrupts.rx_abs_timer: 0
dev.em.0.interrupts.tx_pkt_timer: 0
dev.em.0.interrupts.tx_abs_timer: 0
dev.em.0.interrupts.tx_queue_empty: 0
dev.em.0.interrupts.tx_queue_min_thresh: 0
dev.em.0.interrupts.rx_desc_min_thresh: 0
dev.em.0.interrupts.rx_overrun: 0
dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.1.%driver: em
dev.em.1.%location: slot=0 function=0
dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.1.%parent: pci6
dev.em.1.nvm: -1
dev.em.1.debug: -1
dev.em.1.fc: 3
dev.em.1.rx_int_delay: 0
dev.em.1.tx_int_delay: 66
dev.em.1.rx_abs_int_delay: 66
dev.em.1.tx_abs_int_delay: 66
dev.em.1.itr: 488
dev.em.1.rx_processing_limit: 100
dev.em.1.eee_control: 1
dev.em.1.link_irq: 22
dev.em.1.mbuf_alloc_fail: 0
dev.em.1.cluster_alloc_fail: 0
dev.em.1.dropped: 0
dev.em.1.tx_dma_fail: 0
dev.em.1.rx_overruns: 0
dev.em.1.watchdog_timeouts: 0
dev.em.1.device_control: 1477444168
dev.em.1.rx_control: 67141658
dev.em.1.fc_high_water: 18432
dev.em.1.fc_low_water: 16932
dev.em.1.queue0.txd_head: 112
dev.em.1.queue0.txd_tail: 112
dev.em.1.queue0.tx_irq: 1690961
dev.em.1.queue0.no_desc_avail: 0
dev.em.1.queue0.rxd_head: 37
dev.em.1.queue0.rxd_tail: 36
dev.em.1.queue0.rx_irq: 1381555
dev.em.1.mac_stats.excess_coll: 0
dev.em.1.mac_stats.single_coll: 0
dev.em.1.mac_stats.multiple_coll: 0
dev.em.1.mac_stats.late_coll: 0
dev.em.1.mac_stats.collision_count: 0
dev.em.1.mac_stats.symbol_errors: 0
dev.em.1.mac_stats.sequence_errors: 0
dev.em.1.mac_stats.defer_count: 0
dev.em.1.mac_stats.missed_packets: 0
dev.em.1.mac_stats.recv_no_buff: 0
dev.em.1.mac_stats.recv_undersize: 0
dev.em.1.mac_stats.recv_fragmented: 0
dev.em.1.mac_stats.recv_oversize: 0
dev.em.1.mac_stats.recv_jabber: 0
dev.em.1.mac_stats.recv_errs: 0
dev.em.1.mac_stats.crc_errs: 0
dev.em.1.mac_stats.alignment_errs: 0
dev.em.1.mac_stats.coll_ext_errs: 0
dev.em.1.mac_stats.xon_recvd: 0
dev.em.1.mac_stats.xon_txd: 0
dev.em.1.mac_stats.xoff_recvd: 0
dev.em.1.mac_stats.xoff_txd: 0
dev.em.1.mac_stats.total_pkts_recvd: 6059045
dev.em.1.mac_stats.good_pkts_recvd: 6059045
dev.em.1.mac_stats.bcast_pkts_recvd: 1001
dev.em.1.mac_stats.mcast_pkts_recvd: 36
dev.em.1.mac_stats.rx_frames_64: 3395197
dev.em.1.mac_stats.rx_frames_65_127: 1584918
dev.em.1.mac_stats.rx_frames_128_255: 146033
dev.em.1.mac_stats.rx_frames_256_511: 68732
dev.em.1.mac_stats.rx_frames_512_1023: 57333
dev.em.1.mac_stats.rx_frames_1024_1522: 806832
dev.em.1.mac_stats.good_octets_recvd: 1644008445
dev.em.1.mac_stats.good_octets_txd: 10934359364
dev.em.1.mac_stats.total_pkts_txd: 8618288
dev.em.1.mac_stats.good_pkts_txd: 8618288
dev.em.1.mac_stats.bcast_pkts_txd: 20285
dev.em.1.mac_stats.mcast_pkts_txd: 9084
dev.em.1.mac_stats.tx_frames_64: 438597
dev.em.1.mac_stats.tx_frames_65_127: 621818
dev.em.1.mac_stats.tx_frames_128_255: 326533
dev.em.1.mac_stats.tx_frames_256_511: 105392
dev.em.1.mac_stats.tx_frames_512_1023: 44645
dev.em.1.mac_stats.tx_frames_1024_1522: 7081303
dev.em.1.mac_stats.tso_txd: 0
dev.em.1.mac_stats.tso_ctx_fail: 0
dev.em.1.interrupts.asserts: 13
dev.em.1.interrupts.rx_pkt_timer: 0
dev.em.1.interrupts.rx_abs_timer: 0
dev.em.1.interrupts.tx_pkt_timer: 0
dev.em.1.interrupts.tx_abs_timer: 0
dev.em.1.interrupts.tx_queue_empty: 0
dev.em.1.interrupts.tx_queue_min_thresh: 0
dev.em.1.interrupts.rx_desc_min_thresh: 0
dev.em.1.interrupts.rx_overrun: 0
dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.2.%driver: em
dev.em.2.%location: slot=0 function=0
dev.em.2.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.2.%parent: pci10
dev.em.2.nvm: -1
dev.em.2.debug: -1
dev.em.2.fc: 3
dev.em.2.rx_int_delay: 0
dev.em.2.tx_int_delay: 66
dev.em.2.rx_abs_int_delay: 66
dev.em.2.tx_abs_int_delay: 66
dev.em.2.itr: 488
dev.em.2.rx_processing_limit: 100
dev.em.2.eee_control: 1
dev.em.2.link_irq: 65
dev.em.2.mbuf_alloc_fail: 0
dev.em.2.cluster_alloc_fail: 0
dev.em.2.dropped: 0
dev.em.2.tx_dma_fail: 0
dev.em.2.rx_overruns: 0
dev.em.2.watchdog_timeouts: 0
dev.em.2.device_control: 1477444168
dev.em.2.rx_control: 67141658
dev.em.2.fc_high_water: 18432
dev.em.2.fc_low_water: 16932
dev.em.2.queue0.txd_head: 475
dev.em.2.queue0.txd_tail: 475
dev.em.2.queue0.tx_irq: 1314386
dev.em.2.queue0.no_desc_avail: 4
dev.em.2.queue0.rxd_head: 737
dev.em.2.queue0.rxd_tail: 736
dev.em.2.queue0.rx_irq: 1025527
dev.em.2.mac_stats.excess_coll: 0
dev.em.2.mac_stats.single_coll: 0
dev.em.2.mac_stats.multiple_coll: 0
dev.em.2.mac_stats.late_coll: 0
dev.em.2.mac_stats.collision_count: 0
dev.em.2.mac_stats.symbol_errors: 0
dev.em.2.mac_stats.sequence_errors: 0
dev.em.2.mac_stats.defer_count: 0
dev.em.2.mac_stats.missed_packets: 0
dev.em.2.mac_stats.recv_no_buff: 0
dev.em.2.mac_stats.recv_undersize: 0
dev.em.2.mac_stats.recv_fragmented: 0
dev.em.2.mac_stats.recv_oversize: 0
dev.em.2.mac_stats.recv_jabber: 0
dev.em.2.mac_stats.recv_errs: 0
dev.em.2.mac_stats.crc_errs: 0
dev.em.2.mac_stats.alignment_errs: 0
dev.em.2.mac_stats.coll_ext_errs: 0
dev.em.2.mac_stats.xon_recvd: 0
dev.em.2.mac_stats.xon_txd: 67
dev.em.2.mac_stats.xoff_recvd: 0
dev.em.2.mac_stats.xoff_txd: 67
dev.em.2.mac_stats.total_pkts_recvd: 7579455
dev.em.2.mac_stats.good_pkts_recvd: 7579455
dev.em.2.mac_stats.bcast_pkts_recvd: 4221
dev.em.2.mac_stats.mcast_pkts_recvd: 1900
dev.em.2.mac_stats.rx_frames_64: 733094
dev.em.2.mac_stats.rx_frames_65_127: 127312
dev.em.2.mac_stats.rx_frames_128_255: 236522
dev.em.2.mac_stats.rx_frames_256_511: 32858
dev.em.2.mac_stats.rx_frames_512_1023: 70604
dev.em.2.mac_stats.rx_frames_1024_1522: 6379065
dev.em.2.mac_stats.good_octets_recvd: 9847651473
dev.em.2.mac_stats.good_octets_txd: 2161810275
dev.em.2.mac_stats.total_pkts_txd: 5162048
dev.em.2.mac_stats.good_pkts_txd: 5161914
dev.em.2.mac_stats.bcast_pkts_txd: 5818
dev.em.2.mac_stats.mcast_pkts_txd: 3845
dev.em.2.mac_stats.tx_frames_64: 3311268
dev.em.2.mac_stats.tx_frames_65_127: 402284
dev.em.2.mac_stats.tx_frames_128_255: 129308
dev.em.2.mac_stats.tx_frames_256_511: 25539
dev.em.2.mac_stats.tx_frames_512_1023: 92406
dev.em.2.mac_stats.tx_frames_1024_1522: 1201109
dev.em.2.mac_stats.tso_txd: 0
dev.em.2.mac_stats.tso_ctx_fail: 0
dev.em.2.interrupts.asserts: 41
dev.em.2.interrupts.rx_pkt_timer: 0
dev.em.2.interrupts.rx_abs_timer: 0
dev.em.2.interrupts.tx_pkt_timer: 0
dev.em.2.interrupts.tx_abs_timer: 0
dev.em.2.interrupts.tx_queue_empty: 0
dev.em.2.interrupts.tx_queue_min_thresh: 0
dev.em.2.interrupts.rx_desc_min_thresh: 0
dev.em.2.interrupts.rx_overrun: 0
dev.em.3.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.3.%driver: em
dev.em.3.%location: slot=0 function=0
dev.em.3.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.3.%parent: pci11
dev.em.3.nvm: -1
dev.em.3.debug: -1
dev.em.3.fc: 3
dev.em.3.rx_int_delay: 0
dev.em.3.tx_int_delay: 66
dev.em.3.rx_abs_int_delay: 66
dev.em.3.tx_abs_int_delay: 66
dev.em.3.itr: 488
dev.em.3.rx_processing_limit: 100
dev.em.3.eee_control: 1
dev.em.3.link_irq: 13
dev.em.3.mbuf_alloc_fail: 0
dev.em.3.cluster_alloc_fail: 0
dev.em.3.dropped: 0
dev.em.3.tx_dma_fail: 0
dev.em.3.rx_overruns: 0
dev.em.3.watchdog_timeouts: 0
dev.em.3.device_control: 1074790984
dev.em.3.rx_control: 67141658
dev.em.3.fc_high_water: 18432
dev.em.3.fc_low_water: 16932
dev.em.3.queue0.txd_head: 386
dev.em.3.queue0.txd_tail: 386
dev.em.3.queue0.tx_irq: 276
dev.em.3.queue0.no_desc_avail: 0
dev.em.3.queue0.rxd_head: 218
dev.em.3.queue0.rxd_tail: 217
dev.em.3.queue0.rx_irq: 978
dev.em.3.mac_stats.excess_coll: 0
dev.em.3.mac_stats.single_coll: 0
dev.em.3.mac_stats.multiple_coll: 0
dev.em.3.mac_stats.late_coll: 0
dev.em.3.mac_stats.collision_count: 0
dev.em.3.mac_stats.symbol_errors: 0
dev.em.3.mac_stats.sequence_errors: 0
dev.em.3.mac_stats.defer_count: 0
dev.em.3.mac_stats.missed_packets: 0
dev.em.3.mac_stats.recv_no_buff: 0
dev.em.3.mac_stats.recv_undersize: 0
dev.em.3.mac_stats.recv_fragmented: 0
dev.em.3.mac_stats.recv_oversize: 0
dev.em.3.mac_stats.recv_jabber: 0
dev.em.3.mac_stats.recv_errs: 0
dev.em.3.mac_stats.crc_errs: 0
dev.em.3.mac_stats.alignment_errs: 0
dev.em.3.mac_stats.coll_ext_errs: 0
dev.em.3.mac_stats.xon_recvd: 0
dev.em.3.mac_stats.xon_txd: 0
dev.em.3.mac_stats.xoff_recvd: 0
dev.em.3.mac_stats.xoff_txd: 0
dev.em.3.mac_stats.total_pkts_recvd: 979
dev.em.3.mac_stats.good_pkts_recvd: 979
dev.em.3.mac_stats.bcast_pkts_recvd: 616
dev.em.3.mac_stats.mcast_pkts_recvd: 158
dev.em.3.mac_stats.rx_frames_64: 63
dev.em.3.mac_stats.rx_frames_65_127: 163
dev.em.3.mac_stats.rx_frames_128_255: 112
dev.em.3.mac_stats.rx_frames_256_511: 641
dev.em.3.mac_stats.rx_frames_512_1023: 0
dev.em.3.mac_stats.rx_frames_1024_1522: 0
dev.em.3.mac_stats.good_octets_recvd: 255346
dev.em.3.mac_stats.good_octets_txd: 55615
dev.em.3.mac_stats.total_pkts_txd: 303
dev.em.3.mac_stats.good_pkts_txd: 303
dev.em.3.mac_stats.bcast_pkts_txd: 79
dev.em.3.mac_stats.mcast_pkts_txd: 32
dev.em.3.mac_stats.tx_frames_64: 32
dev.em.3.mac_stats.tx_frames_65_127: 229
dev.em.3.mac_stats.tx_frames_128_255: 9
dev.em.3.mac_stats.tx_frames_256_511: 14
dev.em.3.mac_stats.tx_frames_512_1023: 1
dev.em.3.mac_stats.tx_frames_1024_1522: 18
dev.em.3.mac_stats.tso_txd: 0
dev.em.3.mac_stats.tso_ctx_fail: 0
dev.em.3.interrupts.asserts: 9
dev.em.3.interrupts.rx_pkt_timer: 0
dev.em.3.interrupts.rx_abs_timer: 0
dev.em.3.interrupts.tx_pkt_timer: 0
dev.em.3.interrupts.tx_abs_timer: 0
dev.em.3.interrupts.tx_queue_empty: 0
dev.em.3.interrupts.tx_queue_min_thresh: 0
dev.em.3.interrupts.rx_desc_min_thresh: 0
dev.em.3.interrupts.rx_overrun: 0
dev.em.4.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.4.%driver: em
dev.em.4.%location: slot=0 function=0
dev.em.4.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.4.%parent: pci15
dev.em.4.nvm: -1
dev.em.4.debug: -1
dev.em.4.fc: 3
dev.em.4.rx_int_delay: 0
dev.em.4.tx_int_delay: 66
dev.em.4.rx_abs_int_delay: 66
dev.em.4.tx_abs_int_delay: 66
dev.em.4.itr: 488
dev.em.4.rx_processing_limit: 100
dev.em.4.eee_control: 1
dev.em.4.link_irq: 0
dev.em.4.mbuf_alloc_fail: 0
dev.em.4.cluster_alloc_fail: 0
dev.em.4.dropped: 0
dev.em.4.tx_dma_fail: 0
dev.em.4.rx_overruns: 0
dev.em.4.watchdog_timeouts: 0
dev.em.4.device_control: 1074790984
dev.em.4.rx_control: 67141658
dev.em.4.fc_high_water: 18432
dev.em.4.fc_low_water: 16932
dev.em.4.queue0.txd_head: 0
dev.em.4.queue0.txd_tail: 0
dev.em.4.queue0.tx_irq: 0
dev.em.4.queue0.no_desc_avail: 0
dev.em.4.queue0.rxd_head: 0
dev.em.4.queue0.rxd_tail: 1023
dev.em.4.queue0.rx_irq: 0
dev.em.4.mac_stats.excess_coll: 0
dev.em.4.mac_stats.single_coll: 0
dev.em.4.mac_stats.multiple_coll: 0
dev.em.4.mac_stats.late_coll: 0
dev.em.4.mac_stats.collision_count: 0
dev.em.4.mac_stats.symbol_errors: 0
dev.em.4.mac_stats.sequence_errors: 0
dev.em.4.mac_stats.defer_count: 0
dev.em.4.mac_stats.missed_packets: 0
dev.em.4.mac_stats.recv_no_buff: 0
dev.em.4.mac_stats.recv_undersize: 0
dev.em.4.mac_stats.recv_fragmented: 0
dev.em.4.mac_stats.recv_oversize: 0
dev.em.4.mac_stats.recv_jabber: 0
dev.em.4.mac_stats.recv_errs: 0
dev.em.4.mac_stats.crc_errs: 0
dev.em.4.mac_stats.alignment_errs: 0
dev.em.4.mac_stats.coll_ext_errs: 0
dev.em.4.mac_stats.xon_recvd: 0
dev.em.4.mac_stats.xon_txd: 0
dev.em.4.mac_stats.xoff_recvd: 0
dev.em.4.mac_stats.xoff_txd: 0
dev.em.4.mac_stats.total_pkts_recvd: 0
dev.em.4.mac_stats.good_pkts_recvd: 0
dev.em.4.mac_stats.bcast_pkts_recvd: 0
dev.em.4.mac_stats.mcast_pkts_recvd: 0
dev.em.4.mac_stats.rx_frames_64: 0
dev.em.4.mac_stats.rx_frames_65_127: 0
dev.em.4.mac_stats.rx_frames_128_255: 0
dev.em.4.mac_stats.rx_frames_256_511: 0
dev.em.4.mac_stats.rx_frames_512_1023: 0
dev.em.4.mac_stats.rx_frames_1024_1522: 0
dev.em.4.mac_stats.good_octets_recvd: 0
dev.em.4.mac_stats.good_octets_txd: 0
dev.em.4.mac_stats.total_pkts_txd: 0
dev.em.4.mac_stats.good_pkts_txd: 0
dev.em.4.mac_stats.bcast_pkts_txd: 0
dev.em.4.mac_stats.mcast_pkts_txd: 0
dev.em.4.mac_stats.tx_frames_64: 0
dev.em.4.mac_stats.tx_frames_65_127: 0
dev.em.4.mac_stats.tx_frames_128_255: 0
dev.em.4.mac_stats.tx_frames_256_511: 0
dev.em.4.mac_stats.tx_frames_512_1023: 0
dev.em.4.mac_stats.tx_frames_1024_1522: 0
dev.em.4.mac_stats.tso_txd: 0
dev.em.4.mac_stats.tso_ctx_fail: 0
dev.em.4.interrupts.asserts: 0
dev.em.4.interrupts.rx_pkt_timer: 0
dev.em.4.interrupts.rx_abs_timer: 0
dev.em.4.interrupts.tx_pkt_timer: 0
dev.em.4.interrupts.tx_abs_timer: 0
dev.em.4.interrupts.tx_queue_empty: 0
dev.em.4.interrupts.tx_queue_min_thresh: 0
dev.em.4.interrupts.rx_desc_min_thresh: 0
dev.em.4.interrupts.rx_overrun: 0
dev.em.5.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.5.%driver: em
dev.em.5.%location: slot=0 function=0
dev.em.5.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.5.%parent: pci16
dev.em.5.nvm: -1
dev.em.5.debug: -1
dev.em.5.fc: 3
dev.em.5.rx_int_delay: 0
dev.em.5.tx_int_delay: 66
dev.em.5.rx_abs_int_delay: 66
dev.em.5.tx_abs_int_delay: 66
dev.em.5.itr: 488
dev.em.5.rx_processing_limit: 100
dev.em.5.eee_control: 1
dev.em.5.link_irq: 14
dev.em.5.mbuf_alloc_fail: 0
dev.em.5.cluster_alloc_fail: 0
dev.em.5.dropped: 0
dev.em.5.tx_dma_fail: 0
dev.em.5.rx_overruns: 0
dev.em.5.watchdog_timeouts: 0
dev.em.5.device_control: 1477444168
dev.em.5.rx_control: 67141658
dev.em.5.fc_high_water: 18432
dev.em.5.fc_low_water: 16932
dev.em.5.queue0.txd_head: 118
dev.em.5.queue0.txd_tail: 118
dev.em.5.queue0.tx_irq: 35021
dev.em.5.queue0.no_desc_avail: 0
dev.em.5.queue0.rxd_head: 813
dev.em.5.queue0.rxd_tail: 812
dev.em.5.queue0.rx_irq: 33522
dev.em.5.mac_stats.excess_coll: 0
dev.em.5.mac_stats.single_coll: 0
dev.em.5.mac_stats.multiple_coll: 0
dev.em.5.mac_stats.late_coll: 0
dev.em.5.mac_stats.collision_count: 0
dev.em.5.mac_stats.symbol_errors: 0
dev.em.5.mac_stats.sequence_errors: 0
dev.em.5.mac_stats.defer_count: 0
dev.em.5.mac_stats.missed_packets: 0
dev.em.5.mac_stats.recv_no_buff: 0
dev.em.5.mac_stats.recv_undersize: 0
dev.em.5.mac_stats.recv_fragmented: 0
dev.em.5.mac_stats.recv_oversize: 0
dev.em.5.mac_stats.recv_jabber: 0
dev.em.5.mac_stats.recv_errs: 0
dev.em.5.mac_stats.crc_errs: 0
dev.em.5.mac_stats.alignment_errs: 0
dev.em.5.mac_stats.coll_ext_errs: 0
dev.em.5.mac_stats.xon_recvd: 0
dev.em.5.mac_stats.xon_txd: 0
dev.em.5.mac_stats.xoff_recvd: 0
dev.em.5.mac_stats.xoff_txd: 0
dev.em.5.mac_stats.total_pkts_recvd: 33581
dev.em.5.mac_stats.good_pkts_recvd: 33581
dev.em.5.mac_stats.bcast_pkts_recvd: 13190
dev.em.5.mac_stats.mcast_pkts_recvd: 6958
dev.em.5.mac_stats.rx_frames_64: 13832
dev.em.5.mac_stats.rx_frames_65_127: 10806
dev.em.5.mac_stats.rx_frames_128_255: 408
dev.em.5.mac_stats.rx_frames_256_511: 7058
dev.em.5.mac_stats.rx_frames_512_1023: 413
dev.em.5.mac_stats.rx_frames_1024_1522: 1064
dev.em.5.mac_stats.good_octets_recvd: 6533199
dev.em.5.mac_stats.good_octets_txd: 5861382
dev.em.5.mac_stats.total_pkts_txd: 35811
dev.em.5.mac_stats.good_pkts_txd: 35811
dev.em.5.mac_stats.bcast_pkts_txd: 8074
dev.em.5.mac_stats.mcast_pkts_txd: 2154
dev.em.5.mac_stats.tx_frames_64: 17797
dev.em.5.mac_stats.tx_frames_65_127: 14125
dev.em.5.mac_stats.tx_frames_128_255: 859
dev.em.5.mac_stats.tx_frames_256_511: 716
dev.em.5.mac_stats.tx_frames_512_1023: 294
dev.em.5.mac_stats.tx_frames_1024_1522: 2020
dev.em.5.mac_stats.tso_txd: 0
dev.em.5.mac_stats.tso_ctx_fail: 0
dev.em.5.interrupts.asserts: 9
dev.em.5.interrupts.rx_pkt_timer: 0
dev.em.5.interrupts.rx_abs_timer: 0
dev.em.5.interrupts.tx_pkt_timer: 0
dev.em.5.interrupts.tx_abs_timer: 0
dev.em.5.interrupts.tx_queue_empty: 0
dev.em.5.interrupts.tx_queue_min_thresh: 0
dev.em.5.interrupts.rx_desc_min_thresh: 0
dev.em.5.interrupts.rx_overrun: 0
dev.em.6.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.6.%driver: em
dev.em.6.%location: slot=0 function=0
dev.em.6.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.6.%parent: pci17
dev.em.6.nvm: -1
dev.em.6.debug: -1
dev.em.6.fc: 3
dev.em.6.rx_int_delay: 0
dev.em.6.tx_int_delay: 66
dev.em.6.rx_abs_int_delay: 66
dev.em.6.tx_abs_int_delay: 66
dev.em.6.itr: 488
dev.em.6.rx_processing_limit: 100
dev.em.6.eee_control: 1
dev.em.6.link_irq: 22
dev.em.6.mbuf_alloc_fail: 0
dev.em.6.cluster_alloc_fail: 0
dev.em.6.dropped: 0
dev.em.6.tx_dma_fail: 0
dev.em.6.rx_overruns: 0
dev.em.6.watchdog_timeouts: 0
dev.em.6.device_control: 1477444168
dev.em.6.rx_control: 67141658
dev.em.6.fc_high_water: 18432
dev.em.6.fc_low_water: 16932
dev.em.6.queue0.txd_head: 172
dev.em.6.queue0.txd_tail: 172
dev.em.6.queue0.tx_irq: 86612
dev.em.6.queue0.no_desc_avail: 0
dev.em.6.queue0.rxd_head: 886
dev.em.6.queue0.rxd_tail: 885
dev.em.6.queue0.rx_irq: 37129
dev.em.6.mac_stats.excess_coll: 0
dev.em.6.mac_stats.single_coll: 0
dev.em.6.mac_stats.multiple_coll: 0
dev.em.6.mac_stats.late_coll: 0
dev.em.6.mac_stats.collision_count: 0
dev.em.6.mac_stats.symbol_errors: 0
dev.em.6.mac_stats.sequence_errors: 0
dev.em.6.mac_stats.defer_count: 0
dev.em.6.mac_stats.missed_packets: 0
dev.em.6.mac_stats.recv_no_buff: 0
dev.em.6.mac_stats.recv_undersize: 0
dev.em.6.mac_stats.recv_fragmented: 0
dev.em.6.mac_stats.recv_oversize: 0
dev.em.6.mac_stats.recv_jabber: 0
dev.em.6.mac_stats.recv_errs: 0
dev.em.6.mac_stats.crc_errs: 0
dev.em.6.mac_stats.alignment_errs: 0
dev.em.6.mac_stats.coll_ext_errs: 0
dev.em.6.mac_stats.xon_recvd: 0
dev.em.6.mac_stats.xon_txd: 0
dev.em.6.mac_stats.xoff_recvd: 0
dev.em.6.mac_stats.xoff_txd: 0
dev.em.6.mac_stats.total_pkts_recvd: 40822
dev.em.6.mac_stats.good_pkts_recvd: 40822
dev.em.6.mac_stats.bcast_pkts_recvd: 538
dev.em.6.mac_stats.mcast_pkts_recvd: 445
dev.em.6.mac_stats.rx_frames_64: 28322
dev.em.6.mac_stats.rx_frames_65_127: 8188
dev.em.6.mac_stats.rx_frames_128_255: 966
dev.em.6.mac_stats.rx_frames_256_511: 818
dev.em.6.mac_stats.rx_frames_512_1023: 957
dev.em.6.mac_stats.rx_frames_1024_1522: 1571
dev.em.6.mac_stats.good_octets_recvd: 6040146
dev.em.6.mac_stats.good_octets_txd: 88048854
dev.em.6.mac_stats.total_pkts_txd: 93690
dev.em.6.mac_stats.good_pkts_txd: 93690
dev.em.6.mac_stats.bcast_pkts_txd: 20785
dev.em.6.mac_stats.mcast_pkts_txd: 8747
dev.em.6.mac_stats.tx_frames_64: 19296
dev.em.6.mac_stats.tx_frames_65_127: 9220
dev.em.6.mac_stats.tx_frames_128_255: 2549
dev.em.6.mac_stats.tx_frames_256_511: 7998
dev.em.6.mac_stats.tx_frames_512_1023: 746
dev.em.6.mac_stats.tx_frames_1024_1522: 53881
dev.em.6.mac_stats.tso_txd: 0
dev.em.6.mac_stats.tso_ctx_fail: 0
dev.em.6.interrupts.asserts: 14
dev.em.6.interrupts.rx_pkt_timer: 0
dev.em.6.interrupts.rx_abs_timer: 0
dev.em.6.interrupts.tx_pkt_timer: 0
dev.em.6.interrupts.tx_abs_timer: 0
dev.em.6.interrupts.tx_queue_empty: 0
dev.em.6.interrupts.tx_queue_min_thresh: 0
dev.em.6.interrupts.rx_desc_min_thresh: 0
dev.em.6.interrupts.rx_overrun: 0
dev.em.7.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.7.%driver: em
dev.em.7.%location: slot=0 function=0
dev.em.7.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.7.%parent: pci18
dev.em.7.nvm: -1
dev.em.7.debug: -1
dev.em.7.fc: 3
dev.em.7.rx_int_delay: 0
dev.em.7.tx_int_delay: 66
dev.em.7.rx_abs_int_delay: 66
dev.em.7.tx_abs_int_delay: 66
dev.em.7.itr: 488
dev.em.7.rx_processing_limit: 100
dev.em.7.eee_control: 1
dev.em.7.link_irq: 0
dev.em.7.mbuf_alloc_fail: 0
dev.em.7.cluster_alloc_fail: 0
dev.em.7.dropped: 0
dev.em.7.tx_dma_fail: 0
dev.em.7.rx_overruns: 0
dev.em.7.watchdog_timeouts: 0
dev.em.7.device_control: 1074790984
dev.em.7.rx_control: 67141658
dev.em.7.fc_high_water: 18432
dev.em.7.fc_low_water: 16932
dev.em.7.queue0.txd_head: 0
dev.em.7.queue0.txd_tail: 0
dev.em.7.queue0.tx_irq: 0
dev.em.7.queue0.no_desc_avail: 0
dev.em.7.queue0.rxd_head: 0
dev.em.7.queue0.rxd_tail: 1023
dev.em.7.queue0.rx_irq: 0
dev.em.7.mac_stats.excess_coll: 0
dev.em.7.mac_stats.single_coll: 0
dev.em.7.mac_stats.multiple_coll: 0
dev.em.7.mac_stats.late_coll: 0
dev.em.7.mac_stats.collision_count: 0
dev.em.7.mac_stats.symbol_errors: 0
dev.em.7.mac_stats.sequence_errors: 0
dev.em.7.mac_stats.defer_count: 0
dev.em.7.mac_stats.missed_packets: 0
dev.em.7.mac_stats.recv_no_buff: 0
dev.em.7.mac_stats.recv_undersize: 0
dev.em.7.mac_stats.recv_fragmented: 0
dev.em.7.mac_stats.recv_oversize: 0
dev.em.7.mac_stats.recv_jabber: 0
dev.em.7.mac_stats.recv_errs: 0
dev.em.7.mac_stats.crc_errs: 0
dev.em.7.mac_stats.alignment_errs: 0
dev.em.7.mac_stats.coll_ext_errs: 0
dev.em.7.mac_stats.xon_recvd: 0
dev.em.7.mac_stats.xon_txd: 0
dev.em.7.mac_stats.xoff_recvd: 0
dev.em.7.mac_stats.xoff_txd: 0
dev.em.7.mac_stats.total_pkts_recvd: 0
dev.em.7.mac_stats.good_pkts_recvd: 0
dev.em.7.mac_stats.bcast_pkts_recvd: 0
dev.em.7.mac_stats.mcast_pkts_recvd: 0
dev.em.7.mac_stats.rx_frames_64: 0
dev.em.7.mac_stats.rx_frames_65_127: 0
dev.em.7.mac_stats.rx_frames_128_255: 0
dev.em.7.mac_stats.rx_frames_256_511: 0
dev.em.7.mac_stats.rx_frames_512_1023: 0
dev.em.7.mac_stats.rx_frames_1024_1522: 0
dev.em.7.mac_stats.good_octets_recvd: 0
dev.em.7.mac_stats.good_octets_txd: 0
dev.em.7.mac_stats.total_pkts_txd: 0
dev.em.7.mac_stats.good_pkts_txd: 0
dev.em.7.mac_stats.bcast_pkts_txd: 0
dev.em.7.mac_stats.mcast_pkts_txd: 0
dev.em.7.mac_stats.tx_frames_64: 0
dev.em.7.mac_stats.tx_frames_65_127: 0
dev.em.7.mac_stats.tx_frames_128_255: 0
dev.em.7.mac_stats.tx_frames_256_511: 0
dev.em.7.mac_stats.tx_frames_512_1023: 0
dev.em.7.mac_stats.tx_frames_1024_1522: 0
dev.em.7.mac_stats.tso_txd: 0
dev.em.7.mac_stats.tso_ctx_fail: 0
dev.em.7.interrupts.asserts: 0
dev.em.7.interrupts.rx_pkt_timer: 0
dev.em.7.interrupts.rx_abs_timer: 0
dev.em.7.interrupts.tx_pkt_timer: 0
dev.em.7.interrupts.tx_abs_timer: 0
dev.em.7.interrupts.tx_queue_empty: 0
dev.em.7.interrupts.tx_queue_min_thresh: 0
dev.em.7.interrupts.rx_desc_min_thresh: 0
dev.em.7.interrupts.rx_overrun: 0

And this is shortly after, having revived the connection using ifconfig:

$ sysctl dev.em
dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.0.%driver: em
dev.em.0.%location: slot=0 function=0
dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.0.%parent: pci5
dev.em.0.nvm: -1
dev.em.0.debug: -1
dev.em.0.fc: 3
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.itr: 488
dev.em.0.rx_processing_limit: 100
dev.em.0.eee_control: 1
dev.em.0.link_irq: 3
dev.em.0.mbuf_alloc_fail: 0
dev.em.0.cluster_alloc_fail: 0
dev.em.0.dropped: 0
dev.em.0.tx_dma_fail: 0
dev.em.0.rx_overruns: 0
dev.em.0.watchdog_timeouts: 0
dev.em.0.device_control: 1074790984
dev.em.0.rx_control: 67141658
dev.em.0.fc_high_water: 18432
dev.em.0.fc_low_water: 16932
dev.em.0.queue0.txd_head: 685
dev.em.0.queue0.txd_tail: 685
dev.em.0.queue0.tx_irq: 1353736
dev.em.0.queue0.no_desc_avail: 0
dev.em.0.queue0.rxd_head: 676
dev.em.0.queue0.rxd_tail: 675
dev.em.0.queue0.rx_irq: 2196823
dev.em.0.mac_stats.excess_coll: 0
dev.em.0.mac_stats.single_coll: 0
dev.em.0.mac_stats.multiple_coll: 0
dev.em.0.mac_stats.late_coll: 0
dev.em.0.mac_stats.collision_count: 0
dev.em.0.mac_stats.symbol_errors: 0
dev.em.0.mac_stats.sequence_errors: 0
dev.em.0.mac_stats.defer_count: 0
dev.em.0.mac_stats.missed_packets: 0
dev.em.0.mac_stats.recv_no_buff: 0
dev.em.0.mac_stats.recv_undersize: 0
dev.em.0.mac_stats.recv_fragmented: 0
dev.em.0.mac_stats.recv_oversize: 14
dev.em.0.mac_stats.recv_jabber: 0
dev.em.0.mac_stats.recv_errs: 1
dev.em.0.mac_stats.crc_errs: 1864
dev.em.0.mac_stats.alignment_errs: 0
dev.em.0.mac_stats.coll_ext_errs: 0
dev.em.0.mac_stats.xon_recvd: 0
dev.em.0.mac_stats.xon_txd: 0
dev.em.0.mac_stats.xoff_recvd: 0
dev.em.0.mac_stats.xoff_txd: 0
dev.em.0.mac_stats.total_pkts_recvd: 2695671
dev.em.0.mac_stats.good_pkts_recvd: 2693793
dev.em.0.mac_stats.bcast_pkts_recvd: 115211
dev.em.0.mac_stats.mcast_pkts_recvd: 170573
dev.em.0.mac_stats.rx_frames_64: 231428
dev.em.0.mac_stats.rx_frames_65_127: 881736
dev.em.0.mac_stats.rx_frames_128_255: 240428
dev.em.0.mac_stats.rx_frames_256_511: 127402
dev.em.0.mac_stats.rx_frames_512_1023: 43918
dev.em.0.mac_stats.rx_frames_1024_1522: 1168881
dev.em.0.mac_stats.good_octets_recvd: 1944697083
dev.em.0.mac_stats.good_octets_txd: 267511513
dev.em.0.mac_stats.total_pkts_txd: 2302538
dev.em.0.mac_stats.good_pkts_txd: 2302538
dev.em.0.mac_stats.bcast_pkts_txd: 21
dev.em.0.mac_stats.mcast_pkts_txd: 5
dev.em.0.mac_stats.tx_frames_64: 401423
dev.em.0.mac_stats.tx_frames_65_127: 1702538
dev.em.0.mac_stats.tx_frames_128_255: 59586
dev.em.0.mac_stats.tx_frames_256_511: 57937
dev.em.0.mac_stats.tx_frames_512_1023: 37227
dev.em.0.mac_stats.tx_frames_1024_1522: 43827
dev.em.0.mac_stats.tso_txd: 0
dev.em.0.mac_stats.tso_ctx_fail: 0
dev.em.0.interrupts.asserts: 5
dev.em.0.interrupts.rx_pkt_timer: 0
dev.em.0.interrupts.rx_abs_timer: 0
dev.em.0.interrupts.tx_pkt_timer: 0
dev.em.0.interrupts.tx_abs_timer: 0
dev.em.0.interrupts.tx_queue_empty: 0
dev.em.0.interrupts.tx_queue_min_thresh: 0
dev.em.0.interrupts.rx_desc_min_thresh: 0
dev.em.0.interrupts.rx_overrun: 0
dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.1.%driver: em
dev.em.1.%location: slot=0 function=0
dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.1.%parent: pci6
dev.em.1.nvm: -1
dev.em.1.debug: -1
dev.em.1.fc: 3
dev.em.1.rx_int_delay: 0
dev.em.1.tx_int_delay: 66
dev.em.1.rx_abs_int_delay: 66
dev.em.1.tx_abs_int_delay: 66
dev.em.1.itr: 488
dev.em.1.rx_processing_limit: 100
dev.em.1.eee_control: 1
dev.em.1.link_irq: 22
dev.em.1.mbuf_alloc_fail: 0
dev.em.1.cluster_alloc_fail: 0
dev.em.1.dropped: 0
dev.em.1.tx_dma_fail: 0
dev.em.1.rx_overruns: 0
dev.em.1.watchdog_timeouts: 0
dev.em.1.device_control: 1477444168
dev.em.1.rx_control: 67141658
dev.em.1.fc_high_water: 18432
dev.em.1.fc_low_water: 16932
dev.em.1.queue0.txd_head: 839
dev.em.1.queue0.txd_tail: 839
dev.em.1.queue0.tx_irq: 1691646
dev.em.1.queue0.no_desc_avail: 0
dev.em.1.queue0.rxd_head: 100
dev.em.1.queue0.rxd_tail: 99
dev.em.1.queue0.rx_irq: 1381613
dev.em.1.mac_stats.excess_coll: 0
dev.em.1.mac_stats.single_coll: 0
dev.em.1.mac_stats.multiple_coll: 0
dev.em.1.mac_stats.late_coll: 0
dev.em.1.mac_stats.collision_count: 0
dev.em.1.mac_stats.symbol_errors: 0
dev.em.1.mac_stats.sequence_errors: 0
dev.em.1.mac_stats.defer_count: 0
dev.em.1.mac_stats.missed_packets: 0
dev.em.1.mac_stats.recv_no_buff: 0
dev.em.1.mac_stats.recv_undersize: 0
dev.em.1.mac_stats.recv_fragmented: 0
dev.em.1.mac_stats.recv_oversize: 0
dev.em.1.mac_stats.recv_jabber: 0
dev.em.1.mac_stats.recv_errs: 0
dev.em.1.mac_stats.crc_errs: 0
dev.em.1.mac_stats.alignment_errs: 0
dev.em.1.mac_stats.coll_ext_errs: 0
dev.em.1.mac_stats.xon_recvd: 0
dev.em.1.mac_stats.xon_txd: 0
dev.em.1.mac_stats.xoff_recvd: 0
dev.em.1.mac_stats.xoff_txd: 0
dev.em.1.mac_stats.total_pkts_recvd: 6059107
dev.em.1.mac_stats.good_pkts_recvd: 6059107
dev.em.1.mac_stats.bcast_pkts_recvd: 1003
dev.em.1.mac_stats.mcast_pkts_recvd: 36
dev.em.1.mac_stats.rx_frames_64: 3395204
dev.em.1.mac_stats.rx_frames_65_127: 1584944
dev.em.1.mac_stats.rx_frames_128_255: 146061
dev.em.1.mac_stats.rx_frames_256_511: 68733
dev.em.1.mac_stats.rx_frames_512_1023: 57333
dev.em.1.mac_stats.rx_frames_1024_1522: 806832
dev.em.1.mac_stats.good_octets_recvd: 1644015882
dev.em.1.mac_stats.good_octets_txd: 10934440772
dev.em.1.mac_stats.total_pkts_txd: 8619016
dev.em.1.mac_stats.good_pkts_txd: 8619016
dev.em.1.mac_stats.bcast_pkts_txd: 20889
dev.em.1.mac_stats.mcast_pkts_txd: 9162
dev.em.1.mac_stats.tx_frames_64: 439143
dev.em.1.mac_stats.tx_frames_65_127: 621925
dev.em.1.mac_stats.tx_frames_128_255: 326546
dev.em.1.mac_stats.tx_frames_256_511: 105432
dev.em.1.mac_stats.tx_frames_512_1023: 44657
dev.em.1.mac_stats.tx_frames_1024_1522: 7081313
dev.em.1.mac_stats.tso_txd: 0
dev.em.1.mac_stats.tso_ctx_fail: 0
dev.em.1.interrupts.asserts: 13
dev.em.1.interrupts.rx_pkt_timer: 0
dev.em.1.interrupts.rx_abs_timer: 0
dev.em.1.interrupts.tx_pkt_timer: 0
dev.em.1.interrupts.tx_abs_timer: 0
dev.em.1.interrupts.tx_queue_empty: 0
dev.em.1.interrupts.tx_queue_min_thresh: 0
dev.em.1.interrupts.rx_desc_min_thresh: 0
dev.em.1.interrupts.rx_overrun: 0
dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.2.%driver: em
dev.em.2.%location: slot=0 function=0
dev.em.2.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.2.%parent: pci10
dev.em.2.nvm: -1
dev.em.2.debug: -1
dev.em.2.fc: 3
dev.em.2.rx_int_delay: 0
dev.em.2.tx_int_delay: 66
dev.em.2.rx_abs_int_delay: 66
dev.em.2.tx_abs_int_delay: 66
dev.em.2.itr: 488
dev.em.2.rx_processing_limit: 100
dev.em.2.eee_control: 1
dev.em.2.link_irq: 69
dev.em.2.mbuf_alloc_fail: 0
dev.em.2.cluster_alloc_fail: 0
dev.em.2.dropped: 0
dev.em.2.tx_dma_fail: 0
dev.em.2.rx_overruns: 0
dev.em.2.watchdog_timeouts: 0
dev.em.2.device_control: 1477444168
dev.em.2.rx_control: 67141658
dev.em.2.fc_high_water: 18432
dev.em.2.fc_low_water: 16932
dev.em.2.queue0.txd_head: 240
dev.em.2.queue0.txd_tail: 240
dev.em.2.queue0.tx_irq: 1314599
dev.em.2.queue0.no_desc_avail: 4
dev.em.2.queue0.rxd_head: 293
dev.em.2.queue0.rxd_tail: 292
dev.em.2.queue0.rx_irq: 1026038
dev.em.2.mac_stats.excess_coll: 0
dev.em.2.mac_stats.single_coll: 0
dev.em.2.mac_stats.multiple_coll: 0
dev.em.2.mac_stats.late_coll: 0
dev.em.2.mac_stats.collision_count: 0
dev.em.2.mac_stats.symbol_errors: 0
dev.em.2.mac_stats.sequence_errors: 0
dev.em.2.mac_stats.defer_count: 0
dev.em.2.mac_stats.missed_packets: 0
dev.em.2.mac_stats.recv_no_buff: 0
dev.em.2.mac_stats.recv_undersize: 0
dev.em.2.mac_stats.recv_fragmented: 0
dev.em.2.mac_stats.recv_oversize: 0
dev.em.2.mac_stats.recv_jabber: 0
dev.em.2.mac_stats.recv_errs: 0
dev.em.2.mac_stats.crc_errs: 0
dev.em.2.mac_stats.alignment_errs: 0
dev.em.2.mac_stats.coll_ext_errs: 0
dev.em.2.mac_stats.xon_recvd: 0
dev.em.2.mac_stats.xon_txd: 67
dev.em.2.mac_stats.xoff_recvd: 0
dev.em.2.mac_stats.xoff_txd: 67
dev.em.2.mac_stats.total_pkts_recvd: 7579992
dev.em.2.mac_stats.good_pkts_recvd: 7579992
dev.em.2.mac_stats.bcast_pkts_recvd: 4530
dev.em.2.mac_stats.mcast_pkts_recvd: 1960
dev.em.2.mac_stats.rx_frames_64: 733376
dev.em.2.mac_stats.rx_frames_65_127: 127545
dev.em.2.mac_stats.rx_frames_128_255: 236524
dev.em.2.mac_stats.rx_frames_256_511: 32859
dev.em.2.mac_stats.rx_frames_512_1023: 70613
dev.em.2.mac_stats.rx_frames_1024_1522: 6379075
dev.em.2.mac_stats.good_octets_recvd: 9847706051
dev.em.2.mac_stats.good_octets_txd: 2161839705
dev.em.2.mac_stats.total_pkts_txd: 5162265
dev.em.2.mac_stats.good_pkts_txd: 5162131
dev.em.2.mac_stats.bcast_pkts_txd: 5846
dev.em.2.mac_stats.mcast_pkts_txd: 3858
dev.em.2.mac_stats.tx_frames_64: 3311306
dev.em.2.mac_stats.tx_frames_65_127: 402438
dev.em.2.mac_stats.tx_frames_128_255: 129314
dev.em.2.mac_stats.tx_frames_256_511: 25549
dev.em.2.mac_stats.tx_frames_512_1023: 92410
dev.em.2.mac_stats.tx_frames_1024_1522: 1201114
dev.em.2.mac_stats.tso_txd: 0
dev.em.2.mac_stats.tso_ctx_fail: 0
dev.em.2.interrupts.asserts: 44
dev.em.2.interrupts.rx_pkt_timer: 0
dev.em.2.interrupts.rx_abs_timer: 0
dev.em.2.interrupts.tx_pkt_timer: 0
dev.em.2.interrupts.tx_abs_timer: 0
dev.em.2.interrupts.tx_queue_empty: 0
dev.em.2.interrupts.tx_queue_min_thresh: 0
dev.em.2.interrupts.rx_desc_min_thresh: 0
dev.em.2.interrupts.rx_overrun: 0
dev.em.3.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.3.%driver: em
dev.em.3.%location: slot=0 function=0
dev.em.3.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.3.%parent: pci11
dev.em.3.nvm: -1
dev.em.3.debug: -1
dev.em.3.fc: 3
dev.em.3.rx_int_delay: 0
dev.em.3.tx_int_delay: 66
dev.em.3.rx_abs_int_delay: 66
dev.em.3.tx_abs_int_delay: 66
dev.em.3.itr: 488
dev.em.3.rx_processing_limit: 100
dev.em.3.eee_control: 1
dev.em.3.link_irq: 13
dev.em.3.mbuf_alloc_fail: 0
dev.em.3.cluster_alloc_fail: 0
dev.em.3.dropped: 0
dev.em.3.tx_dma_fail: 0
dev.em.3.rx_overruns: 0
dev.em.3.watchdog_timeouts: 0
dev.em.3.device_control: 1074790984
dev.em.3.rx_control: 67141658
dev.em.3.fc_high_water: 18432
dev.em.3.fc_low_water: 16932
dev.em.3.queue0.txd_head: 386
dev.em.3.queue0.txd_tail: 386
dev.em.3.queue0.tx_irq: 276
dev.em.3.queue0.no_desc_avail: 0
dev.em.3.queue0.rxd_head: 218
dev.em.3.queue0.rxd_tail: 217
dev.em.3.queue0.rx_irq: 978
dev.em.3.mac_stats.excess_coll: 0
dev.em.3.mac_stats.single_coll: 0
dev.em.3.mac_stats.multiple_coll: 0
dev.em.3.mac_stats.late_coll: 0
dev.em.3.mac_stats.collision_count: 0
dev.em.3.mac_stats.symbol_errors: 0
dev.em.3.mac_stats.sequence_errors: 0
dev.em.3.mac_stats.defer_count: 0
dev.em.3.mac_stats.missed_packets: 0
dev.em.3.mac_stats.recv_no_buff: 0
dev.em.3.mac_stats.recv_undersize: 0
dev.em.3.mac_stats.recv_fragmented: 0
dev.em.3.mac_stats.recv_oversize: 0
dev.em.3.mac_stats.recv_jabber: 0
dev.em.3.mac_stats.recv_errs: 0
dev.em.3.mac_stats.crc_errs: 0
dev.em.3.mac_stats.alignment_errs: 0
dev.em.3.mac_stats.coll_ext_errs: 0
dev.em.3.mac_stats.xon_recvd: 0
dev.em.3.mac_stats.xon_txd: 0
dev.em.3.mac_stats.xoff_recvd: 0
dev.em.3.mac_stats.xoff_txd: 0
dev.em.3.mac_stats.total_pkts_recvd: 979
dev.em.3.mac_stats.good_pkts_recvd: 979
dev.em.3.mac_stats.bcast_pkts_recvd: 616
dev.em.3.mac_stats.mcast_pkts_recvd: 158
dev.em.3.mac_stats.rx_frames_64: 63
dev.em.3.mac_stats.rx_frames_65_127: 163
dev.em.3.mac_stats.rx_frames_128_255: 112
dev.em.3.mac_stats.rx_frames_256_511: 641
dev.em.3.mac_stats.rx_frames_512_1023: 0
dev.em.3.mac_stats.rx_frames_1024_1522: 0
dev.em.3.mac_stats.good_octets_recvd: 255346
dev.em.3.mac_stats.good_octets_txd: 55615
dev.em.3.mac_stats.total_pkts_txd: 303
dev.em.3.mac_stats.good_pkts_txd: 303
dev.em.3.mac_stats.bcast_pkts_txd: 79
dev.em.3.mac_stats.mcast_pkts_txd: 32
dev.em.3.mac_stats.tx_frames_64: 32
dev.em.3.mac_stats.tx_frames_65_127: 229
dev.em.3.mac_stats.tx_frames_128_255: 9
dev.em.3.mac_stats.tx_frames_256_511: 14
dev.em.3.mac_stats.tx_frames_512_1023: 1
dev.em.3.mac_stats.tx_frames_1024_1522: 18
dev.em.3.mac_stats.tso_txd: 0
dev.em.3.mac_stats.tso_ctx_fail: 0
dev.em.3.interrupts.asserts: 9
dev.em.3.interrupts.rx_pkt_timer: 0
dev.em.3.interrupts.rx_abs_timer: 0
dev.em.3.interrupts.tx_pkt_timer: 0
dev.em.3.interrupts.tx_abs_timer: 0
dev.em.3.interrupts.tx_queue_empty: 0
dev.em.3.interrupts.tx_queue_min_thresh: 0
dev.em.3.interrupts.rx_desc_min_thresh: 0
dev.em.3.interrupts.rx_overrun: 0
dev.em.4.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.4.%driver: em
dev.em.4.%location: slot=0 function=0
dev.em.4.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.4.%parent: pci15
dev.em.4.nvm: -1
dev.em.4.debug: -1
dev.em.4.fc: 3
dev.em.4.rx_int_delay: 0
dev.em.4.tx_int_delay: 66
dev.em.4.rx_abs_int_delay: 66
dev.em.4.tx_abs_int_delay: 66
dev.em.4.itr: 488
dev.em.4.rx_processing_limit: 100
dev.em.4.eee_control: 1
dev.em.4.link_irq: 0
dev.em.4.mbuf_alloc_fail: 0
dev.em.4.cluster_alloc_fail: 0
dev.em.4.dropped: 0
dev.em.4.tx_dma_fail: 0
dev.em.4.rx_overruns: 0
dev.em.4.watchdog_timeouts: 0
dev.em.4.device_control: 1074790984
dev.em.4.rx_control: 67141658
dev.em.4.fc_high_water: 18432
dev.em.4.fc_low_water: 16932
dev.em.4.queue0.txd_head: 0
dev.em.4.queue0.txd_tail: 0
dev.em.4.queue0.tx_irq: 0
dev.em.4.queue0.no_desc_avail: 0
dev.em.4.queue0.rxd_head: 0
dev.em.4.queue0.rxd_tail: 1023
dev.em.4.queue0.rx_irq: 0
dev.em.4.mac_stats.excess_coll: 0
dev.em.4.mac_stats.single_coll: 0
dev.em.4.mac_stats.multiple_coll: 0
dev.em.4.mac_stats.late_coll: 0
dev.em.4.mac_stats.collision_count: 0
dev.em.4.mac_stats.symbol_errors: 0
dev.em.4.mac_stats.sequence_errors: 0
dev.em.4.mac_stats.defer_count: 0
dev.em.4.mac_stats.missed_packets: 0
dev.em.4.mac_stats.recv_no_buff: 0
dev.em.4.mac_stats.recv_undersize: 0
dev.em.4.mac_stats.recv_fragmented: 0
dev.em.4.mac_stats.recv_oversize: 0
dev.em.4.mac_stats.recv_jabber: 0
dev.em.4.mac_stats.recv_errs: 0
dev.em.4.mac_stats.crc_errs: 0
dev.em.4.mac_stats.alignment_errs: 0
dev.em.4.mac_stats.coll_ext_errs: 0
dev.em.4.mac_stats.xon_recvd: 0
dev.em.4.mac_stats.xon_txd: 0
dev.em.4.mac_stats.xoff_recvd: 0
dev.em.4.mac_stats.xoff_txd: 0
dev.em.4.mac_stats.total_pkts_recvd: 0
dev.em.4.mac_stats.good_pkts_recvd: 0
dev.em.4.mac_stats.bcast_pkts_recvd: 0
dev.em.4.mac_stats.mcast_pkts_recvd: 0
dev.em.4.mac_stats.rx_frames_64: 0
dev.em.4.mac_stats.rx_frames_65_127: 0
dev.em.4.mac_stats.rx_frames_128_255: 0
dev.em.4.mac_stats.rx_frames_256_511: 0
dev.em.4.mac_stats.rx_frames_512_1023: 0
dev.em.4.mac_stats.rx_frames_1024_1522: 0
dev.em.4.mac_stats.good_octets_recvd: 0
dev.em.4.mac_stats.good_octets_txd: 0
dev.em.4.mac_stats.total_pkts_txd: 0
dev.em.4.mac_stats.good_pkts_txd: 0
dev.em.4.mac_stats.bcast_pkts_txd: 0
dev.em.4.mac_stats.mcast_pkts_txd: 0
dev.em.4.mac_stats.tx_frames_64: 0
dev.em.4.mac_stats.tx_frames_65_127: 0
dev.em.4.mac_stats.tx_frames_128_255: 0
dev.em.4.mac_stats.tx_frames_256_511: 0
dev.em.4.mac_stats.tx_frames_512_1023: 0
dev.em.4.mac_stats.tx_frames_1024_1522: 0
dev.em.4.mac_stats.tso_txd: 0
dev.em.4.mac_stats.tso_ctx_fail: 0
dev.em.4.interrupts.asserts: 0
dev.em.4.interrupts.rx_pkt_timer: 0
dev.em.4.interrupts.rx_abs_timer: 0
dev.em.4.interrupts.tx_pkt_timer: 0
dev.em.4.interrupts.tx_abs_timer: 0
dev.em.4.interrupts.tx_queue_empty: 0
dev.em.4.interrupts.tx_queue_min_thresh: 0
dev.em.4.interrupts.rx_desc_min_thresh: 0
dev.em.4.interrupts.rx_overrun: 0
dev.em.5.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.5.%driver: em
dev.em.5.%location: slot=0 function=0
dev.em.5.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.5.%parent: pci16
dev.em.5.nvm: -1
dev.em.5.debug: -1
dev.em.5.fc: 3
dev.em.5.rx_int_delay: 0
dev.em.5.tx_int_delay: 66
dev.em.5.rx_abs_int_delay: 66
dev.em.5.tx_abs_int_delay: 66
dev.em.5.itr: 488
dev.em.5.rx_processing_limit: 100
dev.em.5.eee_control: 1
dev.em.5.link_irq: 14
dev.em.5.mbuf_alloc_fail: 0
dev.em.5.cluster_alloc_fail: 0
dev.em.5.dropped: 0
dev.em.5.tx_dma_fail: 0
dev.em.5.rx_overruns: 0
dev.em.5.watchdog_timeouts: 0
dev.em.5.device_control: 1477444168
dev.em.5.rx_control: 67141658
dev.em.5.fc_high_water: 18432
dev.em.5.fc_low_water: 16932
dev.em.5.queue0.txd_head: 908
dev.em.5.queue0.txd_tail: 908
dev.em.5.queue0.tx_irq: 35644
dev.em.5.queue0.no_desc_avail: 0
dev.em.5.queue0.rxd_head: 913
dev.em.5.queue0.rxd_tail: 912
dev.em.5.queue0.rx_irq: 33622
dev.em.5.mac_stats.excess_coll: 0
dev.em.5.mac_stats.single_coll: 0
dev.em.5.mac_stats.multiple_coll: 0
dev.em.5.mac_stats.late_coll: 0
dev.em.5.mac_stats.collision_count: 0
dev.em.5.mac_stats.symbol_errors: 0
dev.em.5.mac_stats.sequence_errors: 0
dev.em.5.mac_stats.defer_count: 0
dev.em.5.mac_stats.missed_packets: 0
dev.em.5.mac_stats.recv_no_buff: 0
dev.em.5.mac_stats.recv_undersize: 0
dev.em.5.mac_stats.recv_fragmented: 0
dev.em.5.mac_stats.recv_oversize: 0
dev.em.5.mac_stats.recv_jabber: 0
dev.em.5.mac_stats.recv_errs: 0
dev.em.5.mac_stats.crc_errs: 0
dev.em.5.mac_stats.alignment_errs: 0
dev.em.5.mac_stats.coll_ext_errs: 0
dev.em.5.mac_stats.xon_recvd: 0
dev.em.5.mac_stats.xon_txd: 0
dev.em.5.mac_stats.xoff_recvd: 0
dev.em.5.mac_stats.xoff_txd: 0
dev.em.5.mac_stats.total_pkts_recvd: 33681
dev.em.5.mac_stats.good_pkts_recvd: 33681
dev.em.5.mac_stats.bcast_pkts_recvd: 13265
dev.em.5.mac_stats.mcast_pkts_recvd: 6979
dev.em.5.mac_stats.rx_frames_64: 13907
dev.em.5.mac_stats.rx_frames_65_127: 10809
dev.em.5.mac_stats.rx_frames_128_255: 408
dev.em.5.mac_stats.rx_frames_256_511: 7079
dev.em.5.mac_stats.rx_frames_512_1023: 414
dev.em.5.mac_stats.rx_frames_1024_1522: 1064
dev.em.5.mac_stats.good_octets_recvd: 6547683
dev.em.5.mac_stats.good_octets_txd: 5926006
dev.em.5.mac_stats.total_pkts_txd: 36476
dev.em.5.mac_stats.good_pkts_txd: 36476
dev.em.5.mac_stats.bcast_pkts_txd: 8603
dev.em.5.mac_stats.mcast_pkts_txd: 2211
dev.em.5.mac_stats.tx_frames_64: 18335
dev.em.5.mac_stats.tx_frames_65_127: 14216
dev.em.5.mac_stats.tx_frames_128_255: 870
dev.em.5.mac_stats.tx_frames_256_511: 719
dev.em.5.mac_stats.tx_frames_512_1023: 306
dev.em.5.mac_stats.tx_frames_1024_1522: 2030
dev.em.5.mac_stats.tso_txd: 0
dev.em.5.mac_stats.tso_ctx_fail: 0
dev.em.5.interrupts.asserts: 9
dev.em.5.interrupts.rx_pkt_timer: 0
dev.em.5.interrupts.rx_abs_timer: 0
dev.em.5.interrupts.tx_pkt_timer: 0
dev.em.5.interrupts.tx_abs_timer: 0
dev.em.5.interrupts.tx_queue_empty: 0
dev.em.5.interrupts.tx_queue_min_thresh: 0
dev.em.5.interrupts.rx_desc_min_thresh: 0
dev.em.5.interrupts.rx_overrun: 0
dev.em.6.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.6.%driver: em
dev.em.6.%location: slot=0 function=0
dev.em.6.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.6.%parent: pci17
dev.em.6.nvm: -1
dev.em.6.debug: -1
dev.em.6.fc: 3
dev.em.6.rx_int_delay: 0
dev.em.6.tx_int_delay: 66
dev.em.6.rx_abs_int_delay: 66
dev.em.6.tx_abs_int_delay: 66
dev.em.6.itr: 488
dev.em.6.rx_processing_limit: 100
dev.em.6.eee_control: 1
dev.em.6.link_irq: 22
dev.em.6.mbuf_alloc_fail: 0
dev.em.6.cluster_alloc_fail: 0
dev.em.6.dropped: 0
dev.em.6.tx_dma_fail: 0
dev.em.6.rx_overruns: 0
dev.em.6.watchdog_timeouts: 0
dev.em.6.device_control: 1477444168
dev.em.6.rx_control: 67141658
dev.em.6.fc_high_water: 18432
dev.em.6.fc_low_water: 16932
dev.em.6.queue0.txd_head: 103
dev.em.6.queue0.txd_tail: 103
dev.em.6.queue0.tx_irq: 87586
dev.em.6.queue0.no_desc_avail: 0
dev.em.6.queue0.rxd_head: 840
dev.em.6.queue0.rxd_tail: 839
dev.em.6.queue0.rx_irq: 37860
dev.em.6.mac_stats.excess_coll: 0
dev.em.6.mac_stats.single_coll: 0
dev.em.6.mac_stats.multiple_coll: 0
dev.em.6.mac_stats.late_coll: 0
dev.em.6.mac_stats.collision_count: 0
dev.em.6.mac_stats.symbol_errors: 0
dev.em.6.mac_stats.sequence_errors: 0
dev.em.6.mac_stats.defer_count: 0
dev.em.6.mac_stats.missed_packets: 0
dev.em.6.mac_stats.recv_no_buff: 0
dev.em.6.mac_stats.recv_undersize: 0
dev.em.6.mac_stats.recv_fragmented: 0
dev.em.6.mac_stats.recv_oversize: 0
dev.em.6.mac_stats.recv_jabber: 0
dev.em.6.mac_stats.recv_errs: 0
dev.em.6.mac_stats.crc_errs: 0
dev.em.6.mac_stats.alignment_errs: 0
dev.em.6.mac_stats.coll_ext_errs: 0
dev.em.6.mac_stats.xon_recvd: 0
dev.em.6.mac_stats.xon_txd: 0
dev.em.6.mac_stats.xoff_recvd: 0
dev.em.6.mac_stats.xoff_txd: 0
dev.em.6.mac_stats.total_pkts_recvd: 41796
dev.em.6.mac_stats.good_pkts_recvd: 41796
dev.em.6.mac_stats.bcast_pkts_recvd: 755
dev.em.6.mac_stats.mcast_pkts_recvd: 454
dev.em.6.mac_stats.rx_frames_64: 29124
dev.em.6.mac_stats.rx_frames_65_127: 8291
dev.em.6.mac_stats.rx_frames_128_255: 984
dev.em.6.mac_stats.rx_frames_256_511: 824
dev.em.6.mac_stats.rx_frames_512_1023: 993
dev.em.6.mac_stats.rx_frames_1024_1522: 1580
dev.em.6.mac_stats.good_octets_recvd: 6142890
dev.em.6.mac_stats.good_octets_txd: 89550641
dev.em.6.mac_stats.total_pkts_txd: 95436
dev.em.6.mac_stats.good_pkts_txd: 95436
dev.em.6.mac_stats.bcast_pkts_txd: 21172
dev.em.6.mac_stats.mcast_pkts_txd: 8816
dev.em.6.mac_stats.tx_frames_64: 19702
dev.em.6.mac_stats.tx_frames_65_127: 9482
dev.em.6.mac_stats.tx_frames_128_255: 2561
dev.em.6.mac_stats.tx_frames_256_511: 8128
dev.em.6.mac_stats.tx_frames_512_1023: 765
dev.em.6.mac_stats.tx_frames_1024_1522: 54798
dev.em.6.mac_stats.tso_txd: 0
dev.em.6.mac_stats.tso_ctx_fail: 0
dev.em.6.interrupts.asserts: 14
dev.em.6.interrupts.rx_pkt_timer: 0
dev.em.6.interrupts.rx_abs_timer: 0
dev.em.6.interrupts.tx_pkt_timer: 0
dev.em.6.interrupts.tx_abs_timer: 0
dev.em.6.interrupts.tx_queue_empty: 0
dev.em.6.interrupts.tx_queue_min_thresh: 0
dev.em.6.interrupts.rx_desc_min_thresh: 0
dev.em.6.interrupts.rx_overrun: 0
dev.em.7.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
dev.em.7.%driver: em
dev.em.7.%location: slot=0 function=0
dev.em.7.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
dev.em.7.%parent: pci18
dev.em.7.nvm: -1
dev.em.7.debug: -1
dev.em.7.fc: 3
dev.em.7.rx_int_delay: 0
dev.em.7.tx_int_delay: 66
dev.em.7.rx_abs_int_delay: 66
dev.em.7.tx_abs_int_delay: 66
dev.em.7.itr: 488
dev.em.7.rx_processing_limit: 100
dev.em.7.eee_control: 1
dev.em.7.link_irq: 0
dev.em.7.mbuf_alloc_fail: 0
dev.em.7.cluster_alloc_fail: 0
dev.em.7.dropped: 0
dev.em.7.tx_dma_fail: 0
dev.em.7.rx_overruns: 0
dev.em.7.watchdog_timeouts: 0
dev.em.7.device_control: 1074790984
dev.em.7.rx_control: 67141658
dev.em.7.fc_high_water: 18432
dev.em.7.fc_low_water: 16932
dev.em.7.queue0.txd_head: 0
dev.em.7.queue0.txd_tail: 0
dev.em.7.queue0.tx_irq: 0
dev.em.7.queue0.no_desc_avail: 0
dev.em.7.queue0.rxd_head: 0
dev.em.7.queue0.rxd_tail: 1023
dev.em.7.queue0.rx_irq: 0
dev.em.7.mac_stats.excess_coll: 0
dev.em.7.mac_stats.single_coll: 0
dev.em.7.mac_stats.multiple_coll: 0
dev.em.7.mac_stats.late_coll: 0
dev.em.7.mac_stats.collision_count: 0
dev.em.7.mac_stats.symbol_errors: 0
dev.em.7.mac_stats.sequence_errors: 0
dev.em.7.mac_stats.defer_count: 0
dev.em.7.mac_stats.missed_packets: 0
dev.em.7.mac_stats.recv_no_buff: 0
dev.em.7.mac_stats.recv_undersize: 0
dev.em.7.mac_stats.recv_fragmented: 0
dev.em.7.mac_stats.recv_oversize: 0
dev.em.7.mac_stats.recv_jabber: 0
dev.em.7.mac_stats.recv_errs: 0
dev.em.7.mac_stats.crc_errs: 0
dev.em.7.mac_stats.alignment_errs: 0
dev.em.7.mac_stats.coll_ext_errs: 0
dev.em.7.mac_stats.xon_recvd: 0
dev.em.7.mac_stats.xon_txd: 0
dev.em.7.mac_stats.xoff_recvd: 0
dev.em.7.mac_stats.xoff_txd: 0
dev.em.7.mac_stats.total_pkts_recvd: 0
dev.em.7.mac_stats.good_pkts_recvd: 0
dev.em.7.mac_stats.bcast_pkts_recvd: 0
dev.em.7.mac_stats.mcast_pkts_recvd: 0
dev.em.7.mac_stats.rx_frames_64: 0
dev.em.7.mac_stats.rx_frames_65_127: 0
dev.em.7.mac_stats.rx_frames_128_255: 0
dev.em.7.mac_stats.rx_frames_256_511: 0
dev.em.7.mac_stats.rx_frames_512_1023: 0
dev.em.7.mac_stats.rx_frames_1024_1522: 0
dev.em.7.mac_stats.good_octets_recvd: 0
dev.em.7.mac_stats.good_octets_txd: 0
dev.em.7.mac_stats.total_pkts_txd: 0
dev.em.7.mac_stats.good_pkts_txd: 0
dev.em.7.mac_stats.bcast_pkts_txd: 0
dev.em.7.mac_stats.mcast_pkts_txd: 0
dev.em.7.mac_stats.tx_frames_64: 0
dev.em.7.mac_stats.tx_frames_65_127: 0
dev.em.7.mac_stats.tx_frames_128_255: 0
dev.em.7.mac_stats.tx_frames_256_511: 0
dev.em.7.mac_stats.tx_frames_512_1023: 0
dev.em.7.mac_stats.tx_frames_1024_1522: 0
dev.em.7.mac_stats.tso_txd: 0
dev.em.7.mac_stats.tso_ctx_fail: 0
dev.em.7.interrupts.asserts: 0
dev.em.7.interrupts.rx_pkt_timer: 0
dev.em.7.interrupts.rx_abs_timer: 0
dev.em.7.interrupts.tx_pkt_timer: 0
dev.em.7.interrupts.tx_abs_timer: 0
dev.em.7.interrupts.tx_queue_empty: 0
dev.em.7.interrupts.tx_queue_min_thresh: 0
dev.em.7.interrupts.rx_desc_min_thresh: 0
dev.em.7.interrupts.rx_overrun: 0

stephenw10

I have a box that is quite similar in many ways, same NICs, and I often use it as you do, without a switch. I too have all six em NICs bridged together. However I haven't done so recently as I'm using as a test box with 2.2. Thinking back I'm not sure if I ever had that arrangement with 2.1.1/2.
Interestingly I have experienced very similar behavior on that box but not on the em interfaces, on its one fxp NIC. That NIC will not negotiate a connection if it is powered up before the machine at the other end. In that case it was a harware (perhaps firmware) level issue where it would fail to negotiate a speed and duplex wiht the NIC at the other end resulting in no link. The link LED would flash intermittently as it tried and failed. It has no problem doing it it the other end is already powered up. I never found a good solution to it but you work around it by manually setting the link speed and duplex. Try that.

Steve

ESPNSTI

I have played around with nic settings on the connecting PC before, and that didn't seem to make a difference, but I will try that again.

I looked at some of the differences between the em drivers in 2.1.0 and 2.1.2.
In 2.1.2 the version is 7.3.8, I think 2.1.0 might be 7.3.2.
One thing I noticed is that the hw.em.eee_setting (Energy Efficient Ethernet) default might have changed.
It now seems to default to 1 and I think it defaulted to 0 before.
However I can't figure out by the somewhat cryptic code if that means it's now enabled or disabled.
Anyway, I set hw.em.eee_setting=0 in /boot/loader.conf.local and rebooted, but that unfortunately didn't fix it.

stephenw10

Damn that seems like a great suspect. The sysctl had changed after boot?

In my case you could see the NIC wasn't making a connection as ifconfig showed 'no carrier' I don't belive you're seeing that though.

Steve

ESPNSTI

After the reboot, sysctl did show eee_setting as 0.

Edit: I tried changing the link speed and duplex of the connecting PC, and that made no difference.

There are some tests included in the Windows nic driver that I ran, and during the time the problem occurs, they all succeed except for the connection test.

![Cable Test.gif](/public/imported_attachments/1/Cable Test.gif)
![Cable Test.gif_thumb](/public/imported_attachments/1/Cable Test.gif_thumb)
![Hardware Test.gif](/public/imported_attachments/1/Hardware Test.gif)
![Hardware Test.gif_thumb](/public/imported_attachments/1/Hardware Test.gif_thumb)