Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    2.1.1/2.1.2 - Unable to connect LAN from power off without firewall reboot

    Scheduled Pinned Locked Moved General pfSense Questions
    23 Posts 3 Posters 3.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • E
      ESPNSTI
      last edited by

      Packet captures on other interfaces don't show the missing ARP replies.

      I re-ran ifconfig, and it shows the same info as in the first post.

      However, I had success coaxing the connection back to life without a reboot.

      I ran "ifconfig em2 down" and "ifconfig em2 up" and I think that got it going again.
      However, I am not 100% sure, since I also played around with "ifconfig em2 -promisc" and "ifconfig em2 promisc", but nothing seemed to happen when I ran those.

      Edit:
      Tried it on a different PC, and it's the "ifconfig em3 up" after the "ifconfig em3 down" that does it.

      Here is the log, I ran the ifconfig commands at 07:22:09 and 07:22:13.
      It came back to life shortly after 07:22:13.

      Apr 21 07:22:19 	php: rc.newwanip: Interface does not have an IP address, nothing to do.
      Apr 21 07:22:19 	php: rc.newwanip: rc.newwanip: Informational is starting em3.
      Apr 21 07:22:16 	check_reload_status: rc.newwanip starting em3
      Apr 21 07:22:15 	php: rc.linkup: Hotplug event detected for OPT3(opt3) but ignoring since interface is configured with static IP ( )
      Apr 21 07:22:13 	php: rc.linkup: Hotplug event detected for OPT3(opt3) but ignoring since interface is configured with static IP ( )
      Apr 21 07:22:13 	check_reload_status: Linkup starting em3
      Apr 21 07:22:13 	kernel: em3: link state changed to UP
      Apr 21 07:22:09 	kernel: em3: link state changed to DOWN
      Apr 21 07:22:09 	check_reload_status: Linkup starting em3
      Apr 21 07:20:05 	php: rc.newwanip: Interface does not have an IP address, nothing to do.
      Apr 21 07:20:05 	php: rc.newwanip: rc.newwanip: Informational is starting em3.
      Apr 21 07:20:01 	check_reload_status: rc.newwanip starting em3
      Apr 21 07:20:00 	php: rc.linkup: Hotplug event detected for OPT3(opt3) but ignoring since interface is configured with static IP ( )
      Apr 21 07:19:57 	kernel: em3: link state changed to UP
      Apr 21 07:19:57 	check_reload_status: Linkup starting em3
      
      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        Hmm, interesting. I wonder why the interface stops responding yet nothing in the logs.  :-
        Can you bring the interface back by unplugging and re-plugging the cable?

        Steve

        1 Reply Last reply Reply Quote 0
        • E
          ESPNSTI
          last edited by

          When I tried it in the past, unplugging and re-plugging the cable didn't make a difference, neither did switching to a different port.
          I will try that again though next time.

          I am wondering if it's not some sort of sleep or power saving mode that is enabled in the 2.1.1 nic driver that isn't in 2.1.0 (if such a thing exists)?
          I haven't narrowed down the exact time threshold, but it seems consistent somewhere between 4 and 5 hours, so maybe it's some sort of sleep time setting (although I would think that would be much shorter).

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Good question. The em drivers were updated for 2.1.1 so that's a distinct possibility. What are the actual chips in the NICs you have? Anything relevant in hw.em? This looks a likely suspect:

            [2.1.2-RELEASE][root@pfsense.fire.box]/root(3): sysctl hw.em.smart_pwr_down
            hw.em.smart_pwr_down: 0
            

            Anything suspect in dev.em?

            Steve

            1 Reply Last reply Reply Quote 0
            • E
              ESPNSTI
              last edited by

              The nics are all Intel 82574L.

              $ sysctl hw.em
              hw.em.num_queues: 0
              hw.em.eee_setting: 1
              hw.em.rx_process_limit: 100
              hw.em.enable_msix: 1
              hw.em.sbp: 0
              hw.em.smart_pwr_down: 0
              hw.em.txd: 1024
              hw.em.rxd: 1024
              hw.em.rx_abs_int_delay: 66
              hw.em.tx_abs_int_delay: 66
              hw.em.rx_int_delay: 0
              hw.em.tx_int_delay: 66
              
              $ sysctl dev.em
              dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.0.%driver: em
              dev.em.0.%location: slot=0 function=0
              dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.0.%parent: pci5
              dev.em.0.nvm: -1
              dev.em.0.debug: -1
              dev.em.0.fc: 3
              dev.em.0.rx_int_delay: 0
              dev.em.0.tx_int_delay: 66
              dev.em.0.rx_abs_int_delay: 66
              dev.em.0.tx_abs_int_delay: 66
              dev.em.0.itr: 488
              dev.em.0.rx_processing_limit: 100
              dev.em.0.eee_control: 1
              dev.em.0.link_irq: 3
              dev.em.0.mbuf_alloc_fail: 0
              dev.em.0.cluster_alloc_fail: 0
              dev.em.0.dropped: 0
              dev.em.0.tx_dma_fail: 0
              dev.em.0.rx_overruns: 0
              dev.em.0.watchdog_timeouts: 0
              dev.em.0.device_control: 1074790984
              dev.em.0.rx_control: 67141658
              dev.em.0.fc_high_water: 18432
              dev.em.0.fc_low_water: 16932
              dev.em.0.queue0.txd_head: 66
              dev.em.0.queue0.txd_tail: 66
              dev.em.0.queue0.tx_irq: 1332941
              dev.em.0.queue0.no_desc_avail: 0
              dev.em.0.queue0.rxd_head: 543
              dev.em.0.queue0.rxd_tail: 542
              dev.em.0.queue0.rx_irq: 2110549
              dev.em.0.mac_stats.excess_coll: 0
              dev.em.0.mac_stats.single_coll: 0
              dev.em.0.mac_stats.multiple_coll: 0
              dev.em.0.mac_stats.late_coll: 0
              dev.em.0.mac_stats.collision_count: 0
              dev.em.0.mac_stats.symbol_errors: 0
              dev.em.0.mac_stats.sequence_errors: 0
              dev.em.0.mac_stats.defer_count: 0
              dev.em.0.mac_stats.missed_packets: 0
              dev.em.0.mac_stats.recv_no_buff: 0
              dev.em.0.mac_stats.recv_undersize: 0
              dev.em.0.mac_stats.recv_fragmented: 0
              dev.em.0.mac_stats.recv_oversize: 14
              dev.em.0.mac_stats.recv_jabber: 0
              dev.em.0.mac_stats.recv_errs: 1
              dev.em.0.mac_stats.crc_errs: 1616
              dev.em.0.mac_stats.alignment_errs: 0
              dev.em.0.mac_stats.coll_ext_errs: 0
              dev.em.0.mac_stats.xon_recvd: 0
              dev.em.0.mac_stats.xon_txd: 0
              dev.em.0.mac_stats.xoff_recvd: 0
              dev.em.0.mac_stats.xoff_txd: 0
              dev.em.0.mac_stats.total_pkts_recvd: 2601085
              dev.em.0.mac_stats.good_pkts_recvd: 2599455
              dev.em.0.mac_stats.bcast_pkts_recvd: 86896
              dev.em.0.mac_stats.mcast_pkts_recvd: 144132
              dev.em.0.mac_stats.rx_frames_64: 207244
              dev.em.0.mac_stats.rx_frames_65_127: 839440
              dev.em.0.mac_stats.rx_frames_128_255: 225214
              dev.em.0.mac_stats.rx_frames_256_511: 121557
              dev.em.0.mac_stats.rx_frames_512_1023: 43046
              dev.em.0.mac_stats.rx_frames_1024_1522: 1162954
              dev.em.0.mac_stats.good_octets_recvd: 1925347696
              dev.em.0.mac_stats.good_octets_txd: 265656113
              dev.em.0.mac_stats.total_pkts_txd: 2281444
              dev.em.0.mac_stats.good_pkts_txd: 2281444
              dev.em.0.mac_stats.bcast_pkts_txd: 19
              dev.em.0.mac_stats.mcast_pkts_txd: 5
              dev.em.0.mac_stats.tx_frames_64: 401078
              dev.em.0.mac_stats.tx_frames_65_127: 1682199
              dev.em.0.mac_stats.tx_frames_128_255: 59450
              dev.em.0.mac_stats.tx_frames_256_511: 57767
              dev.em.0.mac_stats.tx_frames_512_1023: 37172
              dev.em.0.mac_stats.tx_frames_1024_1522: 43778
              dev.em.0.mac_stats.tso_txd: 0
              dev.em.0.mac_stats.tso_ctx_fail: 0
              dev.em.0.interrupts.asserts: 5
              dev.em.0.interrupts.rx_pkt_timer: 0
              dev.em.0.interrupts.rx_abs_timer: 0
              dev.em.0.interrupts.tx_pkt_timer: 0
              dev.em.0.interrupts.tx_abs_timer: 0
              dev.em.0.interrupts.tx_queue_empty: 0
              dev.em.0.interrupts.tx_queue_min_thresh: 0
              dev.em.0.interrupts.rx_desc_min_thresh: 0
              dev.em.0.interrupts.rx_overrun: 0
              dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.1.%driver: em
              dev.em.1.%location: slot=0 function=0
              dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.1.%parent: pci6
              dev.em.1.nvm: -1
              dev.em.1.debug: -1
              dev.em.1.fc: 3
              dev.em.1.rx_int_delay: 0
              dev.em.1.tx_int_delay: 66
              dev.em.1.rx_abs_int_delay: 66
              dev.em.1.tx_abs_int_delay: 66
              dev.em.1.itr: 488
              dev.em.1.rx_processing_limit: 100
              dev.em.1.eee_control: 1
              dev.em.1.link_irq: 13
              dev.em.1.mbuf_alloc_fail: 0
              dev.em.1.cluster_alloc_fail: 0
              dev.em.1.dropped: 0
              dev.em.1.tx_dma_fail: 0
              dev.em.1.rx_overruns: 0
              dev.em.1.watchdog_timeouts: 0
              dev.em.1.device_control: 1477444168
              dev.em.1.rx_control: 67141658
              dev.em.1.fc_high_water: 18432
              dev.em.1.fc_low_water: 16932
              dev.em.1.queue0.txd_head: 829
              dev.em.1.queue0.txd_tail: 829
              dev.em.1.queue0.tx_irq: 1680542
              dev.em.1.queue0.no_desc_avail: 0
              dev.em.1.queue0.rxd_head: 18
              dev.em.1.queue0.rxd_tail: 17
              dev.em.1.queue0.rx_irq: 1377586
              dev.em.1.mac_stats.excess_coll: 0
              dev.em.1.mac_stats.single_coll: 0
              dev.em.1.mac_stats.multiple_coll: 0
              dev.em.1.mac_stats.late_coll: 0
              dev.em.1.mac_stats.collision_count: 0
              dev.em.1.mac_stats.symbol_errors: 0
              dev.em.1.mac_stats.sequence_errors: 0
              dev.em.1.mac_stats.defer_count: 0
              dev.em.1.mac_stats.missed_packets: 0
              dev.em.1.mac_stats.recv_no_buff: 0
              dev.em.1.mac_stats.recv_undersize: 0
              dev.em.1.mac_stats.recv_fragmented: 0
              dev.em.1.mac_stats.recv_oversize: 0
              dev.em.1.mac_stats.recv_jabber: 0
              dev.em.1.mac_stats.recv_errs: 0
              dev.em.1.mac_stats.crc_errs: 0
              dev.em.1.mac_stats.alignment_errs: 0
              dev.em.1.mac_stats.coll_ext_errs: 0
              dev.em.1.mac_stats.xon_recvd: 0
              dev.em.1.mac_stats.xon_txd: 0
              dev.em.1.mac_stats.xoff_recvd: 0
              dev.em.1.mac_stats.xoff_txd: 0
              dev.em.1.mac_stats.total_pkts_recvd: 6054930
              dev.em.1.mac_stats.good_pkts_recvd: 6054930
              dev.em.1.mac_stats.bcast_pkts_recvd: 814
              dev.em.1.mac_stats.mcast_pkts_recvd: 18
              dev.em.1.mac_stats.rx_frames_64: 3394973
              dev.em.1.mac_stats.rx_frames_65_127: 1581197
              dev.em.1.mac_stats.rx_frames_128_255: 145932
              dev.em.1.mac_stats.rx_frames_256_511: 68688
              dev.em.1.mac_stats.rx_frames_512_1023: 57308
              dev.em.1.mac_stats.rx_frames_1024_1522: 806832
              dev.em.1.mac_stats.good_octets_recvd: 1643667828
              dev.em.1.mac_stats.good_octets_txd: 10924986586
              dev.em.1.mac_stats.total_pkts_txd: 8607743
              dev.em.1.mac_stats.good_pkts_txd: 8607743
              dev.em.1.mac_stats.bcast_pkts_txd: 16764
              dev.em.1.mac_stats.mcast_pkts_txd: 8128
              dev.em.1.mac_stats.tx_frames_64: 435053
              dev.em.1.mac_stats.tx_frames_65_127: 621579
              dev.em.1.mac_stats.tx_frames_128_255: 326492
              dev.em.1.mac_stats.tx_frames_256_511: 104439
              dev.em.1.mac_stats.tx_frames_512_1023: 44603
              dev.em.1.mac_stats.tx_frames_1024_1522: 7075577
              dev.em.1.mac_stats.tso_txd: 0
              dev.em.1.mac_stats.tso_ctx_fail: 0
              dev.em.1.interrupts.asserts: 7
              dev.em.1.interrupts.rx_pkt_timer: 0
              dev.em.1.interrupts.rx_abs_timer: 0
              dev.em.1.interrupts.tx_pkt_timer: 0
              dev.em.1.interrupts.tx_abs_timer: 0
              dev.em.1.interrupts.tx_queue_empty: 0
              dev.em.1.interrupts.tx_queue_min_thresh: 0
              dev.em.1.interrupts.rx_desc_min_thresh: 0
              dev.em.1.interrupts.rx_overrun: 0
              dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.2.%driver: em
              dev.em.2.%location: slot=0 function=0
              dev.em.2.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.2.%parent: pci10
              dev.em.2.nvm: -1
              dev.em.2.debug: -1
              dev.em.2.fc: 3
              dev.em.2.rx_int_delay: 0
              dev.em.2.tx_int_delay: 66
              dev.em.2.rx_abs_int_delay: 66
              dev.em.2.tx_abs_int_delay: 66
              dev.em.2.itr: 488
              dev.em.2.rx_processing_limit: 100
              dev.em.2.eee_control: 1
              dev.em.2.link_irq: 57
              dev.em.2.mbuf_alloc_fail: 0
              dev.em.2.cluster_alloc_fail: 0
              dev.em.2.dropped: 0
              dev.em.2.tx_dma_fail: 0
              dev.em.2.rx_overruns: 0
              dev.em.2.watchdog_timeouts: 0
              dev.em.2.device_control: 1074790984
              dev.em.2.rx_control: 67141658
              dev.em.2.fc_high_water: 18432
              dev.em.2.fc_low_water: 16932
              dev.em.2.queue0.txd_head: 475
              dev.em.2.queue0.txd_tail: 475
              dev.em.2.queue0.tx_irq: 1314386
              dev.em.2.queue0.no_desc_avail: 4
              dev.em.2.queue0.rxd_head: 565
              dev.em.2.queue0.rxd_tail: 564
              dev.em.2.queue0.rx_irq: 1025355
              dev.em.2.mac_stats.excess_coll: 0
              dev.em.2.mac_stats.single_coll: 0
              dev.em.2.mac_stats.multiple_coll: 0
              dev.em.2.mac_stats.late_coll: 0
              dev.em.2.mac_stats.collision_count: 0
              dev.em.2.mac_stats.symbol_errors: 0
              dev.em.2.mac_stats.sequence_errors: 0
              dev.em.2.mac_stats.defer_count: 0
              dev.em.2.mac_stats.missed_packets: 0
              dev.em.2.mac_stats.recv_no_buff: 0
              dev.em.2.mac_stats.recv_undersize: 0
              dev.em.2.mac_stats.recv_fragmented: 0
              dev.em.2.mac_stats.recv_oversize: 0
              dev.em.2.mac_stats.recv_jabber: 0
              dev.em.2.mac_stats.recv_errs: 0
              dev.em.2.mac_stats.crc_errs: 0
              dev.em.2.mac_stats.alignment_errs: 0
              dev.em.2.mac_stats.coll_ext_errs: 0
              dev.em.2.mac_stats.xon_recvd: 0
              dev.em.2.mac_stats.xon_txd: 67
              dev.em.2.mac_stats.xoff_recvd: 0
              dev.em.2.mac_stats.xoff_txd: 67
              dev.em.2.mac_stats.total_pkts_recvd: 7579284
              dev.em.2.mac_stats.good_pkts_recvd: 7579284
              dev.em.2.mac_stats.bcast_pkts_recvd: 4056
              dev.em.2.mac_stats.mcast_pkts_recvd: 1894
              dev.em.2.mac_stats.rx_frames_64: 732927
              dev.em.2.mac_stats.rx_frames_65_127: 127308
              dev.em.2.mac_stats.rx_frames_128_255: 236522
              dev.em.2.mac_stats.rx_frames_256_511: 32858
              dev.em.2.mac_stats.rx_frames_512_1023: 70604
              dev.em.2.mac_stats.rx_frames_1024_1522: 6379065
              dev.em.2.mac_stats.good_octets_recvd: 9847640417
              dev.em.2.mac_stats.good_octets_txd: 2161810275
              dev.em.2.mac_stats.total_pkts_txd: 5162048
              dev.em.2.mac_stats.good_pkts_txd: 5161914
              dev.em.2.mac_stats.bcast_pkts_txd: 5818
              dev.em.2.mac_stats.mcast_pkts_txd: 3845
              dev.em.2.mac_stats.tx_frames_64: 3311268
              dev.em.2.mac_stats.tx_frames_65_127: 402284
              dev.em.2.mac_stats.tx_frames_128_255: 129308
              dev.em.2.mac_stats.tx_frames_256_511: 25539
              dev.em.2.mac_stats.tx_frames_512_1023: 92406
              dev.em.2.mac_stats.tx_frames_1024_1522: 1201109
              dev.em.2.mac_stats.tso_txd: 0
              dev.em.2.mac_stats.tso_ctx_fail: 0
              dev.em.2.interrupts.asserts: 36
              dev.em.2.interrupts.rx_pkt_timer: 0
              dev.em.2.interrupts.rx_abs_timer: 0
              dev.em.2.interrupts.tx_pkt_timer: 0
              dev.em.2.interrupts.tx_abs_timer: 0
              dev.em.2.interrupts.tx_queue_empty: 0
              dev.em.2.interrupts.tx_queue_min_thresh: 0
              dev.em.2.interrupts.rx_desc_min_thresh: 0
              dev.em.2.interrupts.rx_overrun: 0
              dev.em.3.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.3.%driver: em
              dev.em.3.%location: slot=0 function=0
              dev.em.3.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.3.%parent: pci11
              dev.em.3.nvm: -1
              dev.em.3.debug: -1
              dev.em.3.fc: 3
              dev.em.3.rx_int_delay: 0
              dev.em.3.tx_int_delay: 66
              dev.em.3.rx_abs_int_delay: 66
              dev.em.3.tx_abs_int_delay: 66
              dev.em.3.itr: 488
              dev.em.3.rx_processing_limit: 100
              dev.em.3.eee_control: 1
              dev.em.3.link_irq: 13
              dev.em.3.mbuf_alloc_fail: 0
              dev.em.3.cluster_alloc_fail: 0
              dev.em.3.dropped: 0
              dev.em.3.tx_dma_fail: 0
              dev.em.3.rx_overruns: 0
              dev.em.3.watchdog_timeouts: 0
              dev.em.3.device_control: 1074790984
              dev.em.3.rx_control: 67141658
              dev.em.3.fc_high_water: 18432
              dev.em.3.fc_low_water: 16932
              dev.em.3.queue0.txd_head: 386
              dev.em.3.queue0.txd_tail: 386
              dev.em.3.queue0.tx_irq: 276
              dev.em.3.queue0.no_desc_avail: 0
              dev.em.3.queue0.rxd_head: 218
              dev.em.3.queue0.rxd_tail: 217
              dev.em.3.queue0.rx_irq: 978
              dev.em.3.mac_stats.excess_coll: 0
              dev.em.3.mac_stats.single_coll: 0
              dev.em.3.mac_stats.multiple_coll: 0
              dev.em.3.mac_stats.late_coll: 0
              dev.em.3.mac_stats.collision_count: 0
              dev.em.3.mac_stats.symbol_errors: 0
              dev.em.3.mac_stats.sequence_errors: 0
              dev.em.3.mac_stats.defer_count: 0
              dev.em.3.mac_stats.missed_packets: 0
              dev.em.3.mac_stats.recv_no_buff: 0
              dev.em.3.mac_stats.recv_undersize: 0
              dev.em.3.mac_stats.recv_fragmented: 0
              dev.em.3.mac_stats.recv_oversize: 0
              dev.em.3.mac_stats.recv_jabber: 0
              dev.em.3.mac_stats.recv_errs: 0
              dev.em.3.mac_stats.crc_errs: 0
              dev.em.3.mac_stats.alignment_errs: 0
              dev.em.3.mac_stats.coll_ext_errs: 0
              dev.em.3.mac_stats.xon_recvd: 0
              dev.em.3.mac_stats.xon_txd: 0
              dev.em.3.mac_stats.xoff_recvd: 0
              dev.em.3.mac_stats.xoff_txd: 0
              dev.em.3.mac_stats.total_pkts_recvd: 979
              dev.em.3.mac_stats.good_pkts_recvd: 979
              dev.em.3.mac_stats.bcast_pkts_recvd: 616
              dev.em.3.mac_stats.mcast_pkts_recvd: 158
              dev.em.3.mac_stats.rx_frames_64: 63
              dev.em.3.mac_stats.rx_frames_65_127: 163
              dev.em.3.mac_stats.rx_frames_128_255: 112
              dev.em.3.mac_stats.rx_frames_256_511: 641
              dev.em.3.mac_stats.rx_frames_512_1023: 0
              dev.em.3.mac_stats.rx_frames_1024_1522: 0
              dev.em.3.mac_stats.good_octets_recvd: 255346
              dev.em.3.mac_stats.good_octets_txd: 55615
              dev.em.3.mac_stats.total_pkts_txd: 303
              dev.em.3.mac_stats.good_pkts_txd: 303
              dev.em.3.mac_stats.bcast_pkts_txd: 79
              dev.em.3.mac_stats.mcast_pkts_txd: 32
              dev.em.3.mac_stats.tx_frames_64: 32
              dev.em.3.mac_stats.tx_frames_65_127: 229
              dev.em.3.mac_stats.tx_frames_128_255: 9
              dev.em.3.mac_stats.tx_frames_256_511: 14
              dev.em.3.mac_stats.tx_frames_512_1023: 1
              dev.em.3.mac_stats.tx_frames_1024_1522: 18
              dev.em.3.mac_stats.tso_txd: 0
              dev.em.3.mac_stats.tso_ctx_fail: 0
              dev.em.3.interrupts.asserts: 9
              dev.em.3.interrupts.rx_pkt_timer: 0
              dev.em.3.interrupts.rx_abs_timer: 0
              dev.em.3.interrupts.tx_pkt_timer: 0
              dev.em.3.interrupts.tx_abs_timer: 0
              dev.em.3.interrupts.tx_queue_empty: 0
              dev.em.3.interrupts.tx_queue_min_thresh: 0
              dev.em.3.interrupts.rx_desc_min_thresh: 0
              dev.em.3.interrupts.rx_overrun: 0
              dev.em.4.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.4.%driver: em
              dev.em.4.%location: slot=0 function=0
              dev.em.4.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.4.%parent: pci15
              dev.em.4.nvm: -1
              dev.em.4.debug: -1
              dev.em.4.fc: 3
              dev.em.4.rx_int_delay: 0
              dev.em.4.tx_int_delay: 66
              dev.em.4.rx_abs_int_delay: 66
              dev.em.4.tx_abs_int_delay: 66
              dev.em.4.itr: 488
              dev.em.4.rx_processing_limit: 100
              dev.em.4.eee_control: 1
              dev.em.4.link_irq: 0
              dev.em.4.mbuf_alloc_fail: 0
              dev.em.4.cluster_alloc_fail: 0
              dev.em.4.dropped: 0
              dev.em.4.tx_dma_fail: 0
              dev.em.4.rx_overruns: 0
              dev.em.4.watchdog_timeouts: 0
              dev.em.4.device_control: 1074790984
              dev.em.4.rx_control: 67141658
              dev.em.4.fc_high_water: 18432
              dev.em.4.fc_low_water: 16932
              dev.em.4.queue0.txd_head: 0
              dev.em.4.queue0.txd_tail: 0
              dev.em.4.queue0.tx_irq: 0
              dev.em.4.queue0.no_desc_avail: 0
              dev.em.4.queue0.rxd_head: 0
              dev.em.4.queue0.rxd_tail: 1023
              dev.em.4.queue0.rx_irq: 0
              dev.em.4.mac_stats.excess_coll: 0
              dev.em.4.mac_stats.single_coll: 0
              dev.em.4.mac_stats.multiple_coll: 0
              dev.em.4.mac_stats.late_coll: 0
              dev.em.4.mac_stats.collision_count: 0
              dev.em.4.mac_stats.symbol_errors: 0
              dev.em.4.mac_stats.sequence_errors: 0
              dev.em.4.mac_stats.defer_count: 0
              dev.em.4.mac_stats.missed_packets: 0
              dev.em.4.mac_stats.recv_no_buff: 0
              dev.em.4.mac_stats.recv_undersize: 0
              dev.em.4.mac_stats.recv_fragmented: 0
              dev.em.4.mac_stats.recv_oversize: 0
              dev.em.4.mac_stats.recv_jabber: 0
              dev.em.4.mac_stats.recv_errs: 0
              dev.em.4.mac_stats.crc_errs: 0
              dev.em.4.mac_stats.alignment_errs: 0
              dev.em.4.mac_stats.coll_ext_errs: 0
              dev.em.4.mac_stats.xon_recvd: 0
              dev.em.4.mac_stats.xon_txd: 0
              dev.em.4.mac_stats.xoff_recvd: 0
              dev.em.4.mac_stats.xoff_txd: 0
              dev.em.4.mac_stats.total_pkts_recvd: 0
              dev.em.4.mac_stats.good_pkts_recvd: 0
              dev.em.4.mac_stats.bcast_pkts_recvd: 0
              dev.em.4.mac_stats.mcast_pkts_recvd: 0
              dev.em.4.mac_stats.rx_frames_64: 0
              dev.em.4.mac_stats.rx_frames_65_127: 0
              dev.em.4.mac_stats.rx_frames_128_255: 0
              dev.em.4.mac_stats.rx_frames_256_511: 0
              dev.em.4.mac_stats.rx_frames_512_1023: 0
              dev.em.4.mac_stats.rx_frames_1024_1522: 0
              dev.em.4.mac_stats.good_octets_recvd: 0
              dev.em.4.mac_stats.good_octets_txd: 0
              dev.em.4.mac_stats.total_pkts_txd: 0
              dev.em.4.mac_stats.good_pkts_txd: 0
              dev.em.4.mac_stats.bcast_pkts_txd: 0
              dev.em.4.mac_stats.mcast_pkts_txd: 0
              dev.em.4.mac_stats.tx_frames_64: 0
              dev.em.4.mac_stats.tx_frames_65_127: 0
              dev.em.4.mac_stats.tx_frames_128_255: 0
              dev.em.4.mac_stats.tx_frames_256_511: 0
              dev.em.4.mac_stats.tx_frames_512_1023: 0
              dev.em.4.mac_stats.tx_frames_1024_1522: 0
              dev.em.4.mac_stats.tso_txd: 0
              dev.em.4.mac_stats.tso_ctx_fail: 0
              dev.em.4.interrupts.asserts: 0
              dev.em.4.interrupts.rx_pkt_timer: 0
              dev.em.4.interrupts.rx_abs_timer: 0
              dev.em.4.interrupts.tx_pkt_timer: 0
              dev.em.4.interrupts.tx_abs_timer: 0
              dev.em.4.interrupts.tx_queue_empty: 0
              dev.em.4.interrupts.tx_queue_min_thresh: 0
              dev.em.4.interrupts.rx_desc_min_thresh: 0
              dev.em.4.interrupts.rx_overrun: 0
              dev.em.5.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.5.%driver: em
              dev.em.5.%location: slot=0 function=0
              dev.em.5.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.5.%parent: pci16
              dev.em.5.nvm: -1
              dev.em.5.debug: -1
              dev.em.5.fc: 3
              dev.em.5.rx_int_delay: 0
              dev.em.5.tx_int_delay: 66
              dev.em.5.rx_abs_int_delay: 66
              dev.em.5.tx_abs_int_delay: 66
              dev.em.5.itr: 488
              dev.em.5.rx_processing_limit: 100
              dev.em.5.eee_control: 1
              dev.em.5.link_irq: 14
              dev.em.5.mbuf_alloc_fail: 0
              dev.em.5.cluster_alloc_fail: 0
              dev.em.5.dropped: 0
              dev.em.5.tx_dma_fail: 0
              dev.em.5.rx_overruns: 0
              dev.em.5.watchdog_timeouts: 0
              dev.em.5.device_control: 1477444168
              dev.em.5.rx_control: 67141658
              dev.em.5.fc_high_water: 18432
              dev.em.5.fc_low_water: 16932
              dev.em.5.queue0.txd_head: 1015
              dev.em.5.queue0.txd_tail: 1015
              dev.em.5.queue0.tx_irq: 31244
              dev.em.5.queue0.no_desc_avail: 0
              dev.em.5.queue0.rxd_head: 771
              dev.em.5.queue0.rxd_tail: 770
              dev.em.5.queue0.rx_irq: 29384
              dev.em.5.mac_stats.excess_coll: 0
              dev.em.5.mac_stats.single_coll: 0
              dev.em.5.mac_stats.multiple_coll: 0
              dev.em.5.mac_stats.late_coll: 0
              dev.em.5.mac_stats.collision_count: 0
              dev.em.5.mac_stats.symbol_errors: 0
              dev.em.5.mac_stats.sequence_errors: 0
              dev.em.5.mac_stats.defer_count: 0
              dev.em.5.mac_stats.missed_packets: 0
              dev.em.5.mac_stats.recv_no_buff: 0
              dev.em.5.mac_stats.recv_undersize: 0
              dev.em.5.mac_stats.recv_fragmented: 0
              dev.em.5.mac_stats.recv_oversize: 0
              dev.em.5.mac_stats.recv_jabber: 0
              dev.em.5.mac_stats.recv_errs: 0
              dev.em.5.mac_stats.crc_errs: 0
              dev.em.5.mac_stats.alignment_errs: 0
              dev.em.5.mac_stats.coll_ext_errs: 0
              dev.em.5.mac_stats.xon_recvd: 0
              dev.em.5.mac_stats.xon_txd: 0
              dev.em.5.mac_stats.xoff_recvd: 0
              dev.em.5.mac_stats.xoff_txd: 0
              dev.em.5.mac_stats.total_pkts_recvd: 29443
              dev.em.5.mac_stats.good_pkts_recvd: 29443
              dev.em.5.mac_stats.bcast_pkts_recvd: 10091
              dev.em.5.mac_stats.mcast_pkts_recvd: 6055
              dev.em.5.mac_stats.rx_frames_64: 10733
              dev.em.5.mac_stats.rx_frames_65_127: 10674
              dev.em.5.mac_stats.rx_frames_128_255: 408
              dev.em.5.mac_stats.rx_frames_256_511: 6155
              dev.em.5.mac_stats.rx_frames_512_1023: 409
              dev.em.5.mac_stats.rx_frames_1024_1522: 1064
              dev.em.5.mac_stats.good_octets_recvd: 5941407
              dev.em.5.mac_stats.good_octets_txd: 5567151
              dev.em.5.mac_stats.total_pkts_txd: 31914
              dev.em.5.mac_stats.good_pkts_txd: 31914
              dev.em.5.mac_stats.bcast_pkts_txd: 7475
              dev.em.5.mac_stats.mcast_pkts_txd: 2087
              dev.em.5.mac_stats.tx_frames_64: 14358
              dev.em.5.mac_stats.tx_frames_65_127: 13797
              dev.em.5.mac_stats.tx_frames_128_255: 790
              dev.em.5.mac_stats.tx_frames_256_511: 681
              dev.em.5.mac_stats.tx_frames_512_1023: 274
              dev.em.5.mac_stats.tx_frames_1024_1522: 2014
              dev.em.5.mac_stats.tso_txd: 0
              dev.em.5.mac_stats.tso_ctx_fail: 0
              dev.em.5.interrupts.asserts: 9
              dev.em.5.interrupts.rx_pkt_timer: 0
              dev.em.5.interrupts.rx_abs_timer: 0
              dev.em.5.interrupts.tx_pkt_timer: 0
              dev.em.5.interrupts.tx_abs_timer: 0
              dev.em.5.interrupts.tx_queue_empty: 0
              dev.em.5.interrupts.tx_queue_min_thresh: 0
              dev.em.5.interrupts.rx_desc_min_thresh: 0
              dev.em.5.interrupts.rx_overrun: 0
              dev.em.6.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.6.%driver: em
              dev.em.6.%location: slot=0 function=0
              dev.em.6.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.6.%parent: pci17
              dev.em.6.nvm: -1
              dev.em.6.debug: -1
              dev.em.6.fc: 3
              dev.em.6.rx_int_delay: 0
              dev.em.6.tx_int_delay: 66
              dev.em.6.rx_abs_int_delay: 66
              dev.em.6.tx_abs_int_delay: 66
              dev.em.6.itr: 488
              dev.em.6.rx_processing_limit: 100
              dev.em.6.eee_control: 1
              dev.em.6.link_irq: 17
              dev.em.6.mbuf_alloc_fail: 0
              dev.em.6.cluster_alloc_fail: 0
              dev.em.6.dropped: 0
              dev.em.6.tx_dma_fail: 0
              dev.em.6.rx_overruns: 0
              dev.em.6.watchdog_timeouts: 0
              dev.em.6.device_control: 1477444168
              dev.em.6.rx_control: 67141658
              dev.em.6.fc_high_water: 18432
              dev.em.6.fc_low_water: 16932
              dev.em.6.queue0.txd_head: 817
              dev.em.6.queue0.txd_tail: 817
              dev.em.6.queue0.tx_irq: 81780
              dev.em.6.queue0.no_desc_avail: 0
              dev.em.6.queue0.rxd_head: 348
              dev.em.6.queue0.rxd_tail: 347
              dev.em.6.queue0.rx_irq: 36669
              dev.em.6.mac_stats.excess_coll: 0
              dev.em.6.mac_stats.single_coll: 0
              dev.em.6.mac_stats.multiple_coll: 0
              dev.em.6.mac_stats.late_coll: 0
              dev.em.6.mac_stats.collision_count: 0
              dev.em.6.mac_stats.symbol_errors: 0
              dev.em.6.mac_stats.sequence_errors: 0
              dev.em.6.mac_stats.defer_count: 0
              dev.em.6.mac_stats.missed_packets: 0
              dev.em.6.mac_stats.recv_no_buff: 0
              dev.em.6.mac_stats.recv_undersize: 0
              dev.em.6.mac_stats.recv_fragmented: 0
              dev.em.6.mac_stats.recv_oversize: 0
              dev.em.6.mac_stats.recv_jabber: 0
              dev.em.6.mac_stats.recv_errs: 0
              dev.em.6.mac_stats.crc_errs: 0
              dev.em.6.mac_stats.alignment_errs: 0
              dev.em.6.mac_stats.coll_ext_errs: 0
              dev.em.6.mac_stats.xon_recvd: 0
              dev.em.6.mac_stats.xon_txd: 0
              dev.em.6.mac_stats.xoff_recvd: 0
              dev.em.6.mac_stats.xoff_txd: 0
              dev.em.6.mac_stats.total_pkts_recvd: 40284
              dev.em.6.mac_stats.good_pkts_recvd: 40284
              dev.em.6.mac_stats.bcast_pkts_recvd: 420
              dev.em.6.mac_stats.mcast_pkts_recvd: 376
              dev.em.6.mac_stats.rx_frames_64: 28074
              dev.em.6.mac_stats.rx_frames_65_127: 8076
              dev.em.6.mac_stats.rx_frames_128_255: 927
              dev.em.6.mac_stats.rx_frames_256_511: 800
              dev.em.6.mac_stats.rx_frames_512_1023: 843
              dev.em.6.mac_stats.rx_frames_1024_1522: 1564
              dev.em.6.mac_stats.good_octets_recvd: 5925684
              dev.em.6.mac_stats.good_octets_txd: 87073020
              dev.em.6.mac_stats.total_pkts_txd: 88589
              dev.em.6.mac_stats.good_pkts_txd: 88589
              dev.em.6.mac_stats.bcast_pkts_txd: 17191
              dev.em.6.mac_stats.mcast_pkts_txd: 7828
              dev.em.6.mac_stats.tx_frames_64: 15737
              dev.em.6.mac_stats.tx_frames_65_127: 8968
              dev.em.6.mac_stats.tx_frames_128_255: 2483
              dev.em.6.mac_stats.tx_frames_256_511: 6989
              dev.em.6.mac_stats.tx_frames_512_1023: 704
              dev.em.6.mac_stats.tx_frames_1024_1522: 53708
              dev.em.6.mac_stats.tso_txd: 0
              dev.em.6.mac_stats.tso_ctx_fail: 0
              dev.em.6.interrupts.asserts: 11
              dev.em.6.interrupts.rx_pkt_timer: 0
              dev.em.6.interrupts.rx_abs_timer: 0
              dev.em.6.interrupts.tx_pkt_timer: 0
              dev.em.6.interrupts.tx_abs_timer: 0
              dev.em.6.interrupts.tx_queue_empty: 0
              dev.em.6.interrupts.tx_queue_min_thresh: 0
              dev.em.6.interrupts.rx_desc_min_thresh: 0
              dev.em.6.interrupts.rx_overrun: 0
              dev.em.7.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
              dev.em.7.%driver: em
              dev.em.7.%location: slot=0 function=0
              dev.em.7.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
              dev.em.7.%parent: pci18
              dev.em.7.nvm: -1
              dev.em.7.debug: -1
              dev.em.7.fc: 3
              dev.em.7.rx_int_delay: 0
              dev.em.7.tx_int_delay: 66
              dev.em.7.rx_abs_int_delay: 66
              dev.em.7.tx_abs_int_delay: 66
              dev.em.7.itr: 488
              dev.em.7.rx_processing_limit: 100
              dev.em.7.eee_control: 1
              dev.em.7.link_irq: 0
              dev.em.7.mbuf_alloc_fail: 0
              dev.em.7.cluster_alloc_fail: 0
              dev.em.7.dropped: 0
              dev.em.7.tx_dma_fail: 0
              dev.em.7.rx_overruns: 0
              dev.em.7.watchdog_timeouts: 0
              dev.em.7.device_control: 1074790984
              dev.em.7.rx_control: 67141658
              dev.em.7.fc_high_water: 18432
              dev.em.7.fc_low_water: 16932
              dev.em.7.queue0.txd_head: 0
              dev.em.7.queue0.txd_tail: 0
              dev.em.7.queue0.tx_irq: 0
              dev.em.7.queue0.no_desc_avail: 0
              dev.em.7.queue0.rxd_head: 0
              dev.em.7.queue0.rxd_tail: 1023
              dev.em.7.queue0.rx_irq: 0
              dev.em.7.mac_stats.excess_coll: 0
              dev.em.7.mac_stats.single_coll: 0
              dev.em.7.mac_stats.multiple_coll: 0
              dev.em.7.mac_stats.late_coll: 0
              dev.em.7.mac_stats.collision_count: 0
              dev.em.7.mac_stats.symbol_errors: 0
              dev.em.7.mac_stats.sequence_errors: 0
              dev.em.7.mac_stats.defer_count: 0
              dev.em.7.mac_stats.missed_packets: 0
              dev.em.7.mac_stats.recv_no_buff: 0
              dev.em.7.mac_stats.recv_undersize: 0
              dev.em.7.mac_stats.recv_fragmented: 0
              dev.em.7.mac_stats.recv_oversize: 0
              dev.em.7.mac_stats.recv_jabber: 0
              dev.em.7.mac_stats.recv_errs: 0
              dev.em.7.mac_stats.crc_errs: 0
              dev.em.7.mac_stats.alignment_errs: 0
              dev.em.7.mac_stats.coll_ext_errs: 0
              dev.em.7.mac_stats.xon_recvd: 0
              dev.em.7.mac_stats.xon_txd: 0
              dev.em.7.mac_stats.xoff_recvd: 0
              dev.em.7.mac_stats.xoff_txd: 0
              dev.em.7.mac_stats.total_pkts_recvd: 0
              dev.em.7.mac_stats.good_pkts_recvd: 0
              dev.em.7.mac_stats.bcast_pkts_recvd: 0
              dev.em.7.mac_stats.mcast_pkts_recvd: 0
              dev.em.7.mac_stats.rx_frames_64: 0
              dev.em.7.mac_stats.rx_frames_65_127: 0
              dev.em.7.mac_stats.rx_frames_128_255: 0
              dev.em.7.mac_stats.rx_frames_256_511: 0
              dev.em.7.mac_stats.rx_frames_512_1023: 0
              dev.em.7.mac_stats.rx_frames_1024_1522: 0
              dev.em.7.mac_stats.good_octets_recvd: 0
              dev.em.7.mac_stats.good_octets_txd: 0
              dev.em.7.mac_stats.total_pkts_txd: 0
              dev.em.7.mac_stats.good_pkts_txd: 0
              dev.em.7.mac_stats.bcast_pkts_txd: 0
              dev.em.7.mac_stats.mcast_pkts_txd: 0
              dev.em.7.mac_stats.tx_frames_64: 0
              dev.em.7.mac_stats.tx_frames_65_127: 0
              dev.em.7.mac_stats.tx_frames_128_255: 0
              dev.em.7.mac_stats.tx_frames_256_511: 0
              dev.em.7.mac_stats.tx_frames_512_1023: 0
              dev.em.7.mac_stats.tx_frames_1024_1522: 0
              dev.em.7.mac_stats.tso_txd: 0
              dev.em.7.mac_stats.tso_ctx_fail: 0
              dev.em.7.interrupts.asserts: 0
              dev.em.7.interrupts.rx_pkt_timer: 0
              dev.em.7.interrupts.rx_abs_timer: 0
              dev.em.7.interrupts.tx_pkt_timer: 0
              dev.em.7.interrupts.tx_abs_timer: 0
              dev.em.7.interrupts.tx_queue_empty: 0
              dev.em.7.interrupts.tx_queue_min_thresh: 0
              dev.em.7.interrupts.rx_desc_min_thresh: 0
              dev.em.7.interrupts.rx_overrun: 0
              

              I'm not sure what to watch for.
              FYI, this was not taken while the problem was occurring.

              1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                Hmm, very common NIC so should be reported if it was a driver issue.
                You have a lot of CRC errors on em0. Which interface is giving trouble?
                Try to get a set of data when it's stopped responding.

                Steve

                1 Reply Last reply Reply Quote 0
                • E
                  ESPNSTI
                  last edited by

                  The nic may be common, but perhaps not a lot of people use pfsense the way I do?
                  Meaning, directly connecting PCs to the pfSense box rather than having a switch in the middle, in combination with completely unplugging the PC rather than leaving it powered off, but not unplugged.

                  My main PC is connected to em2, but I have reproduced the problem with it connected to other interfaces and with other PCs on other interfaces.

                  My WAN interface is em0, which is connected using WiMAX, don't  know if that explains the number of CRC errors or not.

                  I will try to get dev.em data the next time the problem happens.

                  Edit:

                  I tried unplugging and re-plugging the connection, that does not seem to solve the problem, but ifconfig em2 down followed by ifconfig em2 up does.

                  Here is the dev.em data while the problem happens:

                  $ sysctl dev.em
                  dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.0.%driver: em
                  dev.em.0.%location: slot=0 function=0
                  dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.0.%parent: pci5
                  dev.em.0.nvm: -1
                  dev.em.0.debug: -1
                  dev.em.0.fc: 3
                  dev.em.0.rx_int_delay: 0
                  dev.em.0.tx_int_delay: 66
                  dev.em.0.rx_abs_int_delay: 66
                  dev.em.0.tx_abs_int_delay: 66
                  dev.em.0.itr: 488
                  dev.em.0.rx_processing_limit: 100
                  dev.em.0.eee_control: 1
                  dev.em.0.link_irq: 3
                  dev.em.0.mbuf_alloc_fail: 0
                  dev.em.0.cluster_alloc_fail: 0
                  dev.em.0.dropped: 0
                  dev.em.0.tx_dma_fail: 0
                  dev.em.0.rx_overruns: 0
                  dev.em.0.watchdog_timeouts: 0
                  dev.em.0.device_control: 1074790984
                  dev.em.0.rx_control: 67141658
                  dev.em.0.fc_high_water: 18432
                  dev.em.0.fc_low_water: 16932
                  dev.em.0.queue0.txd_head: 955
                  dev.em.0.queue0.txd_tail: 955
                  dev.em.0.queue0.tx_irq: 1353023
                  dev.em.0.queue0.no_desc_avail: 0
                  dev.em.0.queue0.rxd_head: 646
                  dev.em.0.queue0.rxd_tail: 645
                  dev.em.0.queue0.rx_irq: 2194821
                  dev.em.0.mac_stats.excess_coll: 0
                  dev.em.0.mac_stats.single_coll: 0
                  dev.em.0.mac_stats.multiple_coll: 0
                  dev.em.0.mac_stats.late_coll: 0
                  dev.em.0.mac_stats.collision_count: 0
                  dev.em.0.mac_stats.symbol_errors: 0
                  dev.em.0.mac_stats.sequence_errors: 0
                  dev.em.0.mac_stats.defer_count: 0
                  dev.em.0.mac_stats.missed_packets: 0
                  dev.em.0.mac_stats.recv_no_buff: 0
                  dev.em.0.mac_stats.recv_undersize: 0
                  dev.em.0.mac_stats.recv_fragmented: 0
                  dev.em.0.mac_stats.recv_oversize: 14
                  dev.em.0.mac_stats.recv_jabber: 0
                  dev.em.0.mac_stats.recv_errs: 1
                  dev.em.0.mac_stats.crc_errs: 1858
                  dev.em.0.mac_stats.alignment_errs: 0
                  dev.em.0.mac_stats.coll_ext_errs: 0
                  dev.em.0.mac_stats.xon_recvd: 0
                  dev.em.0.mac_stats.xon_txd: 0
                  dev.em.0.mac_stats.xoff_recvd: 0
                  dev.em.0.mac_stats.xoff_txd: 0
                  dev.em.0.mac_stats.total_pkts_recvd: 2693590
                  dev.em.0.mac_stats.good_pkts_recvd: 2691718
                  dev.em.0.mac_stats.bcast_pkts_recvd: 114676
                  dev.em.0.mac_stats.mcast_pkts_recvd: 169968
                  dev.em.0.mac_stats.rx_frames_64: 230759
                  dev.em.0.mac_stats.rx_frames_65_127: 881015
                  dev.em.0.mac_stats.rx_frames_128_255: 240095
                  dev.em.0.mac_stats.rx_frames_256_511: 127210
                  dev.em.0.mac_stats.rx_frames_512_1023: 43897
                  dev.em.0.mac_stats.rx_frames_1024_1522: 1168742
                  dev.em.0.mac_stats.good_octets_recvd: 1944245208
                  dev.em.0.mac_stats.good_octets_txd: 267430581
                  dev.em.0.mac_stats.total_pkts_txd: 2301786
                  dev.em.0.mac_stats.good_pkts_txd: 2301786
                  dev.em.0.mac_stats.bcast_pkts_txd: 21
                  dev.em.0.mac_stats.mcast_pkts_txd: 5
                  dev.em.0.mac_stats.tx_frames_64: 401303
                  dev.em.0.mac_stats.tx_frames_65_127: 1701968
                  dev.em.0.mac_stats.tx_frames_128_255: 59555
                  dev.em.0.mac_stats.tx_frames_256_511: 57933
                  dev.em.0.mac_stats.tx_frames_512_1023: 37200
                  dev.em.0.mac_stats.tx_frames_1024_1522: 43827
                  dev.em.0.mac_stats.tso_txd: 0
                  dev.em.0.mac_stats.tso_ctx_fail: 0
                  dev.em.0.interrupts.asserts: 5
                  dev.em.0.interrupts.rx_pkt_timer: 0
                  dev.em.0.interrupts.rx_abs_timer: 0
                  dev.em.0.interrupts.tx_pkt_timer: 0
                  dev.em.0.interrupts.tx_abs_timer: 0
                  dev.em.0.interrupts.tx_queue_empty: 0
                  dev.em.0.interrupts.tx_queue_min_thresh: 0
                  dev.em.0.interrupts.rx_desc_min_thresh: 0
                  dev.em.0.interrupts.rx_overrun: 0
                  dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.1.%driver: em
                  dev.em.1.%location: slot=0 function=0
                  dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.1.%parent: pci6
                  dev.em.1.nvm: -1
                  dev.em.1.debug: -1
                  dev.em.1.fc: 3
                  dev.em.1.rx_int_delay: 0
                  dev.em.1.tx_int_delay: 66
                  dev.em.1.rx_abs_int_delay: 66
                  dev.em.1.tx_abs_int_delay: 66
                  dev.em.1.itr: 488
                  dev.em.1.rx_processing_limit: 100
                  dev.em.1.eee_control: 1
                  dev.em.1.link_irq: 22
                  dev.em.1.mbuf_alloc_fail: 0
                  dev.em.1.cluster_alloc_fail: 0
                  dev.em.1.dropped: 0
                  dev.em.1.tx_dma_fail: 0
                  dev.em.1.rx_overruns: 0
                  dev.em.1.watchdog_timeouts: 0
                  dev.em.1.device_control: 1477444168
                  dev.em.1.rx_control: 67141658
                  dev.em.1.fc_high_water: 18432
                  dev.em.1.fc_low_water: 16932
                  dev.em.1.queue0.txd_head: 112
                  dev.em.1.queue0.txd_tail: 112
                  dev.em.1.queue0.tx_irq: 1690961
                  dev.em.1.queue0.no_desc_avail: 0
                  dev.em.1.queue0.rxd_head: 37
                  dev.em.1.queue0.rxd_tail: 36
                  dev.em.1.queue0.rx_irq: 1381555
                  dev.em.1.mac_stats.excess_coll: 0
                  dev.em.1.mac_stats.single_coll: 0
                  dev.em.1.mac_stats.multiple_coll: 0
                  dev.em.1.mac_stats.late_coll: 0
                  dev.em.1.mac_stats.collision_count: 0
                  dev.em.1.mac_stats.symbol_errors: 0
                  dev.em.1.mac_stats.sequence_errors: 0
                  dev.em.1.mac_stats.defer_count: 0
                  dev.em.1.mac_stats.missed_packets: 0
                  dev.em.1.mac_stats.recv_no_buff: 0
                  dev.em.1.mac_stats.recv_undersize: 0
                  dev.em.1.mac_stats.recv_fragmented: 0
                  dev.em.1.mac_stats.recv_oversize: 0
                  dev.em.1.mac_stats.recv_jabber: 0
                  dev.em.1.mac_stats.recv_errs: 0
                  dev.em.1.mac_stats.crc_errs: 0
                  dev.em.1.mac_stats.alignment_errs: 0
                  dev.em.1.mac_stats.coll_ext_errs: 0
                  dev.em.1.mac_stats.xon_recvd: 0
                  dev.em.1.mac_stats.xon_txd: 0
                  dev.em.1.mac_stats.xoff_recvd: 0
                  dev.em.1.mac_stats.xoff_txd: 0
                  dev.em.1.mac_stats.total_pkts_recvd: 6059045
                  dev.em.1.mac_stats.good_pkts_recvd: 6059045
                  dev.em.1.mac_stats.bcast_pkts_recvd: 1001
                  dev.em.1.mac_stats.mcast_pkts_recvd: 36
                  dev.em.1.mac_stats.rx_frames_64: 3395197
                  dev.em.1.mac_stats.rx_frames_65_127: 1584918
                  dev.em.1.mac_stats.rx_frames_128_255: 146033
                  dev.em.1.mac_stats.rx_frames_256_511: 68732
                  dev.em.1.mac_stats.rx_frames_512_1023: 57333
                  dev.em.1.mac_stats.rx_frames_1024_1522: 806832
                  dev.em.1.mac_stats.good_octets_recvd: 1644008445
                  dev.em.1.mac_stats.good_octets_txd: 10934359364
                  dev.em.1.mac_stats.total_pkts_txd: 8618288
                  dev.em.1.mac_stats.good_pkts_txd: 8618288
                  dev.em.1.mac_stats.bcast_pkts_txd: 20285
                  dev.em.1.mac_stats.mcast_pkts_txd: 9084
                  dev.em.1.mac_stats.tx_frames_64: 438597
                  dev.em.1.mac_stats.tx_frames_65_127: 621818
                  dev.em.1.mac_stats.tx_frames_128_255: 326533
                  dev.em.1.mac_stats.tx_frames_256_511: 105392
                  dev.em.1.mac_stats.tx_frames_512_1023: 44645
                  dev.em.1.mac_stats.tx_frames_1024_1522: 7081303
                  dev.em.1.mac_stats.tso_txd: 0
                  dev.em.1.mac_stats.tso_ctx_fail: 0
                  dev.em.1.interrupts.asserts: 13
                  dev.em.1.interrupts.rx_pkt_timer: 0
                  dev.em.1.interrupts.rx_abs_timer: 0
                  dev.em.1.interrupts.tx_pkt_timer: 0
                  dev.em.1.interrupts.tx_abs_timer: 0
                  dev.em.1.interrupts.tx_queue_empty: 0
                  dev.em.1.interrupts.tx_queue_min_thresh: 0
                  dev.em.1.interrupts.rx_desc_min_thresh: 0
                  dev.em.1.interrupts.rx_overrun: 0
                  dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.2.%driver: em
                  dev.em.2.%location: slot=0 function=0
                  dev.em.2.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.2.%parent: pci10
                  dev.em.2.nvm: -1
                  dev.em.2.debug: -1
                  dev.em.2.fc: 3
                  dev.em.2.rx_int_delay: 0
                  dev.em.2.tx_int_delay: 66
                  dev.em.2.rx_abs_int_delay: 66
                  dev.em.2.tx_abs_int_delay: 66
                  dev.em.2.itr: 488
                  dev.em.2.rx_processing_limit: 100
                  dev.em.2.eee_control: 1
                  dev.em.2.link_irq: 65
                  dev.em.2.mbuf_alloc_fail: 0
                  dev.em.2.cluster_alloc_fail: 0
                  dev.em.2.dropped: 0
                  dev.em.2.tx_dma_fail: 0
                  dev.em.2.rx_overruns: 0
                  dev.em.2.watchdog_timeouts: 0
                  dev.em.2.device_control: 1477444168
                  dev.em.2.rx_control: 67141658
                  dev.em.2.fc_high_water: 18432
                  dev.em.2.fc_low_water: 16932
                  dev.em.2.queue0.txd_head: 475
                  dev.em.2.queue0.txd_tail: 475
                  dev.em.2.queue0.tx_irq: 1314386
                  dev.em.2.queue0.no_desc_avail: 4
                  dev.em.2.queue0.rxd_head: 737
                  dev.em.2.queue0.rxd_tail: 736
                  dev.em.2.queue0.rx_irq: 1025527
                  dev.em.2.mac_stats.excess_coll: 0
                  dev.em.2.mac_stats.single_coll: 0
                  dev.em.2.mac_stats.multiple_coll: 0
                  dev.em.2.mac_stats.late_coll: 0
                  dev.em.2.mac_stats.collision_count: 0
                  dev.em.2.mac_stats.symbol_errors: 0
                  dev.em.2.mac_stats.sequence_errors: 0
                  dev.em.2.mac_stats.defer_count: 0
                  dev.em.2.mac_stats.missed_packets: 0
                  dev.em.2.mac_stats.recv_no_buff: 0
                  dev.em.2.mac_stats.recv_undersize: 0
                  dev.em.2.mac_stats.recv_fragmented: 0
                  dev.em.2.mac_stats.recv_oversize: 0
                  dev.em.2.mac_stats.recv_jabber: 0
                  dev.em.2.mac_stats.recv_errs: 0
                  dev.em.2.mac_stats.crc_errs: 0
                  dev.em.2.mac_stats.alignment_errs: 0
                  dev.em.2.mac_stats.coll_ext_errs: 0
                  dev.em.2.mac_stats.xon_recvd: 0
                  dev.em.2.mac_stats.xon_txd: 67
                  dev.em.2.mac_stats.xoff_recvd: 0
                  dev.em.2.mac_stats.xoff_txd: 67
                  dev.em.2.mac_stats.total_pkts_recvd: 7579455
                  dev.em.2.mac_stats.good_pkts_recvd: 7579455
                  dev.em.2.mac_stats.bcast_pkts_recvd: 4221
                  dev.em.2.mac_stats.mcast_pkts_recvd: 1900
                  dev.em.2.mac_stats.rx_frames_64: 733094
                  dev.em.2.mac_stats.rx_frames_65_127: 127312
                  dev.em.2.mac_stats.rx_frames_128_255: 236522
                  dev.em.2.mac_stats.rx_frames_256_511: 32858
                  dev.em.2.mac_stats.rx_frames_512_1023: 70604
                  dev.em.2.mac_stats.rx_frames_1024_1522: 6379065
                  dev.em.2.mac_stats.good_octets_recvd: 9847651473
                  dev.em.2.mac_stats.good_octets_txd: 2161810275
                  dev.em.2.mac_stats.total_pkts_txd: 5162048
                  dev.em.2.mac_stats.good_pkts_txd: 5161914
                  dev.em.2.mac_stats.bcast_pkts_txd: 5818
                  dev.em.2.mac_stats.mcast_pkts_txd: 3845
                  dev.em.2.mac_stats.tx_frames_64: 3311268
                  dev.em.2.mac_stats.tx_frames_65_127: 402284
                  dev.em.2.mac_stats.tx_frames_128_255: 129308
                  dev.em.2.mac_stats.tx_frames_256_511: 25539
                  dev.em.2.mac_stats.tx_frames_512_1023: 92406
                  dev.em.2.mac_stats.tx_frames_1024_1522: 1201109
                  dev.em.2.mac_stats.tso_txd: 0
                  dev.em.2.mac_stats.tso_ctx_fail: 0
                  dev.em.2.interrupts.asserts: 41
                  dev.em.2.interrupts.rx_pkt_timer: 0
                  dev.em.2.interrupts.rx_abs_timer: 0
                  dev.em.2.interrupts.tx_pkt_timer: 0
                  dev.em.2.interrupts.tx_abs_timer: 0
                  dev.em.2.interrupts.tx_queue_empty: 0
                  dev.em.2.interrupts.tx_queue_min_thresh: 0
                  dev.em.2.interrupts.rx_desc_min_thresh: 0
                  dev.em.2.interrupts.rx_overrun: 0
                  dev.em.3.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.3.%driver: em
                  dev.em.3.%location: slot=0 function=0
                  dev.em.3.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.3.%parent: pci11
                  dev.em.3.nvm: -1
                  dev.em.3.debug: -1
                  dev.em.3.fc: 3
                  dev.em.3.rx_int_delay: 0
                  dev.em.3.tx_int_delay: 66
                  dev.em.3.rx_abs_int_delay: 66
                  dev.em.3.tx_abs_int_delay: 66
                  dev.em.3.itr: 488
                  dev.em.3.rx_processing_limit: 100
                  dev.em.3.eee_control: 1
                  dev.em.3.link_irq: 13
                  dev.em.3.mbuf_alloc_fail: 0
                  dev.em.3.cluster_alloc_fail: 0
                  dev.em.3.dropped: 0
                  dev.em.3.tx_dma_fail: 0
                  dev.em.3.rx_overruns: 0
                  dev.em.3.watchdog_timeouts: 0
                  dev.em.3.device_control: 1074790984
                  dev.em.3.rx_control: 67141658
                  dev.em.3.fc_high_water: 18432
                  dev.em.3.fc_low_water: 16932
                  dev.em.3.queue0.txd_head: 386
                  dev.em.3.queue0.txd_tail: 386
                  dev.em.3.queue0.tx_irq: 276
                  dev.em.3.queue0.no_desc_avail: 0
                  dev.em.3.queue0.rxd_head: 218
                  dev.em.3.queue0.rxd_tail: 217
                  dev.em.3.queue0.rx_irq: 978
                  dev.em.3.mac_stats.excess_coll: 0
                  dev.em.3.mac_stats.single_coll: 0
                  dev.em.3.mac_stats.multiple_coll: 0
                  dev.em.3.mac_stats.late_coll: 0
                  dev.em.3.mac_stats.collision_count: 0
                  dev.em.3.mac_stats.symbol_errors: 0
                  dev.em.3.mac_stats.sequence_errors: 0
                  dev.em.3.mac_stats.defer_count: 0
                  dev.em.3.mac_stats.missed_packets: 0
                  dev.em.3.mac_stats.recv_no_buff: 0
                  dev.em.3.mac_stats.recv_undersize: 0
                  dev.em.3.mac_stats.recv_fragmented: 0
                  dev.em.3.mac_stats.recv_oversize: 0
                  dev.em.3.mac_stats.recv_jabber: 0
                  dev.em.3.mac_stats.recv_errs: 0
                  dev.em.3.mac_stats.crc_errs: 0
                  dev.em.3.mac_stats.alignment_errs: 0
                  dev.em.3.mac_stats.coll_ext_errs: 0
                  dev.em.3.mac_stats.xon_recvd: 0
                  dev.em.3.mac_stats.xon_txd: 0
                  dev.em.3.mac_stats.xoff_recvd: 0
                  dev.em.3.mac_stats.xoff_txd: 0
                  dev.em.3.mac_stats.total_pkts_recvd: 979
                  dev.em.3.mac_stats.good_pkts_recvd: 979
                  dev.em.3.mac_stats.bcast_pkts_recvd: 616
                  dev.em.3.mac_stats.mcast_pkts_recvd: 158
                  dev.em.3.mac_stats.rx_frames_64: 63
                  dev.em.3.mac_stats.rx_frames_65_127: 163
                  dev.em.3.mac_stats.rx_frames_128_255: 112
                  dev.em.3.mac_stats.rx_frames_256_511: 641
                  dev.em.3.mac_stats.rx_frames_512_1023: 0
                  dev.em.3.mac_stats.rx_frames_1024_1522: 0
                  dev.em.3.mac_stats.good_octets_recvd: 255346
                  dev.em.3.mac_stats.good_octets_txd: 55615
                  dev.em.3.mac_stats.total_pkts_txd: 303
                  dev.em.3.mac_stats.good_pkts_txd: 303
                  dev.em.3.mac_stats.bcast_pkts_txd: 79
                  dev.em.3.mac_stats.mcast_pkts_txd: 32
                  dev.em.3.mac_stats.tx_frames_64: 32
                  dev.em.3.mac_stats.tx_frames_65_127: 229
                  dev.em.3.mac_stats.tx_frames_128_255: 9
                  dev.em.3.mac_stats.tx_frames_256_511: 14
                  dev.em.3.mac_stats.tx_frames_512_1023: 1
                  dev.em.3.mac_stats.tx_frames_1024_1522: 18
                  dev.em.3.mac_stats.tso_txd: 0
                  dev.em.3.mac_stats.tso_ctx_fail: 0
                  dev.em.3.interrupts.asserts: 9
                  dev.em.3.interrupts.rx_pkt_timer: 0
                  dev.em.3.interrupts.rx_abs_timer: 0
                  dev.em.3.interrupts.tx_pkt_timer: 0
                  dev.em.3.interrupts.tx_abs_timer: 0
                  dev.em.3.interrupts.tx_queue_empty: 0
                  dev.em.3.interrupts.tx_queue_min_thresh: 0
                  dev.em.3.interrupts.rx_desc_min_thresh: 0
                  dev.em.3.interrupts.rx_overrun: 0
                  dev.em.4.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.4.%driver: em
                  dev.em.4.%location: slot=0 function=0
                  dev.em.4.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.4.%parent: pci15
                  dev.em.4.nvm: -1
                  dev.em.4.debug: -1
                  dev.em.4.fc: 3
                  dev.em.4.rx_int_delay: 0
                  dev.em.4.tx_int_delay: 66
                  dev.em.4.rx_abs_int_delay: 66
                  dev.em.4.tx_abs_int_delay: 66
                  dev.em.4.itr: 488
                  dev.em.4.rx_processing_limit: 100
                  dev.em.4.eee_control: 1
                  dev.em.4.link_irq: 0
                  dev.em.4.mbuf_alloc_fail: 0
                  dev.em.4.cluster_alloc_fail: 0
                  dev.em.4.dropped: 0
                  dev.em.4.tx_dma_fail: 0
                  dev.em.4.rx_overruns: 0
                  dev.em.4.watchdog_timeouts: 0
                  dev.em.4.device_control: 1074790984
                  dev.em.4.rx_control: 67141658
                  dev.em.4.fc_high_water: 18432
                  dev.em.4.fc_low_water: 16932
                  dev.em.4.queue0.txd_head: 0
                  dev.em.4.queue0.txd_tail: 0
                  dev.em.4.queue0.tx_irq: 0
                  dev.em.4.queue0.no_desc_avail: 0
                  dev.em.4.queue0.rxd_head: 0
                  dev.em.4.queue0.rxd_tail: 1023
                  dev.em.4.queue0.rx_irq: 0
                  dev.em.4.mac_stats.excess_coll: 0
                  dev.em.4.mac_stats.single_coll: 0
                  dev.em.4.mac_stats.multiple_coll: 0
                  dev.em.4.mac_stats.late_coll: 0
                  dev.em.4.mac_stats.collision_count: 0
                  dev.em.4.mac_stats.symbol_errors: 0
                  dev.em.4.mac_stats.sequence_errors: 0
                  dev.em.4.mac_stats.defer_count: 0
                  dev.em.4.mac_stats.missed_packets: 0
                  dev.em.4.mac_stats.recv_no_buff: 0
                  dev.em.4.mac_stats.recv_undersize: 0
                  dev.em.4.mac_stats.recv_fragmented: 0
                  dev.em.4.mac_stats.recv_oversize: 0
                  dev.em.4.mac_stats.recv_jabber: 0
                  dev.em.4.mac_stats.recv_errs: 0
                  dev.em.4.mac_stats.crc_errs: 0
                  dev.em.4.mac_stats.alignment_errs: 0
                  dev.em.4.mac_stats.coll_ext_errs: 0
                  dev.em.4.mac_stats.xon_recvd: 0
                  dev.em.4.mac_stats.xon_txd: 0
                  dev.em.4.mac_stats.xoff_recvd: 0
                  dev.em.4.mac_stats.xoff_txd: 0
                  dev.em.4.mac_stats.total_pkts_recvd: 0
                  dev.em.4.mac_stats.good_pkts_recvd: 0
                  dev.em.4.mac_stats.bcast_pkts_recvd: 0
                  dev.em.4.mac_stats.mcast_pkts_recvd: 0
                  dev.em.4.mac_stats.rx_frames_64: 0
                  dev.em.4.mac_stats.rx_frames_65_127: 0
                  dev.em.4.mac_stats.rx_frames_128_255: 0
                  dev.em.4.mac_stats.rx_frames_256_511: 0
                  dev.em.4.mac_stats.rx_frames_512_1023: 0
                  dev.em.4.mac_stats.rx_frames_1024_1522: 0
                  dev.em.4.mac_stats.good_octets_recvd: 0
                  dev.em.4.mac_stats.good_octets_txd: 0
                  dev.em.4.mac_stats.total_pkts_txd: 0
                  dev.em.4.mac_stats.good_pkts_txd: 0
                  dev.em.4.mac_stats.bcast_pkts_txd: 0
                  dev.em.4.mac_stats.mcast_pkts_txd: 0
                  dev.em.4.mac_stats.tx_frames_64: 0
                  dev.em.4.mac_stats.tx_frames_65_127: 0
                  dev.em.4.mac_stats.tx_frames_128_255: 0
                  dev.em.4.mac_stats.tx_frames_256_511: 0
                  dev.em.4.mac_stats.tx_frames_512_1023: 0
                  dev.em.4.mac_stats.tx_frames_1024_1522: 0
                  dev.em.4.mac_stats.tso_txd: 0
                  dev.em.4.mac_stats.tso_ctx_fail: 0
                  dev.em.4.interrupts.asserts: 0
                  dev.em.4.interrupts.rx_pkt_timer: 0
                  dev.em.4.interrupts.rx_abs_timer: 0
                  dev.em.4.interrupts.tx_pkt_timer: 0
                  dev.em.4.interrupts.tx_abs_timer: 0
                  dev.em.4.interrupts.tx_queue_empty: 0
                  dev.em.4.interrupts.tx_queue_min_thresh: 0
                  dev.em.4.interrupts.rx_desc_min_thresh: 0
                  dev.em.4.interrupts.rx_overrun: 0
                  dev.em.5.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.5.%driver: em
                  dev.em.5.%location: slot=0 function=0
                  dev.em.5.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.5.%parent: pci16
                  dev.em.5.nvm: -1
                  dev.em.5.debug: -1
                  dev.em.5.fc: 3
                  dev.em.5.rx_int_delay: 0
                  dev.em.5.tx_int_delay: 66
                  dev.em.5.rx_abs_int_delay: 66
                  dev.em.5.tx_abs_int_delay: 66
                  dev.em.5.itr: 488
                  dev.em.5.rx_processing_limit: 100
                  dev.em.5.eee_control: 1
                  dev.em.5.link_irq: 14
                  dev.em.5.mbuf_alloc_fail: 0
                  dev.em.5.cluster_alloc_fail: 0
                  dev.em.5.dropped: 0
                  dev.em.5.tx_dma_fail: 0
                  dev.em.5.rx_overruns: 0
                  dev.em.5.watchdog_timeouts: 0
                  dev.em.5.device_control: 1477444168
                  dev.em.5.rx_control: 67141658
                  dev.em.5.fc_high_water: 18432
                  dev.em.5.fc_low_water: 16932
                  dev.em.5.queue0.txd_head: 118
                  dev.em.5.queue0.txd_tail: 118
                  dev.em.5.queue0.tx_irq: 35021
                  dev.em.5.queue0.no_desc_avail: 0
                  dev.em.5.queue0.rxd_head: 813
                  dev.em.5.queue0.rxd_tail: 812
                  dev.em.5.queue0.rx_irq: 33522
                  dev.em.5.mac_stats.excess_coll: 0
                  dev.em.5.mac_stats.single_coll: 0
                  dev.em.5.mac_stats.multiple_coll: 0
                  dev.em.5.mac_stats.late_coll: 0
                  dev.em.5.mac_stats.collision_count: 0
                  dev.em.5.mac_stats.symbol_errors: 0
                  dev.em.5.mac_stats.sequence_errors: 0
                  dev.em.5.mac_stats.defer_count: 0
                  dev.em.5.mac_stats.missed_packets: 0
                  dev.em.5.mac_stats.recv_no_buff: 0
                  dev.em.5.mac_stats.recv_undersize: 0
                  dev.em.5.mac_stats.recv_fragmented: 0
                  dev.em.5.mac_stats.recv_oversize: 0
                  dev.em.5.mac_stats.recv_jabber: 0
                  dev.em.5.mac_stats.recv_errs: 0
                  dev.em.5.mac_stats.crc_errs: 0
                  dev.em.5.mac_stats.alignment_errs: 0
                  dev.em.5.mac_stats.coll_ext_errs: 0
                  dev.em.5.mac_stats.xon_recvd: 0
                  dev.em.5.mac_stats.xon_txd: 0
                  dev.em.5.mac_stats.xoff_recvd: 0
                  dev.em.5.mac_stats.xoff_txd: 0
                  dev.em.5.mac_stats.total_pkts_recvd: 33581
                  dev.em.5.mac_stats.good_pkts_recvd: 33581
                  dev.em.5.mac_stats.bcast_pkts_recvd: 13190
                  dev.em.5.mac_stats.mcast_pkts_recvd: 6958
                  dev.em.5.mac_stats.rx_frames_64: 13832
                  dev.em.5.mac_stats.rx_frames_65_127: 10806
                  dev.em.5.mac_stats.rx_frames_128_255: 408
                  dev.em.5.mac_stats.rx_frames_256_511: 7058
                  dev.em.5.mac_stats.rx_frames_512_1023: 413
                  dev.em.5.mac_stats.rx_frames_1024_1522: 1064
                  dev.em.5.mac_stats.good_octets_recvd: 6533199
                  dev.em.5.mac_stats.good_octets_txd: 5861382
                  dev.em.5.mac_stats.total_pkts_txd: 35811
                  dev.em.5.mac_stats.good_pkts_txd: 35811
                  dev.em.5.mac_stats.bcast_pkts_txd: 8074
                  dev.em.5.mac_stats.mcast_pkts_txd: 2154
                  dev.em.5.mac_stats.tx_frames_64: 17797
                  dev.em.5.mac_stats.tx_frames_65_127: 14125
                  dev.em.5.mac_stats.tx_frames_128_255: 859
                  dev.em.5.mac_stats.tx_frames_256_511: 716
                  dev.em.5.mac_stats.tx_frames_512_1023: 294
                  dev.em.5.mac_stats.tx_frames_1024_1522: 2020
                  dev.em.5.mac_stats.tso_txd: 0
                  dev.em.5.mac_stats.tso_ctx_fail: 0
                  dev.em.5.interrupts.asserts: 9
                  dev.em.5.interrupts.rx_pkt_timer: 0
                  dev.em.5.interrupts.rx_abs_timer: 0
                  dev.em.5.interrupts.tx_pkt_timer: 0
                  dev.em.5.interrupts.tx_abs_timer: 0
                  dev.em.5.interrupts.tx_queue_empty: 0
                  dev.em.5.interrupts.tx_queue_min_thresh: 0
                  dev.em.5.interrupts.rx_desc_min_thresh: 0
                  dev.em.5.interrupts.rx_overrun: 0
                  dev.em.6.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.6.%driver: em
                  dev.em.6.%location: slot=0 function=0
                  dev.em.6.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.6.%parent: pci17
                  dev.em.6.nvm: -1
                  dev.em.6.debug: -1
                  dev.em.6.fc: 3
                  dev.em.6.rx_int_delay: 0
                  dev.em.6.tx_int_delay: 66
                  dev.em.6.rx_abs_int_delay: 66
                  dev.em.6.tx_abs_int_delay: 66
                  dev.em.6.itr: 488
                  dev.em.6.rx_processing_limit: 100
                  dev.em.6.eee_control: 1
                  dev.em.6.link_irq: 22
                  dev.em.6.mbuf_alloc_fail: 0
                  dev.em.6.cluster_alloc_fail: 0
                  dev.em.6.dropped: 0
                  dev.em.6.tx_dma_fail: 0
                  dev.em.6.rx_overruns: 0
                  dev.em.6.watchdog_timeouts: 0
                  dev.em.6.device_control: 1477444168
                  dev.em.6.rx_control: 67141658
                  dev.em.6.fc_high_water: 18432
                  dev.em.6.fc_low_water: 16932
                  dev.em.6.queue0.txd_head: 172
                  dev.em.6.queue0.txd_tail: 172
                  dev.em.6.queue0.tx_irq: 86612
                  dev.em.6.queue0.no_desc_avail: 0
                  dev.em.6.queue0.rxd_head: 886
                  dev.em.6.queue0.rxd_tail: 885
                  dev.em.6.queue0.rx_irq: 37129
                  dev.em.6.mac_stats.excess_coll: 0
                  dev.em.6.mac_stats.single_coll: 0
                  dev.em.6.mac_stats.multiple_coll: 0
                  dev.em.6.mac_stats.late_coll: 0
                  dev.em.6.mac_stats.collision_count: 0
                  dev.em.6.mac_stats.symbol_errors: 0
                  dev.em.6.mac_stats.sequence_errors: 0
                  dev.em.6.mac_stats.defer_count: 0
                  dev.em.6.mac_stats.missed_packets: 0
                  dev.em.6.mac_stats.recv_no_buff: 0
                  dev.em.6.mac_stats.recv_undersize: 0
                  dev.em.6.mac_stats.recv_fragmented: 0
                  dev.em.6.mac_stats.recv_oversize: 0
                  dev.em.6.mac_stats.recv_jabber: 0
                  dev.em.6.mac_stats.recv_errs: 0
                  dev.em.6.mac_stats.crc_errs: 0
                  dev.em.6.mac_stats.alignment_errs: 0
                  dev.em.6.mac_stats.coll_ext_errs: 0
                  dev.em.6.mac_stats.xon_recvd: 0
                  dev.em.6.mac_stats.xon_txd: 0
                  dev.em.6.mac_stats.xoff_recvd: 0
                  dev.em.6.mac_stats.xoff_txd: 0
                  dev.em.6.mac_stats.total_pkts_recvd: 40822
                  dev.em.6.mac_stats.good_pkts_recvd: 40822
                  dev.em.6.mac_stats.bcast_pkts_recvd: 538
                  dev.em.6.mac_stats.mcast_pkts_recvd: 445
                  dev.em.6.mac_stats.rx_frames_64: 28322
                  dev.em.6.mac_stats.rx_frames_65_127: 8188
                  dev.em.6.mac_stats.rx_frames_128_255: 966
                  dev.em.6.mac_stats.rx_frames_256_511: 818
                  dev.em.6.mac_stats.rx_frames_512_1023: 957
                  dev.em.6.mac_stats.rx_frames_1024_1522: 1571
                  dev.em.6.mac_stats.good_octets_recvd: 6040146
                  dev.em.6.mac_stats.good_octets_txd: 88048854
                  dev.em.6.mac_stats.total_pkts_txd: 93690
                  dev.em.6.mac_stats.good_pkts_txd: 93690
                  dev.em.6.mac_stats.bcast_pkts_txd: 20785
                  dev.em.6.mac_stats.mcast_pkts_txd: 8747
                  dev.em.6.mac_stats.tx_frames_64: 19296
                  dev.em.6.mac_stats.tx_frames_65_127: 9220
                  dev.em.6.mac_stats.tx_frames_128_255: 2549
                  dev.em.6.mac_stats.tx_frames_256_511: 7998
                  dev.em.6.mac_stats.tx_frames_512_1023: 746
                  dev.em.6.mac_stats.tx_frames_1024_1522: 53881
                  dev.em.6.mac_stats.tso_txd: 0
                  dev.em.6.mac_stats.tso_ctx_fail: 0
                  dev.em.6.interrupts.asserts: 14
                  dev.em.6.interrupts.rx_pkt_timer: 0
                  dev.em.6.interrupts.rx_abs_timer: 0
                  dev.em.6.interrupts.tx_pkt_timer: 0
                  dev.em.6.interrupts.tx_abs_timer: 0
                  dev.em.6.interrupts.tx_queue_empty: 0
                  dev.em.6.interrupts.tx_queue_min_thresh: 0
                  dev.em.6.interrupts.rx_desc_min_thresh: 0
                  dev.em.6.interrupts.rx_overrun: 0
                  dev.em.7.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.7.%driver: em
                  dev.em.7.%location: slot=0 function=0
                  dev.em.7.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.7.%parent: pci18
                  dev.em.7.nvm: -1
                  dev.em.7.debug: -1
                  dev.em.7.fc: 3
                  dev.em.7.rx_int_delay: 0
                  dev.em.7.tx_int_delay: 66
                  dev.em.7.rx_abs_int_delay: 66
                  dev.em.7.tx_abs_int_delay: 66
                  dev.em.7.itr: 488
                  dev.em.7.rx_processing_limit: 100
                  dev.em.7.eee_control: 1
                  dev.em.7.link_irq: 0
                  dev.em.7.mbuf_alloc_fail: 0
                  dev.em.7.cluster_alloc_fail: 0
                  dev.em.7.dropped: 0
                  dev.em.7.tx_dma_fail: 0
                  dev.em.7.rx_overruns: 0
                  dev.em.7.watchdog_timeouts: 0
                  dev.em.7.device_control: 1074790984
                  dev.em.7.rx_control: 67141658
                  dev.em.7.fc_high_water: 18432
                  dev.em.7.fc_low_water: 16932
                  dev.em.7.queue0.txd_head: 0
                  dev.em.7.queue0.txd_tail: 0
                  dev.em.7.queue0.tx_irq: 0
                  dev.em.7.queue0.no_desc_avail: 0
                  dev.em.7.queue0.rxd_head: 0
                  dev.em.7.queue0.rxd_tail: 1023
                  dev.em.7.queue0.rx_irq: 0
                  dev.em.7.mac_stats.excess_coll: 0
                  dev.em.7.mac_stats.single_coll: 0
                  dev.em.7.mac_stats.multiple_coll: 0
                  dev.em.7.mac_stats.late_coll: 0
                  dev.em.7.mac_stats.collision_count: 0
                  dev.em.7.mac_stats.symbol_errors: 0
                  dev.em.7.mac_stats.sequence_errors: 0
                  dev.em.7.mac_stats.defer_count: 0
                  dev.em.7.mac_stats.missed_packets: 0
                  dev.em.7.mac_stats.recv_no_buff: 0
                  dev.em.7.mac_stats.recv_undersize: 0
                  dev.em.7.mac_stats.recv_fragmented: 0
                  dev.em.7.mac_stats.recv_oversize: 0
                  dev.em.7.mac_stats.recv_jabber: 0
                  dev.em.7.mac_stats.recv_errs: 0
                  dev.em.7.mac_stats.crc_errs: 0
                  dev.em.7.mac_stats.alignment_errs: 0
                  dev.em.7.mac_stats.coll_ext_errs: 0
                  dev.em.7.mac_stats.xon_recvd: 0
                  dev.em.7.mac_stats.xon_txd: 0
                  dev.em.7.mac_stats.xoff_recvd: 0
                  dev.em.7.mac_stats.xoff_txd: 0
                  dev.em.7.mac_stats.total_pkts_recvd: 0
                  dev.em.7.mac_stats.good_pkts_recvd: 0
                  dev.em.7.mac_stats.bcast_pkts_recvd: 0
                  dev.em.7.mac_stats.mcast_pkts_recvd: 0
                  dev.em.7.mac_stats.rx_frames_64: 0
                  dev.em.7.mac_stats.rx_frames_65_127: 0
                  dev.em.7.mac_stats.rx_frames_128_255: 0
                  dev.em.7.mac_stats.rx_frames_256_511: 0
                  dev.em.7.mac_stats.rx_frames_512_1023: 0
                  dev.em.7.mac_stats.rx_frames_1024_1522: 0
                  dev.em.7.mac_stats.good_octets_recvd: 0
                  dev.em.7.mac_stats.good_octets_txd: 0
                  dev.em.7.mac_stats.total_pkts_txd: 0
                  dev.em.7.mac_stats.good_pkts_txd: 0
                  dev.em.7.mac_stats.bcast_pkts_txd: 0
                  dev.em.7.mac_stats.mcast_pkts_txd: 0
                  dev.em.7.mac_stats.tx_frames_64: 0
                  dev.em.7.mac_stats.tx_frames_65_127: 0
                  dev.em.7.mac_stats.tx_frames_128_255: 0
                  dev.em.7.mac_stats.tx_frames_256_511: 0
                  dev.em.7.mac_stats.tx_frames_512_1023: 0
                  dev.em.7.mac_stats.tx_frames_1024_1522: 0
                  dev.em.7.mac_stats.tso_txd: 0
                  dev.em.7.mac_stats.tso_ctx_fail: 0
                  dev.em.7.interrupts.asserts: 0
                  dev.em.7.interrupts.rx_pkt_timer: 0
                  dev.em.7.interrupts.rx_abs_timer: 0
                  dev.em.7.interrupts.tx_pkt_timer: 0
                  dev.em.7.interrupts.tx_abs_timer: 0
                  dev.em.7.interrupts.tx_queue_empty: 0
                  dev.em.7.interrupts.tx_queue_min_thresh: 0
                  dev.em.7.interrupts.rx_desc_min_thresh: 0
                  dev.em.7.interrupts.rx_overrun: 0
                  

                  And this is shortly after, having revived the connection using ifconfig:

                  $ sysctl dev.em
                  dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.0.%driver: em
                  dev.em.0.%location: slot=0 function=0
                  dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.0.%parent: pci5
                  dev.em.0.nvm: -1
                  dev.em.0.debug: -1
                  dev.em.0.fc: 3
                  dev.em.0.rx_int_delay: 0
                  dev.em.0.tx_int_delay: 66
                  dev.em.0.rx_abs_int_delay: 66
                  dev.em.0.tx_abs_int_delay: 66
                  dev.em.0.itr: 488
                  dev.em.0.rx_processing_limit: 100
                  dev.em.0.eee_control: 1
                  dev.em.0.link_irq: 3
                  dev.em.0.mbuf_alloc_fail: 0
                  dev.em.0.cluster_alloc_fail: 0
                  dev.em.0.dropped: 0
                  dev.em.0.tx_dma_fail: 0
                  dev.em.0.rx_overruns: 0
                  dev.em.0.watchdog_timeouts: 0
                  dev.em.0.device_control: 1074790984
                  dev.em.0.rx_control: 67141658
                  dev.em.0.fc_high_water: 18432
                  dev.em.0.fc_low_water: 16932
                  dev.em.0.queue0.txd_head: 685
                  dev.em.0.queue0.txd_tail: 685
                  dev.em.0.queue0.tx_irq: 1353736
                  dev.em.0.queue0.no_desc_avail: 0
                  dev.em.0.queue0.rxd_head: 676
                  dev.em.0.queue0.rxd_tail: 675
                  dev.em.0.queue0.rx_irq: 2196823
                  dev.em.0.mac_stats.excess_coll: 0
                  dev.em.0.mac_stats.single_coll: 0
                  dev.em.0.mac_stats.multiple_coll: 0
                  dev.em.0.mac_stats.late_coll: 0
                  dev.em.0.mac_stats.collision_count: 0
                  dev.em.0.mac_stats.symbol_errors: 0
                  dev.em.0.mac_stats.sequence_errors: 0
                  dev.em.0.mac_stats.defer_count: 0
                  dev.em.0.mac_stats.missed_packets: 0
                  dev.em.0.mac_stats.recv_no_buff: 0
                  dev.em.0.mac_stats.recv_undersize: 0
                  dev.em.0.mac_stats.recv_fragmented: 0
                  dev.em.0.mac_stats.recv_oversize: 14
                  dev.em.0.mac_stats.recv_jabber: 0
                  dev.em.0.mac_stats.recv_errs: 1
                  dev.em.0.mac_stats.crc_errs: 1864
                  dev.em.0.mac_stats.alignment_errs: 0
                  dev.em.0.mac_stats.coll_ext_errs: 0
                  dev.em.0.mac_stats.xon_recvd: 0
                  dev.em.0.mac_stats.xon_txd: 0
                  dev.em.0.mac_stats.xoff_recvd: 0
                  dev.em.0.mac_stats.xoff_txd: 0
                  dev.em.0.mac_stats.total_pkts_recvd: 2695671
                  dev.em.0.mac_stats.good_pkts_recvd: 2693793
                  dev.em.0.mac_stats.bcast_pkts_recvd: 115211
                  dev.em.0.mac_stats.mcast_pkts_recvd: 170573
                  dev.em.0.mac_stats.rx_frames_64: 231428
                  dev.em.0.mac_stats.rx_frames_65_127: 881736
                  dev.em.0.mac_stats.rx_frames_128_255: 240428
                  dev.em.0.mac_stats.rx_frames_256_511: 127402
                  dev.em.0.mac_stats.rx_frames_512_1023: 43918
                  dev.em.0.mac_stats.rx_frames_1024_1522: 1168881
                  dev.em.0.mac_stats.good_octets_recvd: 1944697083
                  dev.em.0.mac_stats.good_octets_txd: 267511513
                  dev.em.0.mac_stats.total_pkts_txd: 2302538
                  dev.em.0.mac_stats.good_pkts_txd: 2302538
                  dev.em.0.mac_stats.bcast_pkts_txd: 21
                  dev.em.0.mac_stats.mcast_pkts_txd: 5
                  dev.em.0.mac_stats.tx_frames_64: 401423
                  dev.em.0.mac_stats.tx_frames_65_127: 1702538
                  dev.em.0.mac_stats.tx_frames_128_255: 59586
                  dev.em.0.mac_stats.tx_frames_256_511: 57937
                  dev.em.0.mac_stats.tx_frames_512_1023: 37227
                  dev.em.0.mac_stats.tx_frames_1024_1522: 43827
                  dev.em.0.mac_stats.tso_txd: 0
                  dev.em.0.mac_stats.tso_ctx_fail: 0
                  dev.em.0.interrupts.asserts: 5
                  dev.em.0.interrupts.rx_pkt_timer: 0
                  dev.em.0.interrupts.rx_abs_timer: 0
                  dev.em.0.interrupts.tx_pkt_timer: 0
                  dev.em.0.interrupts.tx_abs_timer: 0
                  dev.em.0.interrupts.tx_queue_empty: 0
                  dev.em.0.interrupts.tx_queue_min_thresh: 0
                  dev.em.0.interrupts.rx_desc_min_thresh: 0
                  dev.em.0.interrupts.rx_overrun: 0
                  dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.1.%driver: em
                  dev.em.1.%location: slot=0 function=0
                  dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.1.%parent: pci6
                  dev.em.1.nvm: -1
                  dev.em.1.debug: -1
                  dev.em.1.fc: 3
                  dev.em.1.rx_int_delay: 0
                  dev.em.1.tx_int_delay: 66
                  dev.em.1.rx_abs_int_delay: 66
                  dev.em.1.tx_abs_int_delay: 66
                  dev.em.1.itr: 488
                  dev.em.1.rx_processing_limit: 100
                  dev.em.1.eee_control: 1
                  dev.em.1.link_irq: 22
                  dev.em.1.mbuf_alloc_fail: 0
                  dev.em.1.cluster_alloc_fail: 0
                  dev.em.1.dropped: 0
                  dev.em.1.tx_dma_fail: 0
                  dev.em.1.rx_overruns: 0
                  dev.em.1.watchdog_timeouts: 0
                  dev.em.1.device_control: 1477444168
                  dev.em.1.rx_control: 67141658
                  dev.em.1.fc_high_water: 18432
                  dev.em.1.fc_low_water: 16932
                  dev.em.1.queue0.txd_head: 839
                  dev.em.1.queue0.txd_tail: 839
                  dev.em.1.queue0.tx_irq: 1691646
                  dev.em.1.queue0.no_desc_avail: 0
                  dev.em.1.queue0.rxd_head: 100
                  dev.em.1.queue0.rxd_tail: 99
                  dev.em.1.queue0.rx_irq: 1381613
                  dev.em.1.mac_stats.excess_coll: 0
                  dev.em.1.mac_stats.single_coll: 0
                  dev.em.1.mac_stats.multiple_coll: 0
                  dev.em.1.mac_stats.late_coll: 0
                  dev.em.1.mac_stats.collision_count: 0
                  dev.em.1.mac_stats.symbol_errors: 0
                  dev.em.1.mac_stats.sequence_errors: 0
                  dev.em.1.mac_stats.defer_count: 0
                  dev.em.1.mac_stats.missed_packets: 0
                  dev.em.1.mac_stats.recv_no_buff: 0
                  dev.em.1.mac_stats.recv_undersize: 0
                  dev.em.1.mac_stats.recv_fragmented: 0
                  dev.em.1.mac_stats.recv_oversize: 0
                  dev.em.1.mac_stats.recv_jabber: 0
                  dev.em.1.mac_stats.recv_errs: 0
                  dev.em.1.mac_stats.crc_errs: 0
                  dev.em.1.mac_stats.alignment_errs: 0
                  dev.em.1.mac_stats.coll_ext_errs: 0
                  dev.em.1.mac_stats.xon_recvd: 0
                  dev.em.1.mac_stats.xon_txd: 0
                  dev.em.1.mac_stats.xoff_recvd: 0
                  dev.em.1.mac_stats.xoff_txd: 0
                  dev.em.1.mac_stats.total_pkts_recvd: 6059107
                  dev.em.1.mac_stats.good_pkts_recvd: 6059107
                  dev.em.1.mac_stats.bcast_pkts_recvd: 1003
                  dev.em.1.mac_stats.mcast_pkts_recvd: 36
                  dev.em.1.mac_stats.rx_frames_64: 3395204
                  dev.em.1.mac_stats.rx_frames_65_127: 1584944
                  dev.em.1.mac_stats.rx_frames_128_255: 146061
                  dev.em.1.mac_stats.rx_frames_256_511: 68733
                  dev.em.1.mac_stats.rx_frames_512_1023: 57333
                  dev.em.1.mac_stats.rx_frames_1024_1522: 806832
                  dev.em.1.mac_stats.good_octets_recvd: 1644015882
                  dev.em.1.mac_stats.good_octets_txd: 10934440772
                  dev.em.1.mac_stats.total_pkts_txd: 8619016
                  dev.em.1.mac_stats.good_pkts_txd: 8619016
                  dev.em.1.mac_stats.bcast_pkts_txd: 20889
                  dev.em.1.mac_stats.mcast_pkts_txd: 9162
                  dev.em.1.mac_stats.tx_frames_64: 439143
                  dev.em.1.mac_stats.tx_frames_65_127: 621925
                  dev.em.1.mac_stats.tx_frames_128_255: 326546
                  dev.em.1.mac_stats.tx_frames_256_511: 105432
                  dev.em.1.mac_stats.tx_frames_512_1023: 44657
                  dev.em.1.mac_stats.tx_frames_1024_1522: 7081313
                  dev.em.1.mac_stats.tso_txd: 0
                  dev.em.1.mac_stats.tso_ctx_fail: 0
                  dev.em.1.interrupts.asserts: 13
                  dev.em.1.interrupts.rx_pkt_timer: 0
                  dev.em.1.interrupts.rx_abs_timer: 0
                  dev.em.1.interrupts.tx_pkt_timer: 0
                  dev.em.1.interrupts.tx_abs_timer: 0
                  dev.em.1.interrupts.tx_queue_empty: 0
                  dev.em.1.interrupts.tx_queue_min_thresh: 0
                  dev.em.1.interrupts.rx_desc_min_thresh: 0
                  dev.em.1.interrupts.rx_overrun: 0
                  dev.em.2.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.2.%driver: em
                  dev.em.2.%location: slot=0 function=0
                  dev.em.2.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.2.%parent: pci10
                  dev.em.2.nvm: -1
                  dev.em.2.debug: -1
                  dev.em.2.fc: 3
                  dev.em.2.rx_int_delay: 0
                  dev.em.2.tx_int_delay: 66
                  dev.em.2.rx_abs_int_delay: 66
                  dev.em.2.tx_abs_int_delay: 66
                  dev.em.2.itr: 488
                  dev.em.2.rx_processing_limit: 100
                  dev.em.2.eee_control: 1
                  dev.em.2.link_irq: 69
                  dev.em.2.mbuf_alloc_fail: 0
                  dev.em.2.cluster_alloc_fail: 0
                  dev.em.2.dropped: 0
                  dev.em.2.tx_dma_fail: 0
                  dev.em.2.rx_overruns: 0
                  dev.em.2.watchdog_timeouts: 0
                  dev.em.2.device_control: 1477444168
                  dev.em.2.rx_control: 67141658
                  dev.em.2.fc_high_water: 18432
                  dev.em.2.fc_low_water: 16932
                  dev.em.2.queue0.txd_head: 240
                  dev.em.2.queue0.txd_tail: 240
                  dev.em.2.queue0.tx_irq: 1314599
                  dev.em.2.queue0.no_desc_avail: 4
                  dev.em.2.queue0.rxd_head: 293
                  dev.em.2.queue0.rxd_tail: 292
                  dev.em.2.queue0.rx_irq: 1026038
                  dev.em.2.mac_stats.excess_coll: 0
                  dev.em.2.mac_stats.single_coll: 0
                  dev.em.2.mac_stats.multiple_coll: 0
                  dev.em.2.mac_stats.late_coll: 0
                  dev.em.2.mac_stats.collision_count: 0
                  dev.em.2.mac_stats.symbol_errors: 0
                  dev.em.2.mac_stats.sequence_errors: 0
                  dev.em.2.mac_stats.defer_count: 0
                  dev.em.2.mac_stats.missed_packets: 0
                  dev.em.2.mac_stats.recv_no_buff: 0
                  dev.em.2.mac_stats.recv_undersize: 0
                  dev.em.2.mac_stats.recv_fragmented: 0
                  dev.em.2.mac_stats.recv_oversize: 0
                  dev.em.2.mac_stats.recv_jabber: 0
                  dev.em.2.mac_stats.recv_errs: 0
                  dev.em.2.mac_stats.crc_errs: 0
                  dev.em.2.mac_stats.alignment_errs: 0
                  dev.em.2.mac_stats.coll_ext_errs: 0
                  dev.em.2.mac_stats.xon_recvd: 0
                  dev.em.2.mac_stats.xon_txd: 67
                  dev.em.2.mac_stats.xoff_recvd: 0
                  dev.em.2.mac_stats.xoff_txd: 67
                  dev.em.2.mac_stats.total_pkts_recvd: 7579992
                  dev.em.2.mac_stats.good_pkts_recvd: 7579992
                  dev.em.2.mac_stats.bcast_pkts_recvd: 4530
                  dev.em.2.mac_stats.mcast_pkts_recvd: 1960
                  dev.em.2.mac_stats.rx_frames_64: 733376
                  dev.em.2.mac_stats.rx_frames_65_127: 127545
                  dev.em.2.mac_stats.rx_frames_128_255: 236524
                  dev.em.2.mac_stats.rx_frames_256_511: 32859
                  dev.em.2.mac_stats.rx_frames_512_1023: 70613
                  dev.em.2.mac_stats.rx_frames_1024_1522: 6379075
                  dev.em.2.mac_stats.good_octets_recvd: 9847706051
                  dev.em.2.mac_stats.good_octets_txd: 2161839705
                  dev.em.2.mac_stats.total_pkts_txd: 5162265
                  dev.em.2.mac_stats.good_pkts_txd: 5162131
                  dev.em.2.mac_stats.bcast_pkts_txd: 5846
                  dev.em.2.mac_stats.mcast_pkts_txd: 3858
                  dev.em.2.mac_stats.tx_frames_64: 3311306
                  dev.em.2.mac_stats.tx_frames_65_127: 402438
                  dev.em.2.mac_stats.tx_frames_128_255: 129314
                  dev.em.2.mac_stats.tx_frames_256_511: 25549
                  dev.em.2.mac_stats.tx_frames_512_1023: 92410
                  dev.em.2.mac_stats.tx_frames_1024_1522: 1201114
                  dev.em.2.mac_stats.tso_txd: 0
                  dev.em.2.mac_stats.tso_ctx_fail: 0
                  dev.em.2.interrupts.asserts: 44
                  dev.em.2.interrupts.rx_pkt_timer: 0
                  dev.em.2.interrupts.rx_abs_timer: 0
                  dev.em.2.interrupts.tx_pkt_timer: 0
                  dev.em.2.interrupts.tx_abs_timer: 0
                  dev.em.2.interrupts.tx_queue_empty: 0
                  dev.em.2.interrupts.tx_queue_min_thresh: 0
                  dev.em.2.interrupts.rx_desc_min_thresh: 0
                  dev.em.2.interrupts.rx_overrun: 0
                  dev.em.3.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.3.%driver: em
                  dev.em.3.%location: slot=0 function=0
                  dev.em.3.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.3.%parent: pci11
                  dev.em.3.nvm: -1
                  dev.em.3.debug: -1
                  dev.em.3.fc: 3
                  dev.em.3.rx_int_delay: 0
                  dev.em.3.tx_int_delay: 66
                  dev.em.3.rx_abs_int_delay: 66
                  dev.em.3.tx_abs_int_delay: 66
                  dev.em.3.itr: 488
                  dev.em.3.rx_processing_limit: 100
                  dev.em.3.eee_control: 1
                  dev.em.3.link_irq: 13
                  dev.em.3.mbuf_alloc_fail: 0
                  dev.em.3.cluster_alloc_fail: 0
                  dev.em.3.dropped: 0
                  dev.em.3.tx_dma_fail: 0
                  dev.em.3.rx_overruns: 0
                  dev.em.3.watchdog_timeouts: 0
                  dev.em.3.device_control: 1074790984
                  dev.em.3.rx_control: 67141658
                  dev.em.3.fc_high_water: 18432
                  dev.em.3.fc_low_water: 16932
                  dev.em.3.queue0.txd_head: 386
                  dev.em.3.queue0.txd_tail: 386
                  dev.em.3.queue0.tx_irq: 276
                  dev.em.3.queue0.no_desc_avail: 0
                  dev.em.3.queue0.rxd_head: 218
                  dev.em.3.queue0.rxd_tail: 217
                  dev.em.3.queue0.rx_irq: 978
                  dev.em.3.mac_stats.excess_coll: 0
                  dev.em.3.mac_stats.single_coll: 0
                  dev.em.3.mac_stats.multiple_coll: 0
                  dev.em.3.mac_stats.late_coll: 0
                  dev.em.3.mac_stats.collision_count: 0
                  dev.em.3.mac_stats.symbol_errors: 0
                  dev.em.3.mac_stats.sequence_errors: 0
                  dev.em.3.mac_stats.defer_count: 0
                  dev.em.3.mac_stats.missed_packets: 0
                  dev.em.3.mac_stats.recv_no_buff: 0
                  dev.em.3.mac_stats.recv_undersize: 0
                  dev.em.3.mac_stats.recv_fragmented: 0
                  dev.em.3.mac_stats.recv_oversize: 0
                  dev.em.3.mac_stats.recv_jabber: 0
                  dev.em.3.mac_stats.recv_errs: 0
                  dev.em.3.mac_stats.crc_errs: 0
                  dev.em.3.mac_stats.alignment_errs: 0
                  dev.em.3.mac_stats.coll_ext_errs: 0
                  dev.em.3.mac_stats.xon_recvd: 0
                  dev.em.3.mac_stats.xon_txd: 0
                  dev.em.3.mac_stats.xoff_recvd: 0
                  dev.em.3.mac_stats.xoff_txd: 0
                  dev.em.3.mac_stats.total_pkts_recvd: 979
                  dev.em.3.mac_stats.good_pkts_recvd: 979
                  dev.em.3.mac_stats.bcast_pkts_recvd: 616
                  dev.em.3.mac_stats.mcast_pkts_recvd: 158
                  dev.em.3.mac_stats.rx_frames_64: 63
                  dev.em.3.mac_stats.rx_frames_65_127: 163
                  dev.em.3.mac_stats.rx_frames_128_255: 112
                  dev.em.3.mac_stats.rx_frames_256_511: 641
                  dev.em.3.mac_stats.rx_frames_512_1023: 0
                  dev.em.3.mac_stats.rx_frames_1024_1522: 0
                  dev.em.3.mac_stats.good_octets_recvd: 255346
                  dev.em.3.mac_stats.good_octets_txd: 55615
                  dev.em.3.mac_stats.total_pkts_txd: 303
                  dev.em.3.mac_stats.good_pkts_txd: 303
                  dev.em.3.mac_stats.bcast_pkts_txd: 79
                  dev.em.3.mac_stats.mcast_pkts_txd: 32
                  dev.em.3.mac_stats.tx_frames_64: 32
                  dev.em.3.mac_stats.tx_frames_65_127: 229
                  dev.em.3.mac_stats.tx_frames_128_255: 9
                  dev.em.3.mac_stats.tx_frames_256_511: 14
                  dev.em.3.mac_stats.tx_frames_512_1023: 1
                  dev.em.3.mac_stats.tx_frames_1024_1522: 18
                  dev.em.3.mac_stats.tso_txd: 0
                  dev.em.3.mac_stats.tso_ctx_fail: 0
                  dev.em.3.interrupts.asserts: 9
                  dev.em.3.interrupts.rx_pkt_timer: 0
                  dev.em.3.interrupts.rx_abs_timer: 0
                  dev.em.3.interrupts.tx_pkt_timer: 0
                  dev.em.3.interrupts.tx_abs_timer: 0
                  dev.em.3.interrupts.tx_queue_empty: 0
                  dev.em.3.interrupts.tx_queue_min_thresh: 0
                  dev.em.3.interrupts.rx_desc_min_thresh: 0
                  dev.em.3.interrupts.rx_overrun: 0
                  dev.em.4.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.4.%driver: em
                  dev.em.4.%location: slot=0 function=0
                  dev.em.4.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.4.%parent: pci15
                  dev.em.4.nvm: -1
                  dev.em.4.debug: -1
                  dev.em.4.fc: 3
                  dev.em.4.rx_int_delay: 0
                  dev.em.4.tx_int_delay: 66
                  dev.em.4.rx_abs_int_delay: 66
                  dev.em.4.tx_abs_int_delay: 66
                  dev.em.4.itr: 488
                  dev.em.4.rx_processing_limit: 100
                  dev.em.4.eee_control: 1
                  dev.em.4.link_irq: 0
                  dev.em.4.mbuf_alloc_fail: 0
                  dev.em.4.cluster_alloc_fail: 0
                  dev.em.4.dropped: 0
                  dev.em.4.tx_dma_fail: 0
                  dev.em.4.rx_overruns: 0
                  dev.em.4.watchdog_timeouts: 0
                  dev.em.4.device_control: 1074790984
                  dev.em.4.rx_control: 67141658
                  dev.em.4.fc_high_water: 18432
                  dev.em.4.fc_low_water: 16932
                  dev.em.4.queue0.txd_head: 0
                  dev.em.4.queue0.txd_tail: 0
                  dev.em.4.queue0.tx_irq: 0
                  dev.em.4.queue0.no_desc_avail: 0
                  dev.em.4.queue0.rxd_head: 0
                  dev.em.4.queue0.rxd_tail: 1023
                  dev.em.4.queue0.rx_irq: 0
                  dev.em.4.mac_stats.excess_coll: 0
                  dev.em.4.mac_stats.single_coll: 0
                  dev.em.4.mac_stats.multiple_coll: 0
                  dev.em.4.mac_stats.late_coll: 0
                  dev.em.4.mac_stats.collision_count: 0
                  dev.em.4.mac_stats.symbol_errors: 0
                  dev.em.4.mac_stats.sequence_errors: 0
                  dev.em.4.mac_stats.defer_count: 0
                  dev.em.4.mac_stats.missed_packets: 0
                  dev.em.4.mac_stats.recv_no_buff: 0
                  dev.em.4.mac_stats.recv_undersize: 0
                  dev.em.4.mac_stats.recv_fragmented: 0
                  dev.em.4.mac_stats.recv_oversize: 0
                  dev.em.4.mac_stats.recv_jabber: 0
                  dev.em.4.mac_stats.recv_errs: 0
                  dev.em.4.mac_stats.crc_errs: 0
                  dev.em.4.mac_stats.alignment_errs: 0
                  dev.em.4.mac_stats.coll_ext_errs: 0
                  dev.em.4.mac_stats.xon_recvd: 0
                  dev.em.4.mac_stats.xon_txd: 0
                  dev.em.4.mac_stats.xoff_recvd: 0
                  dev.em.4.mac_stats.xoff_txd: 0
                  dev.em.4.mac_stats.total_pkts_recvd: 0
                  dev.em.4.mac_stats.good_pkts_recvd: 0
                  dev.em.4.mac_stats.bcast_pkts_recvd: 0
                  dev.em.4.mac_stats.mcast_pkts_recvd: 0
                  dev.em.4.mac_stats.rx_frames_64: 0
                  dev.em.4.mac_stats.rx_frames_65_127: 0
                  dev.em.4.mac_stats.rx_frames_128_255: 0
                  dev.em.4.mac_stats.rx_frames_256_511: 0
                  dev.em.4.mac_stats.rx_frames_512_1023: 0
                  dev.em.4.mac_stats.rx_frames_1024_1522: 0
                  dev.em.4.mac_stats.good_octets_recvd: 0
                  dev.em.4.mac_stats.good_octets_txd: 0
                  dev.em.4.mac_stats.total_pkts_txd: 0
                  dev.em.4.mac_stats.good_pkts_txd: 0
                  dev.em.4.mac_stats.bcast_pkts_txd: 0
                  dev.em.4.mac_stats.mcast_pkts_txd: 0
                  dev.em.4.mac_stats.tx_frames_64: 0
                  dev.em.4.mac_stats.tx_frames_65_127: 0
                  dev.em.4.mac_stats.tx_frames_128_255: 0
                  dev.em.4.mac_stats.tx_frames_256_511: 0
                  dev.em.4.mac_stats.tx_frames_512_1023: 0
                  dev.em.4.mac_stats.tx_frames_1024_1522: 0
                  dev.em.4.mac_stats.tso_txd: 0
                  dev.em.4.mac_stats.tso_ctx_fail: 0
                  dev.em.4.interrupts.asserts: 0
                  dev.em.4.interrupts.rx_pkt_timer: 0
                  dev.em.4.interrupts.rx_abs_timer: 0
                  dev.em.4.interrupts.tx_pkt_timer: 0
                  dev.em.4.interrupts.tx_abs_timer: 0
                  dev.em.4.interrupts.tx_queue_empty: 0
                  dev.em.4.interrupts.tx_queue_min_thresh: 0
                  dev.em.4.interrupts.rx_desc_min_thresh: 0
                  dev.em.4.interrupts.rx_overrun: 0
                  dev.em.5.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.5.%driver: em
                  dev.em.5.%location: slot=0 function=0
                  dev.em.5.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.5.%parent: pci16
                  dev.em.5.nvm: -1
                  dev.em.5.debug: -1
                  dev.em.5.fc: 3
                  dev.em.5.rx_int_delay: 0
                  dev.em.5.tx_int_delay: 66
                  dev.em.5.rx_abs_int_delay: 66
                  dev.em.5.tx_abs_int_delay: 66
                  dev.em.5.itr: 488
                  dev.em.5.rx_processing_limit: 100
                  dev.em.5.eee_control: 1
                  dev.em.5.link_irq: 14
                  dev.em.5.mbuf_alloc_fail: 0
                  dev.em.5.cluster_alloc_fail: 0
                  dev.em.5.dropped: 0
                  dev.em.5.tx_dma_fail: 0
                  dev.em.5.rx_overruns: 0
                  dev.em.5.watchdog_timeouts: 0
                  dev.em.5.device_control: 1477444168
                  dev.em.5.rx_control: 67141658
                  dev.em.5.fc_high_water: 18432
                  dev.em.5.fc_low_water: 16932
                  dev.em.5.queue0.txd_head: 908
                  dev.em.5.queue0.txd_tail: 908
                  dev.em.5.queue0.tx_irq: 35644
                  dev.em.5.queue0.no_desc_avail: 0
                  dev.em.5.queue0.rxd_head: 913
                  dev.em.5.queue0.rxd_tail: 912
                  dev.em.5.queue0.rx_irq: 33622
                  dev.em.5.mac_stats.excess_coll: 0
                  dev.em.5.mac_stats.single_coll: 0
                  dev.em.5.mac_stats.multiple_coll: 0
                  dev.em.5.mac_stats.late_coll: 0
                  dev.em.5.mac_stats.collision_count: 0
                  dev.em.5.mac_stats.symbol_errors: 0
                  dev.em.5.mac_stats.sequence_errors: 0
                  dev.em.5.mac_stats.defer_count: 0
                  dev.em.5.mac_stats.missed_packets: 0
                  dev.em.5.mac_stats.recv_no_buff: 0
                  dev.em.5.mac_stats.recv_undersize: 0
                  dev.em.5.mac_stats.recv_fragmented: 0
                  dev.em.5.mac_stats.recv_oversize: 0
                  dev.em.5.mac_stats.recv_jabber: 0
                  dev.em.5.mac_stats.recv_errs: 0
                  dev.em.5.mac_stats.crc_errs: 0
                  dev.em.5.mac_stats.alignment_errs: 0
                  dev.em.5.mac_stats.coll_ext_errs: 0
                  dev.em.5.mac_stats.xon_recvd: 0
                  dev.em.5.mac_stats.xon_txd: 0
                  dev.em.5.mac_stats.xoff_recvd: 0
                  dev.em.5.mac_stats.xoff_txd: 0
                  dev.em.5.mac_stats.total_pkts_recvd: 33681
                  dev.em.5.mac_stats.good_pkts_recvd: 33681
                  dev.em.5.mac_stats.bcast_pkts_recvd: 13265
                  dev.em.5.mac_stats.mcast_pkts_recvd: 6979
                  dev.em.5.mac_stats.rx_frames_64: 13907
                  dev.em.5.mac_stats.rx_frames_65_127: 10809
                  dev.em.5.mac_stats.rx_frames_128_255: 408
                  dev.em.5.mac_stats.rx_frames_256_511: 7079
                  dev.em.5.mac_stats.rx_frames_512_1023: 414
                  dev.em.5.mac_stats.rx_frames_1024_1522: 1064
                  dev.em.5.mac_stats.good_octets_recvd: 6547683
                  dev.em.5.mac_stats.good_octets_txd: 5926006
                  dev.em.5.mac_stats.total_pkts_txd: 36476
                  dev.em.5.mac_stats.good_pkts_txd: 36476
                  dev.em.5.mac_stats.bcast_pkts_txd: 8603
                  dev.em.5.mac_stats.mcast_pkts_txd: 2211
                  dev.em.5.mac_stats.tx_frames_64: 18335
                  dev.em.5.mac_stats.tx_frames_65_127: 14216
                  dev.em.5.mac_stats.tx_frames_128_255: 870
                  dev.em.5.mac_stats.tx_frames_256_511: 719
                  dev.em.5.mac_stats.tx_frames_512_1023: 306
                  dev.em.5.mac_stats.tx_frames_1024_1522: 2030
                  dev.em.5.mac_stats.tso_txd: 0
                  dev.em.5.mac_stats.tso_ctx_fail: 0
                  dev.em.5.interrupts.asserts: 9
                  dev.em.5.interrupts.rx_pkt_timer: 0
                  dev.em.5.interrupts.rx_abs_timer: 0
                  dev.em.5.interrupts.tx_pkt_timer: 0
                  dev.em.5.interrupts.tx_abs_timer: 0
                  dev.em.5.interrupts.tx_queue_empty: 0
                  dev.em.5.interrupts.tx_queue_min_thresh: 0
                  dev.em.5.interrupts.rx_desc_min_thresh: 0
                  dev.em.5.interrupts.rx_overrun: 0
                  dev.em.6.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.6.%driver: em
                  dev.em.6.%location: slot=0 function=0
                  dev.em.6.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.6.%parent: pci17
                  dev.em.6.nvm: -1
                  dev.em.6.debug: -1
                  dev.em.6.fc: 3
                  dev.em.6.rx_int_delay: 0
                  dev.em.6.tx_int_delay: 66
                  dev.em.6.rx_abs_int_delay: 66
                  dev.em.6.tx_abs_int_delay: 66
                  dev.em.6.itr: 488
                  dev.em.6.rx_processing_limit: 100
                  dev.em.6.eee_control: 1
                  dev.em.6.link_irq: 22
                  dev.em.6.mbuf_alloc_fail: 0
                  dev.em.6.cluster_alloc_fail: 0
                  dev.em.6.dropped: 0
                  dev.em.6.tx_dma_fail: 0
                  dev.em.6.rx_overruns: 0
                  dev.em.6.watchdog_timeouts: 0
                  dev.em.6.device_control: 1477444168
                  dev.em.6.rx_control: 67141658
                  dev.em.6.fc_high_water: 18432
                  dev.em.6.fc_low_water: 16932
                  dev.em.6.queue0.txd_head: 103
                  dev.em.6.queue0.txd_tail: 103
                  dev.em.6.queue0.tx_irq: 87586
                  dev.em.6.queue0.no_desc_avail: 0
                  dev.em.6.queue0.rxd_head: 840
                  dev.em.6.queue0.rxd_tail: 839
                  dev.em.6.queue0.rx_irq: 37860
                  dev.em.6.mac_stats.excess_coll: 0
                  dev.em.6.mac_stats.single_coll: 0
                  dev.em.6.mac_stats.multiple_coll: 0
                  dev.em.6.mac_stats.late_coll: 0
                  dev.em.6.mac_stats.collision_count: 0
                  dev.em.6.mac_stats.symbol_errors: 0
                  dev.em.6.mac_stats.sequence_errors: 0
                  dev.em.6.mac_stats.defer_count: 0
                  dev.em.6.mac_stats.missed_packets: 0
                  dev.em.6.mac_stats.recv_no_buff: 0
                  dev.em.6.mac_stats.recv_undersize: 0
                  dev.em.6.mac_stats.recv_fragmented: 0
                  dev.em.6.mac_stats.recv_oversize: 0
                  dev.em.6.mac_stats.recv_jabber: 0
                  dev.em.6.mac_stats.recv_errs: 0
                  dev.em.6.mac_stats.crc_errs: 0
                  dev.em.6.mac_stats.alignment_errs: 0
                  dev.em.6.mac_stats.coll_ext_errs: 0
                  dev.em.6.mac_stats.xon_recvd: 0
                  dev.em.6.mac_stats.xon_txd: 0
                  dev.em.6.mac_stats.xoff_recvd: 0
                  dev.em.6.mac_stats.xoff_txd: 0
                  dev.em.6.mac_stats.total_pkts_recvd: 41796
                  dev.em.6.mac_stats.good_pkts_recvd: 41796
                  dev.em.6.mac_stats.bcast_pkts_recvd: 755
                  dev.em.6.mac_stats.mcast_pkts_recvd: 454
                  dev.em.6.mac_stats.rx_frames_64: 29124
                  dev.em.6.mac_stats.rx_frames_65_127: 8291
                  dev.em.6.mac_stats.rx_frames_128_255: 984
                  dev.em.6.mac_stats.rx_frames_256_511: 824
                  dev.em.6.mac_stats.rx_frames_512_1023: 993
                  dev.em.6.mac_stats.rx_frames_1024_1522: 1580
                  dev.em.6.mac_stats.good_octets_recvd: 6142890
                  dev.em.6.mac_stats.good_octets_txd: 89550641
                  dev.em.6.mac_stats.total_pkts_txd: 95436
                  dev.em.6.mac_stats.good_pkts_txd: 95436
                  dev.em.6.mac_stats.bcast_pkts_txd: 21172
                  dev.em.6.mac_stats.mcast_pkts_txd: 8816
                  dev.em.6.mac_stats.tx_frames_64: 19702
                  dev.em.6.mac_stats.tx_frames_65_127: 9482
                  dev.em.6.mac_stats.tx_frames_128_255: 2561
                  dev.em.6.mac_stats.tx_frames_256_511: 8128
                  dev.em.6.mac_stats.tx_frames_512_1023: 765
                  dev.em.6.mac_stats.tx_frames_1024_1522: 54798
                  dev.em.6.mac_stats.tso_txd: 0
                  dev.em.6.mac_stats.tso_ctx_fail: 0
                  dev.em.6.interrupts.asserts: 14
                  dev.em.6.interrupts.rx_pkt_timer: 0
                  dev.em.6.interrupts.rx_abs_timer: 0
                  dev.em.6.interrupts.tx_pkt_timer: 0
                  dev.em.6.interrupts.tx_abs_timer: 0
                  dev.em.6.interrupts.tx_queue_empty: 0
                  dev.em.6.interrupts.tx_queue_min_thresh: 0
                  dev.em.6.interrupts.rx_desc_min_thresh: 0
                  dev.em.6.interrupts.rx_overrun: 0
                  dev.em.7.%desc: Intel(R) PRO/1000 Network Connection 7.3.8
                  dev.em.7.%driver: em
                  dev.em.7.%location: slot=0 function=0
                  dev.em.7.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x8086 subdevice=0x0000 class=0x020000
                  dev.em.7.%parent: pci18
                  dev.em.7.nvm: -1
                  dev.em.7.debug: -1
                  dev.em.7.fc: 3
                  dev.em.7.rx_int_delay: 0
                  dev.em.7.tx_int_delay: 66
                  dev.em.7.rx_abs_int_delay: 66
                  dev.em.7.tx_abs_int_delay: 66
                  dev.em.7.itr: 488
                  dev.em.7.rx_processing_limit: 100
                  dev.em.7.eee_control: 1
                  dev.em.7.link_irq: 0
                  dev.em.7.mbuf_alloc_fail: 0
                  dev.em.7.cluster_alloc_fail: 0
                  dev.em.7.dropped: 0
                  dev.em.7.tx_dma_fail: 0
                  dev.em.7.rx_overruns: 0
                  dev.em.7.watchdog_timeouts: 0
                  dev.em.7.device_control: 1074790984
                  dev.em.7.rx_control: 67141658
                  dev.em.7.fc_high_water: 18432
                  dev.em.7.fc_low_water: 16932
                  dev.em.7.queue0.txd_head: 0
                  dev.em.7.queue0.txd_tail: 0
                  dev.em.7.queue0.tx_irq: 0
                  dev.em.7.queue0.no_desc_avail: 0
                  dev.em.7.queue0.rxd_head: 0
                  dev.em.7.queue0.rxd_tail: 1023
                  dev.em.7.queue0.rx_irq: 0
                  dev.em.7.mac_stats.excess_coll: 0
                  dev.em.7.mac_stats.single_coll: 0
                  dev.em.7.mac_stats.multiple_coll: 0
                  dev.em.7.mac_stats.late_coll: 0
                  dev.em.7.mac_stats.collision_count: 0
                  dev.em.7.mac_stats.symbol_errors: 0
                  dev.em.7.mac_stats.sequence_errors: 0
                  dev.em.7.mac_stats.defer_count: 0
                  dev.em.7.mac_stats.missed_packets: 0
                  dev.em.7.mac_stats.recv_no_buff: 0
                  dev.em.7.mac_stats.recv_undersize: 0
                  dev.em.7.mac_stats.recv_fragmented: 0
                  dev.em.7.mac_stats.recv_oversize: 0
                  dev.em.7.mac_stats.recv_jabber: 0
                  dev.em.7.mac_stats.recv_errs: 0
                  dev.em.7.mac_stats.crc_errs: 0
                  dev.em.7.mac_stats.alignment_errs: 0
                  dev.em.7.mac_stats.coll_ext_errs: 0
                  dev.em.7.mac_stats.xon_recvd: 0
                  dev.em.7.mac_stats.xon_txd: 0
                  dev.em.7.mac_stats.xoff_recvd: 0
                  dev.em.7.mac_stats.xoff_txd: 0
                  dev.em.7.mac_stats.total_pkts_recvd: 0
                  dev.em.7.mac_stats.good_pkts_recvd: 0
                  dev.em.7.mac_stats.bcast_pkts_recvd: 0
                  dev.em.7.mac_stats.mcast_pkts_recvd: 0
                  dev.em.7.mac_stats.rx_frames_64: 0
                  dev.em.7.mac_stats.rx_frames_65_127: 0
                  dev.em.7.mac_stats.rx_frames_128_255: 0
                  dev.em.7.mac_stats.rx_frames_256_511: 0
                  dev.em.7.mac_stats.rx_frames_512_1023: 0
                  dev.em.7.mac_stats.rx_frames_1024_1522: 0
                  dev.em.7.mac_stats.good_octets_recvd: 0
                  dev.em.7.mac_stats.good_octets_txd: 0
                  dev.em.7.mac_stats.total_pkts_txd: 0
                  dev.em.7.mac_stats.good_pkts_txd: 0
                  dev.em.7.mac_stats.bcast_pkts_txd: 0
                  dev.em.7.mac_stats.mcast_pkts_txd: 0
                  dev.em.7.mac_stats.tx_frames_64: 0
                  dev.em.7.mac_stats.tx_frames_65_127: 0
                  dev.em.7.mac_stats.tx_frames_128_255: 0
                  dev.em.7.mac_stats.tx_frames_256_511: 0
                  dev.em.7.mac_stats.tx_frames_512_1023: 0
                  dev.em.7.mac_stats.tx_frames_1024_1522: 0
                  dev.em.7.mac_stats.tso_txd: 0
                  dev.em.7.mac_stats.tso_ctx_fail: 0
                  dev.em.7.interrupts.asserts: 0
                  dev.em.7.interrupts.rx_pkt_timer: 0
                  dev.em.7.interrupts.rx_abs_timer: 0
                  dev.em.7.interrupts.tx_pkt_timer: 0
                  dev.em.7.interrupts.tx_abs_timer: 0
                  dev.em.7.interrupts.tx_queue_empty: 0
                  dev.em.7.interrupts.tx_queue_min_thresh: 0
                  dev.em.7.interrupts.rx_desc_min_thresh: 0
                  dev.em.7.interrupts.rx_overrun: 0
                  
                  1 Reply Last reply Reply Quote 0
                  • stephenw10S
                    stephenw10 Netgate Administrator
                    last edited by

                    I have a box that is quite similar in many ways, same NICs, and I often use it as you do, without a switch. I too have all six em NICs bridged together. However I haven't done so recently as I'm using as a test box with 2.2. Thinking back I'm not sure if I ever had that arrangement with 2.1.1/2.
                    Interestingly I have experienced very similar behavior on that box but not on the em interfaces, on its one fxp NIC. That NIC will not negotiate a connection if it is powered up before the machine at the other end. In that case it was a harware (perhaps firmware) level issue where it would fail to negotiate a speed and duplex wiht the NIC at the other end resulting in no link. The link LED would flash intermittently as it tried and failed. It has no problem doing it it the other end is already powered up. I never found a good solution to it but you work around it by manually setting the link speed and duplex. Try that.

                    Steve

                    1 Reply Last reply Reply Quote 0
                    • E
                      ESPNSTI
                      last edited by

                      I have played around with nic settings on the connecting PC before, and that didn't seem to make a difference, but I will try that again.

                      I looked at some of the differences between the em drivers in 2.1.0 and 2.1.2.
                      In 2.1.2 the version is 7.3.8, I think 2.1.0 might be 7.3.2.
                      One thing I noticed is that the hw.em.eee_setting (Energy Efficient Ethernet) default might have changed.
                      It now seems to default to 1 and I think it defaulted to 0 before.
                      However I can't figure out by the somewhat cryptic code if that means it's now enabled or disabled.
                      Anyway, I set hw.em.eee_setting=0 in /boot/loader.conf.local and rebooted, but that unfortunately didn't fix it.

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Damn that seems like a great suspect. The sysctl had changed after boot?

                        In my case you could see the NIC wasn't making a connection as ifconfig showed 'no carrier' I don't belive you're seeing that though.

                        Steve

                        1 Reply Last reply Reply Quote 0
                        • E
                          ESPNSTI
                          last edited by

                          After the reboot, sysctl did show eee_setting as 0.

                          Edit: I tried changing the link speed and duplex of the connecting PC, and that made no difference.

                          There are some tests included in the Windows nic driver that I ran, and during the time the problem occurs, they all succeed except for the connection test.

                          ![Cable Test.gif](/public/imported_attachments/1/Cable Test.gif)
                          ![Cable Test.gif_thumb](/public/imported_attachments/1/Cable Test.gif_thumb)
                          ![Hardware Test.gif](/public/imported_attachments/1/Hardware Test.gif)
                          ![Hardware Test.gif_thumb](/public/imported_attachments/1/Hardware Test.gif_thumb)

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.