Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Failing to add interfaces to dataplane.

    Scheduled Pinned Locked Moved Problems Installing or Upgrading TNSR Software
    16 Posts 2 Posters 5.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • J
      joaoa
      last edited by

      Hello again.

      So R320 raid card is not recognized even by centos.
      Confirming this, moved to VMWARE.

      Installed the machine, all good, until I want to add the card to dataplane, again.

      Machine is set with 2 cores 4G Ram, network cards are with VMXNET3 driver like stated here:

      "
      Virtual Machines
      A TNSR software Bare Metal Image is available and will run in most virtual x86 environments.

      VMware - vSphere/ESXi 6.0 and later, running VMXNET3 virtual network adapters.
      "

      machine is set as
      Guest OS: CentOS 8 (64-bit)
      Compatibility: ESXi 6.7 and later (VM version 14)
      VMware Tools: Not running, not installed

      In host OS, I´ve set ens224 to onboot=no.

      In clixon_cli, I try to set the dataplane, it accepts, but nothing is returned in show interfaces.

      Again, tried the 3 drivers, and setting the vfio-pci to pa, and nothing.

      What am I missing here?

      Please help.

      1 Reply Last reply Reply Quote 0
      • DerelictD
        Derelict LAYER 8 Netgate
        last edited by

        Please post exactly what you are doing and the output.

        Chattanooga, Tennessee, USA
        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
        Do Not Chat For Help! NO_WAN_EGRESS(TM)

        1 Reply Last reply Reply Quote 0
        • J
          joaoa
          last edited by

          With default driver:

          labtnsr1 tnsr# conf
labtnsr1 tnsr(config)# dataplane dpdk dev
  0000:0b:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01) ( Active Interface ens192 )
  0000:13:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)
  default
labtnsr1 tnsr(config)# dataplane dpdk dev
labtnsr1 tnsr(config)# dataplane dpdk dev 0000:13:00.0 network
labtnsr1 tnsr(config)# configuration candidate commit
labtnsr1 tnsr(config)# service dataplane restart
labtnsr1 tnsr(config)# exit
labtnsr1 tnsr# show interface
labtnsr1 tnsr#
labtnsr1 tnsr#

          labtnsr1 tnsr# show configuration
<dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
   <dpdk>
      <dev>
         <id>0000:13:00.0</id>
         <device-type>network</device-type>
      </dev>
      <uio-driver>igb_uio</uio-driver>
   </dpdk>
</dataplane-config>
<nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
   <enable-nacm>true</enable-nacm>
   <read-default>deny</read-default>
   <write-default>deny</write-default>
   <exec-default>deny</exec-default>
   <enable-external-groups>true</enable-external-groups>
   <groups>
      <group>
         <name>admin</name>
         <user-name>root</user-name>
         <user-name>tnsr</user-name>
      </group>
   </groups>
   <rule-list>
      <name>admin-rules</name>
      <group>admin</group>
      <rule>
         <name>permit-all</name>
         <module-name>*</module-name>
         <access-operations>*</access-operations>
         <action>permit</action>
      </rule>
   </rule-list>
</nacm>
labtnsr1 tnsr#

          trying vfio-pci

          labtnsr1 tnsr(config)# dataplane dpdk uio-driver vfio-pci
labtnsr1 tnsr(config)# configuration candidate commit
labtnsr1 tnsr(config)# service dataplane restart
labtnsr1 tnsr(config)#
labtnsr1 tnsr(config)#
labtnsr1 tnsr(config)# exit
labtnsr1 tnsr# show interface
labtnsr1 tnsr# configure
labtnsr1 tnsr(config)# dataplane dpdk iova-mode pa
labtnsr1 tnsr(config)# configuration candidate commit
labtnsr1 tnsr(config)# service dataplane restart
labtnsr1 tnsr(config)#
labtnsr1 tnsr(config)#
labtnsr1 tnsr(config)# exit
labtnsr1 tnsr# sh
 shell                 show
labtnsr1 tnsr# show interface
labtnsr1 tnsr#

          trying generic.

          labtnsr1 tnsr# conf t
labtnsr1 tnsr(config)# dataplane dpdk uio-driver uio_pci_generic
labtnsr1 tnsr(config)# configuration candidate commit
labtnsr1 tnsr(config)# service dataplane restart
labtnsr1 tnsr(config)# exit
labtnsr1 tnsr# show interface
labtnsr1 tnsr#
labtnsr1 tnsr#
labtnsr1 tnsr#

          in host os

          [toor@labtnsr1 ~]$ ip lin
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: ens192: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
    link/ether 00:50:56:ba:02:05 brd ff:ff:ff:ff:ff:ff
[toor@labtnsr1 ~]$

          Thanks

          1 Reply Last reply Reply Quote 0
          • DerelictD
            Derelict LAYER 8 Netgate
            last edited by

            Be sure the host has:

            ONBOOT=no
            NM_CONTROLLED=no

            Are present in the host configuration files in /etc/sysconfig/network-scripts for the interfaces you want on the dataplane and reboot and try again.

            https://docs.netgate.com/tnsr/en/latest/setup/setup-host-interfaces.html

            Chattanooga, Tennessee, USA
            A comprehensive network diagram is worth 10,000 words and 15 conference calls.
            DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
            Do Not Chat For Help! NO_WAN_EGRESS(TM)

            1 Reply Last reply Reply Quote 0
            • J
              joaoa
              last edited by

              Hi, it was already when i took all that.

              fiule is like this:

              [toor@labtnsr1 ~]$ sudo cat /etc/sysconfig/network-scripts/ifcfg-ens224
[sudo] password for toor:
ONBOOT=no
NM_CONTROLLED=no
[toor@labtnsr1 ~]$
              1 Reply Last reply Reply Quote 0
              • DerelictD
                Derelict LAYER 8 Netgate
                last edited by

                How many vmxnet interfaces are you trying to assign to this? What version of ESXi? What VM version?

                Chattanooga, Tennessee, USA
                A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                Do Not Chat For Help! NO_WAN_EGRESS(TM)

                1 Reply Last reply Reply Quote 0
                • J
                  joaoa
                  last edited by

                  I´m only trying to assing this toi dataplane.

                  The goal is to have has trunk and use vlans.

                  regarding vmware:

                  machine is set as
                  Guest OS: CentOS 8 (64-bit)
                  Compatibility: ESXi 6.7 and later (VM version 14)
                  VMware Tools: Not running, not installed

                  1 Reply Last reply Reply Quote 0
                  • DerelictD
                    Derelict LAYER 8 Netgate
                    last edited by

                    Try ESXi compatibility version 6.5. You will probably have to reinstall.

                    I highly recommend a management interface on the host plus any dataplane interfaces you need.

                    Chattanooga, Tennessee, USA
                    A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                    DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                    Do Not Chat For Help! NO_WAN_EGRESS(TM)

                    1 Reply Last reply Reply Quote 0
                    • J
                      joaoa
                      last edited by

                      ok, I'll try.

                      The management interface is already set, is the ens192 in previous prints, it's how I'm reaching the machine now.

                      I thought you were asking only about dataplane.

                      1 Reply Last reply Reply Quote 0
                      • J
                        joaoa
                        last edited by

                        Hi,

                        So, that does work, it was even set automatically to dataplane with the default driver.

                        labtnsr1 tnsr# show configuration
<dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
   <dpdk>
      <uio-driver>igb_uio</uio-driver>
   </dpdk>
</dataplane-config>
<nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
   <enable-nacm>true</enable-nacm>
   <read-default>deny</read-default>
   <write-default>deny</write-default>
   <exec-default>deny</exec-default>
   <enable-external-groups>true</enable-external-groups>
   <groups>
      <group>
         <name>admin</name>
         <user-name>root</user-name>
         <user-name>tnsr</user-name>
      </group>
   </groups>
   <rule-list>
      <name>admin-rules</name>
      <group>admin</group>
      <rule>
         <name>permit-all</name>
         <module-name>*</module-name>
         <access-operations>*</access-operations>
         <action>permit</action>
      </rule>
   </rule-list>
</nacm>
labtnsr1 tnsr# show interface
Interface: GigabitEthernetb/0/0
    Admin status: down
    Link down, link-speed 10 Gbps, full duplex
    Link MTU: 9000 bytes
    MAC address: 00:50:56:ba:ed:31
    IPv4 MTU: 0 bytes
    IPv4 Route Table: ipv4-VRF:0
    IPv6 MTU: 0 bytes
    IPv6 Route Table: ipv6-VRF:0
    VLAN tag rewrite: disable
    Rx-queues
        queue-id 0 : cpu-id 1
    counters:
      received: 0 bytes, 0 packets, 0 errors
      transmitted: 0 bytes, 0 packets, 0 errors
      protocols: 0 IPv4, 0 IPv6
      0 drops, 0 punts, 0 rx miss, 0 rx no buffer

labtnsr1 tnsr#

                        Since there was a difference in the way I did the install, I retried with 6.7 compatibility again, and fails again.

                        Basically, this time I started the installation already with both network cards set in vmware, and this wasn't the case in the previous problematic installation.

                        But it's confirmed that was not this the issue, it failed again now with 6.7 and both cards available to the installer.

                        So, I don't know if this is a bug or not, but for centOS8 based OS, would make sense to support 6.7 already.

                        Thank you for your help, will continue the tests now.

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post
                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.