Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Failing to add interfaces to dataplane.

    Scheduled Pinned Locked Moved Problems Installing or Upgrading TNSR Software
    16 Posts 2 Posters 4.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • J
      joaoa @Derelict
      last edited by

      @Derelict
      Ok, will check if I can install CentOS8 on this server, if not, that explains all.

      Thanks again.

      1 Reply Last reply Reply Quote 0
      • DerelictD
        Derelict LAYER 8 Netgate
        last edited by

        The tnsr installer is a CentOS 8 installer that also installs the tnsr packages. But researching what does and does not work with CentOS 8 will get you more results than searching for what does and does not work for tnsr.

        Chattanooga, Tennessee, USA
        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
        Do Not Chat For Help! NO_WAN_EGRESS(TM)

        1 Reply Last reply Reply Quote 0
        • J
          joaoa
          last edited by

          Hello again.

          So R320 raid card is not recognized even by centos.
          Confirming this, moved to VMWARE.

          Installed the machine, all good, until I want to add the card to dataplane, again.

          Machine is set with 2 cores 4G Ram, network cards are with VMXNET3 driver like stated here:

          "
          Virtual Machines
          A TNSR software Bare Metal Image is available and will run in most virtual x86 environments.

          VMware - vSphere/ESXi 6.0 and later, running VMXNET3 virtual network adapters.
          "

          machine is set as
          Guest OS: CentOS 8 (64-bit)
          Compatibility: ESXi 6.7 and later (VM version 14)
          VMware Tools: Not running, not installed

          In host OS, I´ve set ens224 to onboot=no.

          In clixon_cli, I try to set the dataplane, it accepts, but nothing is returned in show interfaces.

          Again, tried the 3 drivers, and setting the vfio-pci to pa, and nothing.

          What am I missing here?

          Please help.

          1 Reply Last reply Reply Quote 0
          • DerelictD
            Derelict LAYER 8 Netgate
            last edited by

            Please post exactly what you are doing and the output.

            Chattanooga, Tennessee, USA
            A comprehensive network diagram is worth 10,000 words and 15 conference calls.
            DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
            Do Not Chat For Help! NO_WAN_EGRESS(TM)

            1 Reply Last reply Reply Quote 0
            • J
              joaoa
              last edited by

              With default driver:

              labtnsr1 tnsr# conf
              labtnsr1 tnsr(config)# dataplane dpdk dev
                0000:0b:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01) ( Active Interface ens192 )
                0000:13:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)
                default
              labtnsr1 tnsr(config)# dataplane dpdk dev
              labtnsr1 tnsr(config)# dataplane dpdk dev 0000:13:00.0 network
              labtnsr1 tnsr(config)# configuration candidate commit
              labtnsr1 tnsr(config)# service dataplane restart
              labtnsr1 tnsr(config)# exit
              labtnsr1 tnsr# show interface
              labtnsr1 tnsr#
              labtnsr1 tnsr#
              
              labtnsr1 tnsr# show configuration
              <dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
                 <dpdk>
                    <dev>
                       <id>0000:13:00.0</id>
                       <device-type>network</device-type>
                    </dev>
                    <uio-driver>igb_uio</uio-driver>
                 </dpdk>
              </dataplane-config>
              <nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
                 <enable-nacm>true</enable-nacm>
                 <read-default>deny</read-default>
                 <write-default>deny</write-default>
                 <exec-default>deny</exec-default>
                 <enable-external-groups>true</enable-external-groups>
                 <groups>
                    <group>
                       <name>admin</name>
                       <user-name>root</user-name>
                       <user-name>tnsr</user-name>
                    </group>
                 </groups>
                 <rule-list>
                    <name>admin-rules</name>
                    <group>admin</group>
                    <rule>
                       <name>permit-all</name>
                       <module-name>*</module-name>
                       <access-operations>*</access-operations>
                       <action>permit</action>
                    </rule>
                 </rule-list>
              </nacm>
              labtnsr1 tnsr#
              

              trying vfio-pci

              labtnsr1 tnsr(config)# dataplane dpdk uio-driver vfio-pci
              labtnsr1 tnsr(config)# configuration candidate commit
              labtnsr1 tnsr(config)# service dataplane restart
              labtnsr1 tnsr(config)#
              labtnsr1 tnsr(config)#
              labtnsr1 tnsr(config)# exit
              labtnsr1 tnsr# show interface
              labtnsr1 tnsr# configure
              labtnsr1 tnsr(config)# dataplane dpdk iova-mode pa
              labtnsr1 tnsr(config)# configuration candidate commit
              labtnsr1 tnsr(config)# service dataplane restart
              labtnsr1 tnsr(config)#
              labtnsr1 tnsr(config)#
              labtnsr1 tnsr(config)# exit
              labtnsr1 tnsr# sh
               shell                 show
              labtnsr1 tnsr# show interface
              labtnsr1 tnsr#
              

              trying generic.

              labtnsr1 tnsr# conf t
              labtnsr1 tnsr(config)# dataplane dpdk uio-driver uio_pci_generic
              labtnsr1 tnsr(config)# configuration candidate commit
              labtnsr1 tnsr(config)# service dataplane restart
              labtnsr1 tnsr(config)# exit
              labtnsr1 tnsr# show interface
              labtnsr1 tnsr#
              labtnsr1 tnsr#
              labtnsr1 tnsr#
              

              in host os

              [toor@labtnsr1 ~]$ ip lin
              1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
                  link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
              2: ens192: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
                  link/ether 00:50:56:ba:02:05 brd ff:ff:ff:ff:ff:ff
              [toor@labtnsr1 ~]$
              

              Thanks

              1 Reply Last reply Reply Quote 0
              • DerelictD
                Derelict LAYER 8 Netgate
                last edited by

                Be sure the host has:

                ONBOOT=no
                NM_CONTROLLED=no

                Are present in the host configuration files in /etc/sysconfig/network-scripts for the interfaces you want on the dataplane and reboot and try again.

                https://docs.netgate.com/tnsr/en/latest/setup/setup-host-interfaces.html

                Chattanooga, Tennessee, USA
                A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                Do Not Chat For Help! NO_WAN_EGRESS(TM)

                1 Reply Last reply Reply Quote 0
                • J
                  joaoa
                  last edited by

                  Hi, it was already when i took all that.

                  fiule is like this:

                  [toor@labtnsr1 ~]$ sudo cat /etc/sysconfig/network-scripts/ifcfg-ens224
                  [sudo] password for toor:
                  ONBOOT=no
                  NM_CONTROLLED=no
                  [toor@labtnsr1 ~]$
                  
                  1 Reply Last reply Reply Quote 0
                  • DerelictD
                    Derelict LAYER 8 Netgate
                    last edited by

                    How many vmxnet interfaces are you trying to assign to this? What version of ESXi? What VM version?

                    Chattanooga, Tennessee, USA
                    A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                    DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                    Do Not Chat For Help! NO_WAN_EGRESS(TM)

                    1 Reply Last reply Reply Quote 0
                    • J
                      joaoa
                      last edited by

                      I´m only trying to assing this toi dataplane.

                      The goal is to have has trunk and use vlans.

                      regarding vmware:

                      machine is set as
                      Guest OS: CentOS 8 (64-bit)
                      Compatibility: ESXi 6.7 and later (VM version 14)
                      VMware Tools: Not running, not installed

                      1 Reply Last reply Reply Quote 0
                      • DerelictD
                        Derelict LAYER 8 Netgate
                        last edited by

                        Try ESXi compatibility version 6.5. You will probably have to reinstall.

                        I highly recommend a management interface on the host plus any dataplane interfaces you need.

                        Chattanooga, Tennessee, USA
                        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                        Do Not Chat For Help! NO_WAN_EGRESS(TM)

                        1 Reply Last reply Reply Quote 0
                        • J
                          joaoa
                          last edited by

                          ok, I'll try.

                          The management interface is already set, is the ens192 in previous prints, it's how I'm reaching the machine now.

                          I thought you were asking only about dataplane.

                          1 Reply Last reply Reply Quote 0
                          • J
                            joaoa
                            last edited by

                            Hi,

                            So, that does work, it was even set automatically to dataplane with the default driver.

                            labtnsr1 tnsr# show configuration
                            <dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
                               <dpdk>
                                  <uio-driver>igb_uio</uio-driver>
                               </dpdk>
                            </dataplane-config>
                            <nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
                               <enable-nacm>true</enable-nacm>
                               <read-default>deny</read-default>
                               <write-default>deny</write-default>
                               <exec-default>deny</exec-default>
                               <enable-external-groups>true</enable-external-groups>
                               <groups>
                                  <group>
                                     <name>admin</name>
                                     <user-name>root</user-name>
                                     <user-name>tnsr</user-name>
                                  </group>
                               </groups>
                               <rule-list>
                                  <name>admin-rules</name>
                                  <group>admin</group>
                                  <rule>
                                     <name>permit-all</name>
                                     <module-name>*</module-name>
                                     <access-operations>*</access-operations>
                                     <action>permit</action>
                                  </rule>
                               </rule-list>
                            </nacm>
                            labtnsr1 tnsr# show interface
                            Interface: GigabitEthernetb/0/0
                                Admin status: down
                                Link down, link-speed 10 Gbps, full duplex
                                Link MTU: 9000 bytes
                                MAC address: 00:50:56:ba:ed:31
                                IPv4 MTU: 0 bytes
                                IPv4 Route Table: ipv4-VRF:0
                                IPv6 MTU: 0 bytes
                                IPv6 Route Table: ipv6-VRF:0
                                VLAN tag rewrite: disable
                                Rx-queues
                                    queue-id 0 : cpu-id 1
                                counters:
                                  received: 0 bytes, 0 packets, 0 errors
                                  transmitted: 0 bytes, 0 packets, 0 errors
                                  protocols: 0 IPv4, 0 IPv6
                                  0 drops, 0 punts, 0 rx miss, 0 rx no buffer
                            
                            labtnsr1 tnsr#
                            

                            Since there was a difference in the way I did the install, I retried with 6.7 compatibility again, and fails again.

                            Basically, this time I started the installation already with both network cards set in vmware, and this wasn't the case in the previous problematic installation.

                            But it's confirmed that was not this the issue, it failed again now with 6.7 and both cards available to the installer.

                            So, I don't know if this is a bug or not, but for centOS8 based OS, would make sense to support 6.7 already.

                            Thank you for your help, will continue the tests now.

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.