Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Failing to add interfaces to dataplane.

    Scheduled Pinned Locked Moved Problems Installing or Upgrading TNSR Software
    16 Posts 2 Posters 4.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DerelictD
      Derelict LAYER 8 Netgate @joaoa
      last edited by

      @joaoa Not really. Anything that works in CentOS8 should work fine.

      Chattanooga, Tennessee, USA
      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
      Do Not Chat For Help! NO_WAN_EGRESS(TM)

      J 1 Reply Last reply Reply Quote 0
      • J
        joaoa @Derelict
        last edited by

        @Derelict
        Ok, will check if I can install CentOS8 on this server, if not, that explains all.

        Thanks again.

        1 Reply Last reply Reply Quote 0
        • DerelictD
          Derelict LAYER 8 Netgate
          last edited by

          The tnsr installer is a CentOS 8 installer that also installs the tnsr packages. But researching what does and does not work with CentOS 8 will get you more results than searching for what does and does not work for tnsr.

          Chattanooga, Tennessee, USA
          A comprehensive network diagram is worth 10,000 words and 15 conference calls.
          DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
          Do Not Chat For Help! NO_WAN_EGRESS(TM)

          1 Reply Last reply Reply Quote 0
          • J
            joaoa
            last edited by

            Hello again.

            So R320 raid card is not recognized even by centos.
            Confirming this, moved to VMWARE.

            Installed the machine, all good, until I want to add the card to dataplane, again.

            Machine is set with 2 cores 4G Ram, network cards are with VMXNET3 driver like stated here:

            "
            Virtual Machines
            A TNSR software Bare Metal Image is available and will run in most virtual x86 environments.

            VMware - vSphere/ESXi 6.0 and later, running VMXNET3 virtual network adapters.
            "

            machine is set as
            Guest OS: CentOS 8 (64-bit)
            Compatibility: ESXi 6.7 and later (VM version 14)
            VMware Tools: Not running, not installed

            In host OS, I´ve set ens224 to onboot=no.

            In clixon_cli, I try to set the dataplane, it accepts, but nothing is returned in show interfaces.

            Again, tried the 3 drivers, and setting the vfio-pci to pa, and nothing.

            What am I missing here?

            Please help.

            1 Reply Last reply Reply Quote 0
            • DerelictD
              Derelict LAYER 8 Netgate
              last edited by

              Please post exactly what you are doing and the output.

              Chattanooga, Tennessee, USA
              A comprehensive network diagram is worth 10,000 words and 15 conference calls.
              DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
              Do Not Chat For Help! NO_WAN_EGRESS(TM)

              1 Reply Last reply Reply Quote 0
              • J
                joaoa
                last edited by

                With default driver:

                labtnsr1 tnsr# conf
                labtnsr1 tnsr(config)# dataplane dpdk dev
                  0000:0b:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01) ( Active Interface ens192 )
                  0000:13:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)
                  default
                labtnsr1 tnsr(config)# dataplane dpdk dev
                labtnsr1 tnsr(config)# dataplane dpdk dev 0000:13:00.0 network
                labtnsr1 tnsr(config)# configuration candidate commit
                labtnsr1 tnsr(config)# service dataplane restart
                labtnsr1 tnsr(config)# exit
                labtnsr1 tnsr# show interface
                labtnsr1 tnsr#
                labtnsr1 tnsr#
                
                labtnsr1 tnsr# show configuration
                <dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
                   <dpdk>
                      <dev>
                         <id>0000:13:00.0</id>
                         <device-type>network</device-type>
                      </dev>
                      <uio-driver>igb_uio</uio-driver>
                   </dpdk>
                </dataplane-config>
                <nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
                   <enable-nacm>true</enable-nacm>
                   <read-default>deny</read-default>
                   <write-default>deny</write-default>
                   <exec-default>deny</exec-default>
                   <enable-external-groups>true</enable-external-groups>
                   <groups>
                      <group>
                         <name>admin</name>
                         <user-name>root</user-name>
                         <user-name>tnsr</user-name>
                      </group>
                   </groups>
                   <rule-list>
                      <name>admin-rules</name>
                      <group>admin</group>
                      <rule>
                         <name>permit-all</name>
                         <module-name>*</module-name>
                         <access-operations>*</access-operations>
                         <action>permit</action>
                      </rule>
                   </rule-list>
                </nacm>
                labtnsr1 tnsr#
                

                trying vfio-pci

                labtnsr1 tnsr(config)# dataplane dpdk uio-driver vfio-pci
                labtnsr1 tnsr(config)# configuration candidate commit
                labtnsr1 tnsr(config)# service dataplane restart
                labtnsr1 tnsr(config)#
                labtnsr1 tnsr(config)#
                labtnsr1 tnsr(config)# exit
                labtnsr1 tnsr# show interface
                labtnsr1 tnsr# configure
                labtnsr1 tnsr(config)# dataplane dpdk iova-mode pa
                labtnsr1 tnsr(config)# configuration candidate commit
                labtnsr1 tnsr(config)# service dataplane restart
                labtnsr1 tnsr(config)#
                labtnsr1 tnsr(config)#
                labtnsr1 tnsr(config)# exit
                labtnsr1 tnsr# sh
                 shell                 show
                labtnsr1 tnsr# show interface
                labtnsr1 tnsr#
                

                trying generic.

                labtnsr1 tnsr# conf t
                labtnsr1 tnsr(config)# dataplane dpdk uio-driver uio_pci_generic
                labtnsr1 tnsr(config)# configuration candidate commit
                labtnsr1 tnsr(config)# service dataplane restart
                labtnsr1 tnsr(config)# exit
                labtnsr1 tnsr# show interface
                labtnsr1 tnsr#
                labtnsr1 tnsr#
                labtnsr1 tnsr#
                

                in host os

                [toor@labtnsr1 ~]$ ip lin
                1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
                    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
                2: ens192: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
                    link/ether 00:50:56:ba:02:05 brd ff:ff:ff:ff:ff:ff
                [toor@labtnsr1 ~]$
                

                Thanks

                1 Reply Last reply Reply Quote 0
                • DerelictD
                  Derelict LAYER 8 Netgate
                  last edited by

                  Be sure the host has:

                  ONBOOT=no
                  NM_CONTROLLED=no

                  Are present in the host configuration files in /etc/sysconfig/network-scripts for the interfaces you want on the dataplane and reboot and try again.

                  https://docs.netgate.com/tnsr/en/latest/setup/setup-host-interfaces.html

                  Chattanooga, Tennessee, USA
                  A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                  DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                  Do Not Chat For Help! NO_WAN_EGRESS(TM)

                  1 Reply Last reply Reply Quote 0
                  • J
                    joaoa
                    last edited by

                    Hi, it was already when i took all that.

                    fiule is like this:

                    [toor@labtnsr1 ~]$ sudo cat /etc/sysconfig/network-scripts/ifcfg-ens224
                    [sudo] password for toor:
                    ONBOOT=no
                    NM_CONTROLLED=no
                    [toor@labtnsr1 ~]$
                    
                    1 Reply Last reply Reply Quote 0
                    • DerelictD
                      Derelict LAYER 8 Netgate
                      last edited by

                      How many vmxnet interfaces are you trying to assign to this? What version of ESXi? What VM version?

                      Chattanooga, Tennessee, USA
                      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                      Do Not Chat For Help! NO_WAN_EGRESS(TM)

                      1 Reply Last reply Reply Quote 0
                      • J
                        joaoa
                        last edited by

                        I´m only trying to assing this toi dataplane.

                        The goal is to have has trunk and use vlans.

                        regarding vmware:

                        machine is set as
                        Guest OS: CentOS 8 (64-bit)
                        Compatibility: ESXi 6.7 and later (VM version 14)
                        VMware Tools: Not running, not installed

                        1 Reply Last reply Reply Quote 0
                        • DerelictD
                          Derelict LAYER 8 Netgate
                          last edited by

                          Try ESXi compatibility version 6.5. You will probably have to reinstall.

                          I highly recommend a management interface on the host plus any dataplane interfaces you need.

                          Chattanooga, Tennessee, USA
                          A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                          DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                          Do Not Chat For Help! NO_WAN_EGRESS(TM)

                          1 Reply Last reply Reply Quote 0
                          • J
                            joaoa
                            last edited by

                            ok, I'll try.

                            The management interface is already set, is the ens192 in previous prints, it's how I'm reaching the machine now.

                            I thought you were asking only about dataplane.

                            1 Reply Last reply Reply Quote 0
                            • J
                              joaoa
                              last edited by

                              Hi,

                              So, that does work, it was even set automatically to dataplane with the default driver.

                              labtnsr1 tnsr# show configuration
                              <dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
                                 <dpdk>
                                    <uio-driver>igb_uio</uio-driver>
                                 </dpdk>
                              </dataplane-config>
                              <nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
                                 <enable-nacm>true</enable-nacm>
                                 <read-default>deny</read-default>
                                 <write-default>deny</write-default>
                                 <exec-default>deny</exec-default>
                                 <enable-external-groups>true</enable-external-groups>
                                 <groups>
                                    <group>
                                       <name>admin</name>
                                       <user-name>root</user-name>
                                       <user-name>tnsr</user-name>
                                    </group>
                                 </groups>
                                 <rule-list>
                                    <name>admin-rules</name>
                                    <group>admin</group>
                                    <rule>
                                       <name>permit-all</name>
                                       <module-name>*</module-name>
                                       <access-operations>*</access-operations>
                                       <action>permit</action>
                                    </rule>
                                 </rule-list>
                              </nacm>
                              labtnsr1 tnsr# show interface
                              Interface: GigabitEthernetb/0/0
                                  Admin status: down
                                  Link down, link-speed 10 Gbps, full duplex
                                  Link MTU: 9000 bytes
                                  MAC address: 00:50:56:ba:ed:31
                                  IPv4 MTU: 0 bytes
                                  IPv4 Route Table: ipv4-VRF:0
                                  IPv6 MTU: 0 bytes
                                  IPv6 Route Table: ipv6-VRF:0
                                  VLAN tag rewrite: disable
                                  Rx-queues
                                      queue-id 0 : cpu-id 1
                                  counters:
                                    received: 0 bytes, 0 packets, 0 errors
                                    transmitted: 0 bytes, 0 packets, 0 errors
                                    protocols: 0 IPv4, 0 IPv6
                                    0 drops, 0 punts, 0 rx miss, 0 rx no buffer
                              
                              labtnsr1 tnsr#
                              

                              Since there was a difference in the way I did the install, I retried with 6.7 compatibility again, and fails again.

                              Basically, this time I started the installation already with both network cards set in vmware, and this wasn't the case in the previous problematic installation.

                              But it's confirmed that was not this the issue, it failed again now with 6.7 and both cards available to the installer.

                              So, I don't know if this is a bug or not, but for centOS8 based OS, would make sense to support 6.7 already.

                              Thank you for your help, will continue the tests now.

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.