• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

Failing to add interfaces to dataplane.

Scheduled Pinned Locked Moved Problems Installing or Upgrading TNSR Software
16 Posts 2 Posters 4.5k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J
    joaoa
    last edited by Oct 15, 2020, 12:24 PM

    Hello again.

    So R320 raid card is not recognized even by centos.
    Confirming this, moved to VMWARE.

    Installed the machine, all good, until I want to add the card to dataplane, again.

    Machine is set with 2 cores 4G Ram, network cards are with VMXNET3 driver like stated here:

    "
    Virtual Machines
    A TNSR software Bare Metal Image is available and will run in most virtual x86 environments.

    VMware - vSphere/ESXi 6.0 and later, running VMXNET3 virtual network adapters.
    "

    machine is set as
    Guest OS: CentOS 8 (64-bit)
    Compatibility: ESXi 6.7 and later (VM version 14)
    VMware Tools: Not running, not installed

    In host OS, I´ve set ens224 to onboot=no.

    In clixon_cli, I try to set the dataplane, it accepts, but nothing is returned in show interfaces.

    Again, tried the 3 drivers, and setting the vfio-pci to pa, and nothing.

    What am I missing here?

    Please help.

    1 Reply Last reply Reply Quote 0
    • D
      Derelict LAYER 8 Netgate
      last edited by Oct 15, 2020, 12:53 PM

      Please post exactly what you are doing and the output.

      Chattanooga, Tennessee, USA
      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
      Do Not Chat For Help! NO_WAN_EGRESS(TM)

      1 Reply Last reply Reply Quote 0
      • J
        joaoa
        last edited by Oct 15, 2020, 1:23 PM

        With default driver:

        labtnsr1 tnsr# conf
        labtnsr1 tnsr(config)# dataplane dpdk dev
          0000:0b:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01) ( Active Interface ens192 )
          0000:13:00.0           Ethernet controller: VMware VMXNET3 Ethernet Controller (rev 01)
          default
        labtnsr1 tnsr(config)# dataplane dpdk dev
        labtnsr1 tnsr(config)# dataplane dpdk dev 0000:13:00.0 network
        labtnsr1 tnsr(config)# configuration candidate commit
        labtnsr1 tnsr(config)# service dataplane restart
        labtnsr1 tnsr(config)# exit
        labtnsr1 tnsr# show interface
        labtnsr1 tnsr#
        labtnsr1 tnsr#
        
        labtnsr1 tnsr# show configuration
        <dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
           <dpdk>
              <dev>
                 <id>0000:13:00.0</id>
                 <device-type>network</device-type>
              </dev>
              <uio-driver>igb_uio</uio-driver>
           </dpdk>
        </dataplane-config>
        <nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
           <enable-nacm>true</enable-nacm>
           <read-default>deny</read-default>
           <write-default>deny</write-default>
           <exec-default>deny</exec-default>
           <enable-external-groups>true</enable-external-groups>
           <groups>
              <group>
                 <name>admin</name>
                 <user-name>root</user-name>
                 <user-name>tnsr</user-name>
              </group>
           </groups>
           <rule-list>
              <name>admin-rules</name>
              <group>admin</group>
              <rule>
                 <name>permit-all</name>
                 <module-name>*</module-name>
                 <access-operations>*</access-operations>
                 <action>permit</action>
              </rule>
           </rule-list>
        </nacm>
        labtnsr1 tnsr#
        

        trying vfio-pci

        labtnsr1 tnsr(config)# dataplane dpdk uio-driver vfio-pci
        labtnsr1 tnsr(config)# configuration candidate commit
        labtnsr1 tnsr(config)# service dataplane restart
        labtnsr1 tnsr(config)#
        labtnsr1 tnsr(config)#
        labtnsr1 tnsr(config)# exit
        labtnsr1 tnsr# show interface
        labtnsr1 tnsr# configure
        labtnsr1 tnsr(config)# dataplane dpdk iova-mode pa
        labtnsr1 tnsr(config)# configuration candidate commit
        labtnsr1 tnsr(config)# service dataplane restart
        labtnsr1 tnsr(config)#
        labtnsr1 tnsr(config)#
        labtnsr1 tnsr(config)# exit
        labtnsr1 tnsr# sh
         shell                 show
        labtnsr1 tnsr# show interface
        labtnsr1 tnsr#
        

        trying generic.

        labtnsr1 tnsr# conf t
        labtnsr1 tnsr(config)# dataplane dpdk uio-driver uio_pci_generic
        labtnsr1 tnsr(config)# configuration candidate commit
        labtnsr1 tnsr(config)# service dataplane restart
        labtnsr1 tnsr(config)# exit
        labtnsr1 tnsr# show interface
        labtnsr1 tnsr#
        labtnsr1 tnsr#
        labtnsr1 tnsr#
        

        in host os

        [toor@labtnsr1 ~]$ ip lin
        1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
            link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
        2: ens192: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000
            link/ether 00:50:56:ba:02:05 brd ff:ff:ff:ff:ff:ff
        [toor@labtnsr1 ~]$
        

        Thanks

        1 Reply Last reply Reply Quote 0
        • D
          Derelict LAYER 8 Netgate
          last edited by Oct 15, 2020, 4:09 PM

          Be sure the host has:

          ONBOOT=no
          NM_CONTROLLED=no

          Are present in the host configuration files in /etc/sysconfig/network-scripts for the interfaces you want on the dataplane and reboot and try again.

          https://docs.netgate.com/tnsr/en/latest/setup/setup-host-interfaces.html

          Chattanooga, Tennessee, USA
          A comprehensive network diagram is worth 10,000 words and 15 conference calls.
          DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
          Do Not Chat For Help! NO_WAN_EGRESS(TM)

          1 Reply Last reply Reply Quote 0
          • J
            joaoa
            last edited by Oct 15, 2020, 4:12 PM

            Hi, it was already when i took all that.

            fiule is like this:

            [toor@labtnsr1 ~]$ sudo cat /etc/sysconfig/network-scripts/ifcfg-ens224
            [sudo] password for toor:
            ONBOOT=no
            NM_CONTROLLED=no
            [toor@labtnsr1 ~]$
            
            1 Reply Last reply Reply Quote 0
            • D
              Derelict LAYER 8 Netgate
              last edited by Oct 15, 2020, 4:14 PM

              How many vmxnet interfaces are you trying to assign to this? What version of ESXi? What VM version?

              Chattanooga, Tennessee, USA
              A comprehensive network diagram is worth 10,000 words and 15 conference calls.
              DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
              Do Not Chat For Help! NO_WAN_EGRESS(TM)

              1 Reply Last reply Reply Quote 0
              • J
                joaoa
                last edited by Oct 15, 2020, 4:16 PM

                I´m only trying to assing this toi dataplane.

                The goal is to have has trunk and use vlans.

                regarding vmware:

                machine is set as
                Guest OS: CentOS 8 (64-bit)
                Compatibility: ESXi 6.7 and later (VM version 14)
                VMware Tools: Not running, not installed

                1 Reply Last reply Reply Quote 0
                • D
                  Derelict LAYER 8 Netgate
                  last edited by Oct 15, 2020, 4:22 PM

                  Try ESXi compatibility version 6.5. You will probably have to reinstall.

                  I highly recommend a management interface on the host plus any dataplane interfaces you need.

                  Chattanooga, Tennessee, USA
                  A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                  DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                  Do Not Chat For Help! NO_WAN_EGRESS(TM)

                  1 Reply Last reply Reply Quote 0
                  • J
                    joaoa
                    last edited by Oct 15, 2020, 4:24 PM

                    ok, I'll try.

                    The management interface is already set, is the ens192 in previous prints, it's how I'm reaching the machine now.

                    I thought you were asking only about dataplane.

                    1 Reply Last reply Reply Quote 0
                    • J
                      joaoa
                      last edited by Oct 16, 2020, 9:17 AM

                      Hi,

                      So, that does work, it was even set automatically to dataplane with the default driver.

                      labtnsr1 tnsr# show configuration
                      <dataplane-config xmlns="urn:netgate:xml:yang:netgate-dataplane">
                         <dpdk>
                            <uio-driver>igb_uio</uio-driver>
                         </dpdk>
                      </dataplane-config>
                      <nacm xmlns="urn:ietf:params:xml:ns:yang:ietf-netconf-acm">
                         <enable-nacm>true</enable-nacm>
                         <read-default>deny</read-default>
                         <write-default>deny</write-default>
                         <exec-default>deny</exec-default>
                         <enable-external-groups>true</enable-external-groups>
                         <groups>
                            <group>
                               <name>admin</name>
                               <user-name>root</user-name>
                               <user-name>tnsr</user-name>
                            </group>
                         </groups>
                         <rule-list>
                            <name>admin-rules</name>
                            <group>admin</group>
                            <rule>
                               <name>permit-all</name>
                               <module-name>*</module-name>
                               <access-operations>*</access-operations>
                               <action>permit</action>
                            </rule>
                         </rule-list>
                      </nacm>
                      labtnsr1 tnsr# show interface
                      Interface: GigabitEthernetb/0/0
                          Admin status: down
                          Link down, link-speed 10 Gbps, full duplex
                          Link MTU: 9000 bytes
                          MAC address: 00:50:56:ba:ed:31
                          IPv4 MTU: 0 bytes
                          IPv4 Route Table: ipv4-VRF:0
                          IPv6 MTU: 0 bytes
                          IPv6 Route Table: ipv6-VRF:0
                          VLAN tag rewrite: disable
                          Rx-queues
                              queue-id 0 : cpu-id 1
                          counters:
                            received: 0 bytes, 0 packets, 0 errors
                            transmitted: 0 bytes, 0 packets, 0 errors
                            protocols: 0 IPv4, 0 IPv6
                            0 drops, 0 punts, 0 rx miss, 0 rx no buffer
                      
                      labtnsr1 tnsr#
                      

                      Since there was a difference in the way I did the install, I retried with 6.7 compatibility again, and fails again.

                      Basically, this time I started the installation already with both network cards set in vmware, and this wasn't the case in the previous problematic installation.

                      But it's confirmed that was not this the issue, it failed again now with 6.7 and both cards available to the installer.

                      So, I don't know if this is a bug or not, but for centOS8 based OS, would make sense to support 6.7 already.

                      Thank you for your help, will continue the tests now.

                      1 Reply Last reply Reply Quote 0
                      16 out of 16
                      • First post
                        16/16
                        Last post
                      Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                        This community forum collects and processes your personal information.
                        consent.not_received