note: i run packet sniffer, capture packets of BGP session

i see then keepalive messages and at one point tnsr with IP 10.62.40.245 sends TCP FIN and closes connection without any obvious reason

@sheebz said in TNSR on Proxmox:

@jimp ahh it needs 3 virtual nics? my server has a dual 10g nic, but i do have a node with 2 more 1gig nics. will that work? or does it have to be 3+ nics on the main machine?

It's possible to run with two (e.g. internal and external) in the dataplane only but TNSR works best when you have a management interface. The host management itself doesn't use the dataplane network, it's separate. That doesn't need to be real, it could be internal to Proxmox on a bridge to somewhere else you have a management client. There are ways to nudge things to use the dataplane from within the host for tasks like OS updates, so it's not a complete non-starter, it's just not an ideal setup.

@derelict yes i see ipfix dont giving all data sending only nat data

we cant use fastnetmon right now

if possible please add sflow exported on next version

@derelict

Well there is this page suggesting it could be supported.
https://doc.dpdk.org/guides/nics/axgbe.html
Dunno if the Epyc Embedded 3000 are the same as Ryzen Embedded regarding the NIC. Cannot find much about that.

As I own a system with a v1500b inside maybe I will just try and install TNSR and see what happens.

@indianatux OK thanks for trying that.

@jimp Thanks, I have since found that out.

Heads up for anyone else trying to get this working on CentOS, the information you are looking for to get this working is to specify the NetworkNamespace="dataplane" in your rsyslog.conf configuration. This would have been a useful tip as it goes off the typical, basic, default config in rsyslog and specific for the TNSR config.

example config for my rsyslog.conf that work for me in CentOS 8:-
action(type="omfwd"
queue.filename="tnsr_syslog"
queue.maxdiskspace="1g"
queue.saveonshutdown="on"
queue.type="LinkedList"
action.resumeRetryCount="-1"
Target="example.com" Port="514" Protocol="udp" NetworkNamespace="dataplane")

@dans I might be about to have a similar setup as yours. How did it end?
Thanks from a fellow "Dan"

@jimp Thank you sir

@viragomann My question about TNSR Home+Lab setup.

Thanks jimp. Maybe just a newbie issue. Anyway, I've got an initial build up now. Throughput is about twice as fast as testing I've done with FreeBSD packet filters but still tops out at about 3-4Gbps. I'm hoping I can improve this with tuning.

Looking forward to the next release. Debian distro's are my preferred Linux flavour 👍

@derelict
is worked thanx

@derelict Thought i would give this another shot on the latest code v21.01-588~tnsr_v21.07_1~g31b3e823e, but to no avail, but i did find somting interesting using the show hardware-interface command in vppctl it is seeing the non working interface VirtualFunctionEthernet6/0/0 MTU at 9206 and the admin up flag is not present and this error [rte_eth_dev_start[port:1, errno:-22]: Unknown error -22]. any Ideas how to look/debug further into this or do yo know what this error is?

I have also included working interface VirtualFunctionEthernet5/0/0 for comparison

vpp# sh hardware-interfaces
Name Idx Link Hardware
VirtualFunctionEthernet5/0/0 1 up VirtualFunctionEthernet5/0/0
Link speed: 10 Gbps
RX Queues:
queue thread mode
0 main (0) polling
Ethernet address 02:09:c0:99:4a:be
Intel 82599 VF
carrier up full duplex mtu 1500
flags: admin-up pmd maybe-multiseg subif tx-offload intel-phdr-cksum rx-ip4-cksum
rx: queues 1 (max 2), desc 1024 (min 32 max 4096 align 8)
tx: queues 1 (max 2), desc 1024 (min 32 max 4096 align 8)
pci: device 8086:10ed subsystem 8086:000c address 0000:05:00.00 numa 0
max rx packet len: 9728
promiscuous: unicast off all-multicast on
vlan offload: strip off filter off qinq off
rx offload avail: vlan-strip ipv4-cksum udp-cksum tcp-cksum vlan-filter
jumbo-frame scatter keep-crc rss-hash
rx offload active: ipv4-cksum jumbo-frame scatter
tx offload avail: vlan-insert ipv4-cksum udp-cksum tcp-cksum sctp-cksum
tcp-tso multi-segs
tx offload active: udp-cksum tcp-cksum multi-segs
rss avail: ipv4-tcp ipv4-udp ipv4 ipv6-tcp-ex ipv6-udp-ex ipv6-tcp
ipv6-udp ipv6-ex ipv6
rss active: ipv4-tcp ipv6-tcp-ex ipv6-tcp ipv6-udp ipv6-ex
tx burst function: ixgbe_xmit_pkts
rx burst function: ixgbe_recv_scattered_pkts_vec

tx frames ok 86 tx bytes ok 7258 rx frames ok 1325 rx bytes ok 191694 extended stats: rx_good_packets 1325 tx_good_packets 86 rx_good_bytes 191694 tx_good_bytes 7258 rx_multicast_packets 1550

VirtualFunctionEthernet6/0/0 2 up VirtualFunctionEthernet6/0/0
Link speed: 10 Gbps
RX Queues:
queue thread mode
0 main (0) polling
Ethernet address 02:09:c0:c1:84:fc
Intel 82599 VF
carrier up full duplex mtu 9206
flags: pmd maybe-multiseg subif tx-offload intel-phdr-cksum rx-ip4-cksum
rx: queues 1 (max 2), desc 1024 (min 32 max 4096 align 8)
tx: queues 1 (max 2), desc 1024 (min 32 max 4096 align 8)
pci: device 8086:10ed subsystem 8086:000c address 0000:06:00.00 numa 0
max rx packet len: 9728
promiscuous: unicast off all-multicast off
vlan offload: strip off filter on qinq off
rx offload avail: vlan-strip ipv4-cksum udp-cksum tcp-cksum vlan-filter
jumbo-frame scatter keep-crc rss-hash
rx offload active: ipv4-cksum jumbo-frame scatter
tx offload avail: vlan-insert ipv4-cksum udp-cksum tcp-cksum sctp-cksum
tcp-tso multi-segs
tx offload active: udp-cksum tcp-cksum multi-segs
rss avail: ipv4-tcp ipv4-udp ipv4 ipv6-tcp-ex ipv6-udp-ex ipv6-tcp
ipv6-udp ipv6-ex ipv6
rss active: ipv4-tcp ipv6-tcp-ex ipv6-tcp ipv6-udp ipv6-ex
tx burst function: ixgbe_xmit_pkts
rx burst function: ixgbe_recv_pkts

rx frames ok 4294966922 rx bytes ok 68719442425 Errors: rte_eth_dev_start[port:1, errno:-22: Unknown error -22

Thanks.