• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

[solved] pfSense (2.6.0 & 22.01 ) is very slow on Hyper-V

Scheduled Pinned Locked Moved
Virtualization
36
187
93.0k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • B
    Bob.Dig LAYER 8
    last edited by Bob.Dig Feb 26, 2022, 7:04 PM Feb 26, 2022, 7:03 PM

    I figured out an interim solution for me. I created two external Switches, one for pfSense and one for all the other VMs. With that it does work, no slow speed anymore. Drawback is, it is using one more port and everything goes through a physical Switch.

    1 Reply Last reply Reply Quote 0
    • S
      stephenw10 Netgate Administrator
      last edited by Feb 26, 2022, 7:50 PM

      So that's no routing between VMs in the same host? That seems like it's what should trigger this.

      B 1 Reply Last reply Feb 26, 2022, 8:29 PM Reply Quote 0
      • B
        Bob.Dig LAYER 8 @stephenw10
        last edited by Bob.Dig Feb 26, 2022, 8:30 PM Feb 26, 2022, 8:29 PM

        @stephenw10 I think the key point is that pfsense is not using the same vSwitch then the others. This is an untypical setup and no one with a right mind would do it like this, but I did. And it does work here. I think I simulated "having two (vm) hosts", where it is natural, that the VMs can't use the same vSwitch.

        1 Reply Last reply Reply Quote 1
        • B
          Bob.Dig LAYER 8
          last edited by Feb 26, 2022, 9:13 PM

          It feels like coming home, finally. 🤗

          yeha.png

          Still hope for a real fix to that situation some have for the future.

          1 Reply Last reply Reply Quote 0
          • I
            i386DX
            last edited by Feb 26, 2022, 10:52 PM

            Set-VMSwitch -Name "*" -EnableSoftwareRsc $false
            
            Get-VMNetworkAdapter -VMName "vmname" | Where-Object {$_.MacAddress -eq "yourmacaddress"} | Set-VMNetworkAdapter -RscEnabled $false
            

            Seems to have worked for restoring both my wan upload and inter vlan throughput. Is there any official guidance on this?

            M 1 Reply Last reply Feb 27, 2022, 8:33 AM Reply Quote 3
            • N
              n1ck31 @DD
              last edited by Feb 27, 2022, 1:33 AM

              @dd Did you downgrade without a reinstall? The one time I forgot to take a snapshot and now I'm left with dialup speeds on my 10G server.

              1 Reply Last reply Reply Quote 0
              • M
                m0nji @i386DX
                last edited by m0nji Feb 27, 2022, 8:38 AM Feb 27, 2022, 8:33 AM

                @i386dx said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                damn this did the trick right now

                Get-VMNetworkAdapter -VMName "vmname" | Where-Object {$_.MacAddress -eq "yourmacaddress"} | Set-VMNetworkAdapter -RscEnabled $false
                

                we were just concentrating of disabling RSC on the vSwitch but there is also a variable for the VMs.
                so the workaround should be:

                1. disable RSC support on the vSwitch
                Set-VMSwitch -Name "vSwitchName" -SoftwareRscEnabled $false
                
                1. disable RSC support on the VM
                Get-VMNetworkAdapter -VMName "VMname" | Set-VMNetworkAdapter -RscEnabled $false
                

                one important side note: right now, you have to enable & disable RSC on the VM after every VM reboot even when the value is still $false!
                at least on my host...

                Intel i3-N305 / 4 x 2.5Gbe LAN @2.7.2-Release
                WAN: Vodafone 1000/50, Telekom 250/40; Switch: USW Enterprise 8 PoE, USW Flex XG, US-8-60W; Wifi: Unifi 6 Lite AP, U6 Mesh

                I 1 Reply Last reply Mar 1, 2022, 12:03 AM Reply Quote 2
                • W werter referenced this topic on Feb 27, 2022, 11:34 AM
                • I
                  i386DX @m0nji
                  last edited by Mar 1, 2022, 12:03 AM

                  @m0nji said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                  one important side note: right now, you have to enable & disable RSC on the VM after every VM reboot even when the value is still $false!
                  at least on my host...

                  Yes, same behaviour on my host too (Windows server 2022, gen2 vm, I350-T2 adapter, sr-iov unavailable, vmq disabled).
                  In my case I could even leave -SoftwareRscEnabled enabled on the vswitches and just flip -RscEnabled on and off on the vm network adapter(s) to restore normal bandwidth.

                  Unfortunately I'm not aware if there are ways to enforce nvs version 5 (327680) on the hn driver.

                  1 Reply Last reply Reply Quote 0
                  • S
                    stephenw10 Netgate Administrator
                    last edited by Mar 1, 2022, 1:19 AM

                    Indeed I was hoping there would be some way to force it but I don't see any way.

                    M 1 Reply Last reply Mar 1, 2022, 10:45 AM Reply Quote 0
                    • M
                      m0nji @stephenw10
                      last edited by Mar 1, 2022, 10:45 AM

                      @stephenw10
                      we should keep an eye on this: https://reviews.freebsd.org/D29075?id=85183

                      Intel i3-N305 / 4 x 2.5Gbe LAN @2.7.2-Release
                      WAN: Vodafone 1000/50, Telekom 250/40; Switch: USW Enterprise 8 PoE, USW Flex XG, US-8-60W; Wifi: Unifi 6 Lite AP, U6 Mesh

                      1 Reply Last reply Reply Quote 1
                      • D
                        Drumdevil
                        last edited by Drumdevil Mar 2, 2022, 4:03 PM Mar 2, 2022, 4:02 PM

                        I have two Server 2019 hosts (Host1 & Host2) in my homelab, with both the same hardware. Both experienced slow WAN speeds since the update to 2.6. Normally WAN would reach about 1 Gbit, but after the update it was only about 30 Mbit. The servers each have two separate virtual switches for LAN and WAN. Inter-VLAN communication was as expected in 2.6.

                        The virtual switches are attached as follows:

                        • WAN vSwitch -> Intel Pro/1000 PT, not shared with host
                        • LAN vSwitch -> Microsoft Network Adapter Multiplexer Driver -> NIC Team, static teaming, dynamic load balance

                        On both hosts I did:

                        Get-VMSwitch | Set-VMSwitch -SoftwareRscEnabled $false
                        

                        Then I confirmed both servers returned False for both switches using:

                        Get-VMSwitch | Select-Object *RSC*
                        

                        This fixed the issue on Host1. On Host2, now the WAN speeds were OK too, BUT: Inter-VRF traffic became insanely slow. After troubleshooting I found that the only difference was that Host2 was more recently installed and had yet to get a bunch of Windows updates. I couldn't tell you which one it was, but the updates fixed it.

                        So if you have inter-VLAN performance issues after disabling RSC, try installing Windows updates.

                        F 1 Reply Last reply Mar 8, 2022, 9:54 PM Reply Quote 2
                        • B bmeeks referenced this topic on Mar 3, 2022, 2:24 PM
                        • B bmeeks referenced this topic on Mar 3, 2022, 2:24 PM
                        • B bmeeks referenced this topic on Mar 3, 2022, 2:24 PM
                        • B bmeeks referenced this topic on Mar 3, 2022, 2:24 PM
                        • B Bob.Dig referenced this topic on Mar 6, 2022, 10:51 AM
                        • B bmeeks referenced this topic on Mar 7, 2022, 2:45 PM
                        • B bmeeks referenced this topic on Mar 7, 2022, 2:45 PM
                        • F
                          fiblimitless @Drumdevil
                          last edited by Mar 8, 2022, 9:54 PM

                          @drumdevil said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                          installing Windows updates.

                          For anyone who is having throttled uploads. I found a fix.

                          Go to the your vNIC Properties > Configure > Advanced, and disable "Large Send Offload Version 2" for IPv4/ IPv6, and the upload speed goes back to normal.

                          I think this also will fix your inter-VLAN performance after disabling RSC.

                          M B 2 Replies Last reply Mar 9, 2022, 9:37 AM Reply Quote 1
                          • M
                            m0nji @fiblimitless
                            last edited by Mar 9, 2022, 9:37 AM

                            @fiblimitless said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                            @drumdevil said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                            installing Windows updates.

                            For anyone who is having throttled uploads. I found a fix.

                            Go to the your vNIC Properties > Configure > Advanced, and disable "Large Send Offload Version 2" for IPv4/ IPv6, and the upload speed goes back to normal.

                            I think this also will fix your inter-VLAN performance after disabling RSC.

                            Cannot confirm this. I still need to enable & disable RSC on the VM after every VM Reboot!
                            Just for Clarification: I disabled Large Send Offload on the virtual Switch and the physical NIC. But i didnt reboot the host yet.

                            Intel i3-N305 / 4 x 2.5Gbe LAN @2.7.2-Release
                            WAN: Vodafone 1000/50, Telekom 250/40; Switch: USW Enterprise 8 PoE, USW Flex XG, US-8-60W; Wifi: Unifi 6 Lite AP, U6 Mesh

                            B 1 Reply Last reply Mar 9, 2022, 10:22 AM Reply Quote 0
                            • B
                              Bob.Dig LAYER 8 @m0nji
                              last edited by Bob.Dig Mar 9, 2022, 10:23 AM Mar 9, 2022, 10:22 AM

                              @m0nji said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                              Just for Clarification: I disabled Large Send Offload on the virtual Switch and the physical NIC. But i didnt reboot the host yet.

                              I think he meant the NIC in the vms, pretty easy to do that for a windows vm, more hard on a linux machine without GUI I guess. That's why I have not tested this.

                              I have my wacky solution for now using two external switches and wait for a permanent solution, probably coming with 2.7... lets hope.

                              1 Reply Last reply Reply Quote 0
                              • S SteveITS referenced this topic on Mar 9, 2022, 10:37 PM
                              • W werter referenced this topic on Mar 12, 2022, 2:28 PM
                              • W werter referenced this topic on Mar 16, 2022, 1:22 PM
                              • W werter referenced this topic on Mar 18, 2022, 11:26 AM
                              • W werter referenced this topic on Mar 22, 2022, 1:18 PM
                              • B
                                bimmerdriver @fiblimitless
                                last edited by bimmerdriver Mar 23, 2022, 3:32 AM Mar 23, 2022, 3:31 AM

                                @fiblimitless said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                                @drumdevil said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                                installing Windows updates.

                                For anyone who is having throttled uploads. I found a fix.

                                Go to the your vNIC Properties > Configure > Advanced, and disable "Large Send Offload Version 2" for IPv4/ IPv6, and the upload speed goes back to normal.

                                I think this also will fix your inter-VLAN performance after disabling RSC.

                                I tried your suggestion, but it made no difference. I'm experiencing erratic dead slow uploads and downloads. Is it necessary to reboot after making this change?

                                I'm running pfSense 2.6.0 on Windows Server 2019 in a Generation 2 VM. There are virtual switches on the WAN and LAN. The WAN and LAN NICs are Intel I350. Not using VLANs. VMQ, IPsec task offloading, SR-IOV enabled.

                                F I 2 Replies Last reply Mar 23, 2022, 5:44 AM Reply Quote 0
                                • F
                                  fiblimitless @bimmerdriver
                                  last edited by fiblimitless Mar 23, 2022, 6:00 AM Mar 23, 2022, 5:44 AM

                                  @bimmerdriver
                                  I have same system as you except for SR-IOV I have it disabled.

                                  For the download as mentioned before disable RSC via powershell.
                                  For the uploads: Make sure you disable Large Send Offload v2 on the
                                  virtual Switch and the physical NIC on the Host Machine.

                                  No boot needed, maybe disable/enable NICs.

                                  If that doesn't work, start disabling all these offload options you'll find in the v/NICs properties. and see if the speed goes back to normal. then work your way through by enabling them one by one. until you find the cause.

                                  I'v had a previous experience with win2016 when it was in preview, with regular Windows VM on Hyper-V. The speed was so slow, and had this offloading disabled, until Microsoft pushed an update and fixed it, or it was a NIC driver update. I don't remember.

                                  .

                                  1 Reply Last reply Reply Quote 0
                                  • S stephenw10 referenced this topic on Mar 23, 2022, 11:52 PM
                                  • S stephenw10 referenced this topic on Mar 23, 2022, 11:52 PM
                                  • W werter referenced this topic on Mar 24, 2022, 12:35 PM
                                  • I
                                    i386DX @bimmerdriver
                                    last edited by Mar 24, 2022, 7:18 PM

                                    @bimmerdriver did you try flipping -RscEnabled on and off on your pfsense vm network adapters?
                                    This fixes both wan upload and inter vlan bandwidth for me on ws 2022.

                                    I ended up scheduling this at startup until a fix is available:

                                    Start-Sleep -Seconds 120 ; `
                                    Get-VMNetworkAdapter -VMName "yourvmname" | Set-VMNetworkAdapter -RscEnabled $true ; `
                                    Start-Sleep -Seconds 10 ; `
                                    Get-VMNetworkAdapter -VMName "yourvmname" | Set-VMNetworkAdapter -RscEnabled $false
                                    
                                    B B 2 Replies Last reply Mar 25, 2022, 7:29 AM Reply Quote 1
                                    • B
                                      Bob.Dig LAYER 8 @i386DX
                                      last edited by Bob.Dig Mar 25, 2022, 8:07 AM Mar 25, 2022, 7:29 AM

                                      @i386dx said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                                      I ended up scheduling this at startup until a fix is available:

                                      Start-Sleep -Seconds 120 ; `
                                      Get-VMNetworkAdapter -VMName "yourvmname" | Set-VMNetworkAdapter -RscEnabled $true ; `
                                      Start-Sleep -Seconds 10 ; `
                                      Get-VMNetworkAdapter -VMName "yourvmname" | Set-VMNetworkAdapter -RscEnabled $false
                                      

                                      This works great, or not I am getting mixed results here, but how do you start that with Windows exactly?

                                      I 1 Reply Last reply Mar 29, 2022, 12:02 AM Reply Quote 0
                                      • B
                                        bimmerdriver @i386DX
                                        last edited by Mar 25, 2022, 7:42 PM

                                        @i386dx said in After Upgrade inter (V)LAN communication is very slow (on Hyper-V).:

                                        @bimmerdriver did you try flipping -RscEnabled on and off on your pfsense vm network adapters?
                                        This fixes both wan upload and inter vlan bandwidth for me on ws 2022.

                                        I ended up scheduling this at startup until a fix is available:

                                        Start-Sleep -Seconds 120 ; `
                                        Get-VMNetworkAdapter -VMName "yourvmname" | Set-VMNetworkAdapter -RscEnabled $true ; `
                                        Start-Sleep -Seconds 10 ; `
                                        Get-VMNetworkAdapter -VMName "yourvmname" | Set-VMNetworkAdapter -RscEnabled $false
                                        

                                        I did this yesterday. I didn't have a chance to post an update. It seems to have fixed the problem. I also noticed in the advanced settings for the virtual ethernet adapter that there are settings to enable and disable RSC for Ipv4 and IPv6. I will enable RSC on the switches and try disabling it in the driver to see if it accomplishes the same thing or not.

                                        B 1 Reply Last reply Mar 26, 2022, 3:36 PM Reply Quote 0
                                        • B
                                          bimmerdriver @bimmerdriver
                                          last edited by bimmerdriver Mar 26, 2022, 3:49 PM Mar 26, 2022, 3:36 PM

                                          Here are the settings I'm using for Windows Server 2019 with a Generation 2 VM. I'm not suggesting these settings are optimal for everyone, but in my case, pfSense is working properly with them, unlike before I disabled RSC in the virtual switches.

                                          My LAN and WAN NICs are I350-T2.

                                          I'm not using VLANs.

                                          In my system, the LAN and WAN NICs are connected to virtual switches. pfSense NICs are virtual, connected to LAN and WAN virtual switches.

                                          Virtual switches: RSC disabled, SR-IOV enabled in external switches.

                                          In all NICs (physical and virtual), VMQ, IPsec task offloading and SR-IOV are enabled. The only advanced feature I have enabled is port mirroring on WAN NICs so I can capture packets.

                                          NIC Drivers: Jumbo packets (9014) are enabled. All possible offloading is enabled. IRRC, the only non-default setting is enabling jumbo packets.

                                          In pfSense:

                                          Disable hardware checksum offload: not checked
                                          Disable hardware TCP segmentation offload: checked
                                          Disable hardware large receive offload: checked
                                          Enable the ALTQ support for hn NICs: not checked

                                          I have not tried disabling RSC (IPv4 and IPv6) in the virtual NIC driver settings. Perhaps that would have the same effect as disabling RSC in the virtual switches.

                                          YMMV.

                                          1 Reply Last reply Reply Quote 0
                                          139 out of 187
                                          • First post
                                            139/187
                                            Last post
                                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                                            This community forum collects and processes your personal information.
                                            consent.not_received