Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Latest pfsense+ 23.01 beta freezes on Hyper-v

    Scheduled Pinned Locked Moved Plus 23.05 Development Snapshots (Retired)
    67 Posts 10 Posters 19.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Bob.DigB
      Bob.Dig LAYER 8 @vbjp
      last edited by

      @vbjp No problem here on 23.01.b.20230106.0600.

      V 1 Reply Last reply Reply Quote 0
      • V
        vbjp @Bob.Dig
        last edited by vbjp

        @bob-dig said in Latest pfsense+ 23.01 beta freezes on Hyper-v:

        @vbjp No problem here on 23.01.b.20230106.0600.

        Steps to reproduce open hyper-v manager on server open vm display/console while not running start vm
        It will display vga resolution atc and freeze on masks line with high CPU usage.

        If you run vm without console open it starts and restarts just fine.

        Bob.DigB 1 Reply Last reply Reply Quote 0
        • Bob.DigB
          Bob.Dig LAYER 8 @vbjp
          last edited by

          @vbjp Yeah, I did this.

          V 1 Reply Last reply Reply Quote 0
          • V
            vbjp @Bob.Dig
            last edited by vbjp

            @bob-dig
            Gen2 vm yes?

            Screenshot (2).png

            Frozen on this screen
            2 different hosts 2 different pfsense vm installs broken

            Bob.DigB 1 Reply Last reply Reply Quote 0
            • Bob.DigB
              Bob.Dig LAYER 8 @vbjp
              last edited by Bob.Dig

              @vbjp said in Latest pfsense+ 23.01 beta freezes on Hyper-v:

              @bob-dig
              Gen2 vm yes?

              Yep. ZFS here too on WinServer2022.

              V 1 Reply Last reply Reply Quote 0
              • V
                vbjp @Bob.Dig
                last edited by vbjp

                @bob-dig said in Latest pfsense+ 23.01 beta freezes on Hyper-v:

                @vbjp said in Latest pfsense+ 23.01 beta freezes on Hyper-v:

                @bob-dig
                Gen2 vm yes?

                Yep. ZFS here too on WinServer2022.

                Strange after taking screenshot could not get vm to boot at all, even with console closed. rolled back to 22.05 snapshot, considering 22.05 really bad network performance on Hyper-v, will have to think something else.

                Anyone have any ideas what could be the issue here?

                Bob.DigB 1 Reply Last reply Reply Quote 0
                • Bob.DigB
                  Bob.Dig LAYER 8 @vbjp
                  last edited by

                  @vbjp 22.05 "already" had the fix for the hyper-v networking problem (RSC).

                  V 1 Reply Last reply Reply Quote 0
                  • V
                    vbjp @Bob.Dig
                    last edited by

                    @bob-dig said in Latest pfsense+ 23.01 beta freezes on Hyper-v:

                    @vbjp 22.05 "already" had the fix for the hyper-v networking problem (RSC).

                    Will test when I have more time.
                    Still there is some bug in 23.01 that making it fail boot on Hyper-v.
                    Not sure what is different with your setup.

                    I had crazy upgrade path to plus (partially because no isos) maybe that's messed something up.

                    Upgrade was 2.5>2.6>2.7dev then tried to upgrade to plus 23.01 as beta released but it failed. After upgrade from 2.7dev to 22.01 plus (no detect path to 23.01) vm jus boot cycles few times and shuts off. Then reinstalled 2.6 on top from iso an had to wait 24 hours as netgate seem to limit frequent upgrades from same Id. Then upgraded to 22.01>22.05 and finally 23.01 beta. It booted fine after upgrade and even had few reboots. But now it's failing.

                    Bob.DigB 1 Reply Last reply Reply Quote 0
                    • Bob.DigB
                      Bob.Dig LAYER 8 @vbjp
                      last edited by

                      @vbjp One problem I have encountered lately is that I can not have MAC address spoofing enabled. It was once advised by MS to have that enabled but it made terrible problems here but not yours. Maybe have an eye on that too.

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Moving from 2.7 to 22.01 is invalid. That is effectively a downgrade which is can cause problems.

                        It may be possible to upgrade from 2.7 once 23.01 is released since both are FreeBSD main (14) based.

                        I would expect that to work after reinstalling 2.6 though.

                        If you have issues pulling the certs too frequently you can open a ticket with us to reset it.

                        Steve

                        1 Reply Last reply Reply Quote 0
                        • jimpJ
                          jimp Rebel Alliance Developer Netgate
                          last edited by

                          I can't replicate any problems on 23.01 RC using ZFS with Hyper-V here. Installs clean and boots fine afterward with UEFI.

                          VM was configured by following the recipe in the docs:

                          https://docs.netgate.com/pfsense/en/latest/recipes/virtualize-hyper-v.html

                          This is on a Windows 10 host (22H2)

                          Remember: Upvote with the ๐Ÿ‘ button for any user/post you find to be helpful, informative, or deserving of recognition!

                          Need help fast? Netgate Global Support!

                          Do not Chat/PM for help!

                          V 1 Reply Last reply Reply Quote 1
                          • V
                            vbjp @jimp
                            last edited by

                            @jimp
                            Did fresh install of 2.6 and upgraded to latest 23.01 beta. Same problem. Reproducible everytime on my 2 systems running windows 2022 server.
                            Vm setup
                            Gen2 secure boot disabled
                            2gb ram (static), 1core. 2xnetwork adapters wan to nic SW and lan to private SW. 30gb drive plus DVD for install. Installed default 2.6 settings zfs etc. Min initial setup.

                            Screenshot (3).png

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              Does FreeBSD 14 install and boot correctly there?

                              V 1 Reply Last reply Reply Quote 0
                              • jimpJ
                                jimp Rebel Alliance Developer Netgate
                                last edited by

                                Did you go from 2.6 to 22.01, then to 22.05, and then 23.01? Or straight from 22.01 to 23.01?

                                Remember: Upvote with the ๐Ÿ‘ button for any user/post you find to be helpful, informative, or deserving of recognition!

                                Need help fast? Netgate Global Support!

                                Do not Chat/PM for help!

                                1 Reply Last reply Reply Quote 0
                                • jimpJ
                                  jimp Rebel Alliance Developer Netgate
                                  last edited by jimp

                                  I couldn't go from 22.01 to 23.01 directly, but going from 22.01 to 22.05 to 23.01 each step worked and boots UEFI and ZFS properly with a working console.

                                  I did this both by starting at 22.01 directly and by starting at 2.6, doing the plus upgrade to 22.01, then 22.05, then 23.01. Both paths succeeded, no problems encountered.

                                  Remember: Upvote with the ๐Ÿ‘ button for any user/post you find to be helpful, informative, or deserving of recognition!

                                  Need help fast? Netgate Global Support!

                                  Do not Chat/PM for help!

                                  1 Reply Last reply Reply Quote 0
                                  • V
                                    vbjp @stephenw10
                                    last edited by vbjp

                                    @stephenw10
                                    Installed freebsd 14 on same host booted successfully. Rebooted few times no problems (vm settings basically same, just one network adapter)

                                    Screenshot (4).png

                                    Upgrade path for my pfsense was install 2.6ce from iso next get the id and register then upgrade to plus 22.01 then 22.05 then to beta 23.01.

                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      We managed to replicate this locally and are investigating. So far it's not obvious what the difference is that triggers it.
                                      You might try installing as UFS, in our tests that boots fine which seems like a big clue!

                                      There's a bug open for it:
                                      https://redmine.pfsense.org/issues/13895

                                      Steve

                                      1 Reply Last reply Reply Quote 0
                                      • A
                                        andrew_241
                                        last edited by andrew_241

                                        I'm having the same problem. In case it may be of help, here is a dump of my VMCX configuration file, with the server name and VMCX filename removed:

                                        [Server]: PS C:\> $tempVM = (Compare-VM -Copy -Path "{Path to .vmcx}" -GenerateNewID).VM
                                        [Server]: PS C:\> $tempVM | select *
                                        
                                        
                                        ParentCheckpointId                  :
                                        ParentCheckpointName                :
                                        VMName                              : pfSense Router and Firewall
                                        VMId                                : dcfe7a58-eadd-4d11-b5ec-ff674db02362
                                        CheckpointFileLocation              : C:\ProgramData\Microsoft\Windows\Hyper-V
                                        ConfigurationLocation               : C:\ProgramData\Microsoft\Windows\Hyper-V
                                        SmartPagingFileInUse                : False
                                        SmartPagingFilePath                 : C:\ProgramData\Microsoft\Windows\Hyper-V
                                        SnapshotFileLocation                : C:\ProgramData\Microsoft\Windows\Hyper-V
                                        AutomaticStartAction                : Start
                                        AutomaticStartDelay                 : 0
                                        AutomaticStopAction                 : ShutDown
                                        AutomaticCriticalErrorAction        : Pause
                                        AutomaticCriticalErrorActionTimeout : 30
                                        AutomaticCheckpointsEnabled         : False
                                        CPUUsage                            : 0
                                        MemoryAssigned                      : 0
                                        MemoryDemand                        : 0
                                        MemoryStatus                        :
                                        NumaAligned                         :
                                        NumaNodesCount                      :
                                        NumaSocketCount                     :
                                        Heartbeat                           :
                                        IntegrationServicesState            :
                                        IntegrationServicesVersion          : 0.0
                                        Uptime                              : 00:00:00
                                        OperationalStatus                   : {Ok}
                                        PrimaryOperationalStatus            : Ok
                                        SecondaryOperationalStatus          :
                                        StatusDescriptions                  : {Operating normally}
                                        PrimaryStatusDescription            : Operating normally
                                        SecondaryStatusDescription          :
                                        Status                              : Operating normally
                                        ReplicationHealth                   : Normal
                                        ReplicationMode                     : None
                                        ReplicationState                    : Disabled
                                        ResourceMeteringEnabled             : False
                                        CheckpointType                      : Production
                                        EnhancedSessionTransportType        : VMBus
                                        Groups                              :
                                        Version                             : 10.0
                                        VirtualMachineType                  : PlannedVirtualMachine
                                        VirtualMachineSubType               : Generation2
                                        Notes                               :
                                        State                               : Off
                                        ComPort1                            : VMComPort (Name = 'COM 1', VMName = 'pfSense Router and Firewall') [Id = 'Microso
                                                                              ft:DCFE7A58-EADD-4D11-B5EC-FF674DB02362\8E3A359F-559A-4B6A-98A9-1690A6100ED7\0',
                                                                              VMId = 'dcfe7a58-eadd-4d11-b5ec-ff674db02362']
                                        ComPort2                            : VMComPort (Name = 'COM 2', VMName = 'pfSense Router and Firewall') [Id = 'Microso
                                                                              ft:DCFE7A58-EADD-4D11-B5EC-FF674DB02362\8E3A359F-559A-4B6A-98A9-1690A6100ED7\1',
                                                                              VMId = 'dcfe7a58-eadd-4d11-b5ec-ff674db02362']
                                        DVDDrives                           : {DVD Drive on SCSI controller number 0 at location 1}
                                        FibreChannelHostBusAdapters         : {}
                                        FloppyDrive                         :
                                        HardDrives                          : {Hard Drive on SCSI controller number 0 at location 0}
                                        RemoteFxAdapter                     :
                                        VMIntegrationService                : {Guest Service Interface, Heartbeat, Key-Value Pair Exchange, Shutdown...}
                                        DynamicMemoryEnabled                : False
                                        MemoryMaximum                       : 1099511627776
                                        MemoryMinimum                       : 536870912
                                        MemoryStartup                       : 8589934592
                                        ProcessorCount                      : 8
                                        BatteryPassthroughEnabled           : False
                                        Generation                          : 2
                                        IsClustered                         : False
                                        ParentSnapshotId                    :
                                        ParentSnapshotName                  :
                                        Path                                : C:\ProgramData\Microsoft\Windows\Hyper-V
                                        SizeOfSystemFiles                   : 45090
                                        GuestControlledCacheTypes           : False
                                        LowMemoryMappedIoSpace              : 134217728
                                        HighMemoryMappedIoSpace             : 536870912
                                        HighMemoryMappedIoBaseAddress       : 68182605824
                                        LockOnDisconnect                    : Off
                                        CreationTime                        : 1/25/2023 4:17:00 PM
                                        Id                                  : dcfe7a58-eadd-4d11-b5ec-ff674db02362
                                        Name                                : pfSense Router and Firewall
                                        NetworkAdapters                     : {Network Adapter, Network Adapter}
                                        CimSession                          : CimSession: .
                                        ComputerName                        : SERVER
                                        IsDeleted                           : False
                                        

                                        Perhaps someone can compare this output to theirs if they have a functioning install of the 23.01 beta in Hyper-V on Windows Server 2022.

                                        jimpJ 1 Reply Last reply Reply Quote 0
                                        • jimpJ
                                          jimp Rebel Alliance Developer Netgate @andrew_241
                                          last edited by jimp

                                          @andrew_241 said in Latest pfsense+ 23.01 beta freezes on Hyper-v:

                                          Version : 10.0

                                          The only real difference I see is mine that work are version 11.0, not version 10.0.

                                          Can you stop the VM, and in the Hyper-V manager select Actions > Upgrade Configuration Version so it gets updated to 11.0?

                                          I don't know about Hyper-V but we see things like that all the time in ESX where newer FreeBSD versions will tickle some behavior that either needs a newer VM config version or newer OS selected.

                                          That may only be on Windows 11, though. My Windows 10 box is powered off at the moment so I can't double check that until tomorrow.

                                          Remember: Upvote with the ๐Ÿ‘ button for any user/post you find to be helpful, informative, or deserving of recognition!

                                          Need help fast? Netgate Global Support!

                                          Do not Chat/PM for help!

                                          A 1 Reply Last reply Reply Quote 0
                                          • A
                                            andrew_241 @jimp
                                            last edited by

                                            @jimp

                                            For Windows Server 2022, the maximum configuration version is 10.0. I typed this in in PowerShell:

                                            [Server]: PS C:\> Update-VMVersion "pfSense Router and Firewall"
                                            
                                            Confirm
                                            Are you sure you want to perform this action?
                                            Performing a configuration version update of "pfSense Router and Firewall" will prevent it from being migrated to or
                                            imported on previous versions of Windows. This operation is not reversible.
                                            
                                            [Y] Yes  [A] Yes to All  [N] No  [L] No to All  [?] Help (default is "Y"): y
                                            WARNING: No update was performed for the virtual machine "pfSense Router and Firewall" because its configuration
                                            version is already at the maximum level supported by this server.  For clustered servers, the maximum supported
                                            configuration version can be limited by the cluster functional level.
                                            
                                            
                                            Bob.DigB 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.