Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PfSense on esxi 6.7, can get it to work propperly.

    Scheduled Pinned Locked Moved Virtualization
    57 Posts 5 Posters 9.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • M
      marcel1988
      last edited by marcel1988

      Still this is not working fine. My internet disconnects every 4-5 hour.
      So can you please check my settings and tell me if the are right:

      First off all, the network settings:

      1. ESXI WAN settings: + VLAN ID 4095
        2a5c04f0-4638-4c0e-a37f-0610d4012047-image.png

      2. ESXI LAN settings:
        084a34a8-f224-4852-abba-0c44361b92f8-image.png

      3. PfSense settings:
        75daa62b-5e52-49d2-af2f-ec083f56d2b4-image.png

      Cable managment:

      WAN T-mobile > WAN Port intel NIC ESXI
      LAN Port intel NIC > port 1 into standard network switch. ( not managed )
      port 2 network switch > Onboard LAN port of ESXI server for managment.
      The rest of the network ports of the switch are 2 Ubiquiti WIFI accespoint, and some computers.

      As you can see, i also installed OpnSense just to find our of PfSense was the problem.
      But also OpnSense has the same problems.

      1 Reply Last reply Reply Quote 0
      • kiokomanK
        kiokoman LAYER 8
        last edited by

        it's ok, was the cable removed during this screenshot i suppose? physical adapters are not green
        if you are using igbn (native esxi driver) try to install net-igb (intel driver for esxi)

        Immagine.jpg

        also install open-vm-tools from pfsense packages if you didn't already

        ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
        Please do not use chat/PM to ask for help
        we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
        Don't forget to Upvote with the 👍 button for any post you find to be helpful.

        1 Reply Last reply Reply Quote 0
        • M
          marcel1988
          last edited by

          Yes, the cable is removed otherwise i dont have good internet ofcourse :)

          Both the drivers are installed:
          c156b52c-3b20-45e0-8132-bed43bde2ec2-image.png

          Also the package in PfSense for open-vm-tools is installed.

          1 Reply Last reply Reply Quote 0
          • kiokomanK
            kiokoman LAYER 8
            last edited by

            idk, settings are ok, maybe do a backup of your configuration ad reinstall a new clean vm with pfsense 2.4.5 or try 2.5.0

            ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
            Please do not use chat/PM to ask for help
            we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
            Don't forget to Upvote with the 👍 button for any post you find to be helpful.

            1 Reply Last reply Reply Quote 0
            • Cool_CoronaC
              Cool_Corona
              last edited by

              Can I get a Teamviewer into the box... then I will have your ESXi/pfsense running in 5 mins

              1 Reply Last reply Reply Quote 0
              • M
                marcel1988
                last edited by

                @kiokoman
                I have tried freshinstall of 2.4.5 and 2.5.0
                I have tried backing up and restoring.

                Maybe te problem is the fact i dont enter a MAC-ADDRESS into the wan port of the T-mobile fiber?
                and i leave the MTU also clear?

                @Cool_Corona
                if you can do it in 5 minutes. you can also tell me how ;)

                1 Reply Last reply Reply Quote 0
                • kiokomanK
                  kiokoman LAYER 8
                  last edited by

                  that would be something specific to your isp 🤷

                  ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
                  Please do not use chat/PM to ask for help
                  we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
                  Don't forget to Upvote with the 👍 button for any post you find to be helpful.

                  1 Reply Last reply Reply Quote 0
                  • M
                    marcel1988
                    last edited by

                    So i tried adding a MAC-ADDRESS but then there is no internet at all.
                    Where in PfSense can i find a log? so maybe i can see where the problem is occurring.

                    1 Reply Last reply Reply Quote 0
                    • kiokomanK
                      kiokoman LAYER 8
                      last edited by kiokoman

                      all logs are under status / system log
                      what kind of connection is it? pppoe ? dhcp? static or dynamic ip?

                      ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
                      Please do not use chat/PM to ask for help
                      we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
                      Don't forget to Upvote with the 👍 button for any post you find to be helpful.

                      1 Reply Last reply Reply Quote 0
                      • G
                        gcu_greyarea
                        last edited by gcu_greyarea

                        I have a cable modem and for testing purposes I have been switching between a pfSense VM and physical appliances.

                        Not sure why - but my connection is stable with the mac address used when the connection was first setup. This may be a provider thing...

                        Either way - if you want your pfSense VM to use a custom mac address on the WAN interface you'll need to allow forged transmits.

                        I'd also suggest you enable promiscuous mode.

                        https://docs.vmware.com/en/VMware-vSphere/6.7/com.vmware.vsphere.security.doc/GUID-7DC6486F-5400-44DF-8A62-6273798A2F80.html

                        and

                        https://docs.vmware.com/en/VMware-vSphere/6.7/com.vmware.vsphere.security.doc/GUID-92F3AB1F-B4C5-4F25-A010-8820D7250350.html

                        and

                        https://wahlnetwork.com/2013/04/29/how-the-vmware-forged-transmits-security-policy-works/

                        For good measure also allow mac changes.

                        Once its all working... you can revert these settings until you know exactly which setting breaks your environment.

                        To sum this up: on the WAN vSwitch and Portgroup you need to:

                        • Allow Mac Changes

                        • Allow Forged Transmits

                        • Allow Promiscuous Mode

                        • In pfsense - on the WAN Interface use a Mac Address that has previously worked with your provider

                        1 Reply Last reply Reply Quote 0
                        • M
                          marcel1988
                          last edited by

                          @kiokoman

                          These where my settings when i was using the Ubiquiti USG router:
                          033581ee-a505-4870-84c8-57a7d8279617-image.png

                          1 Reply Last reply Reply Quote 0
                          • M
                            marcel1988
                            last edited by marcel1988

                            ok, again the internet stopt working and i pull this out the logfile:

                            Apr 6 14:32:33 check_reload_status updating dyndns wan
                            Apr 6 14:32:33 check_reload_status Syncing firewall
                            Apr 6 14:32:33 php-fpm 2504 /interfaces_assign.php: Creating rrd update script
                            Apr 6 14:32:45 check_reload_status Syncing firewall
                            Apr 6 14:32:49 check_reload_status Syncing firewall
                            Apr 6 14:32:52 login login on ttyv0 as root
                            Apr 6 14:33:06 login login on ttyv0 as root
                            Apr 6 14:33:52 php-fpm 2504 /interfaces.php: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP'
                            Apr 6 14:33:52 php-fpm 2504 /interfaces.php: Gateway, none 'available' for inet6, use the first one configured. ''
                            Apr 6 14:33:52 check_reload_status Restarting ipsec tunnels
                            Apr 6 14:33:54 php-fpm 2504 /interfaces.php: Unbound /var/unbound/root.key file is corrupt, removing and recreating.
                            Apr 6 14:33:56 check_reload_status updating dyndns wan
                            Apr 6 14:33:56 kernel vlan0: changing name to 'vmx0.300'
                            Apr 6 14:33:58 check_reload_status Reloading filter
                            Apr 6 14:33:58 php-fpm 2504 /interfaces.php: Creating rrd update script
                            Apr 6 14:34:24 check_reload_status rc.newwanip starting vmx0.300
                            Apr 6 14:34:24 php-fpm 340 /interfaces_assign.php: Gateway, none 'available' for inet, use the first one configured. 'WAN_DHCP'
                            Apr 6 14:34:24 php-fpm 340 /interfaces_assign.php: Default gateway setting Interface WAN_DHCP Gateway as default.
                            Apr 6 14:34:24 php-fpm 340 /interfaces_assign.php: Gateway, none 'available' for inet6, use the first one configured. ''
                            Apr 6 14:34:24 check_reload_status Restarting ipsec tunnels
                            Apr 6 14:34:25 php-fpm 2504 /rc.newwanip: rc.newwanip: Info: starting on vmx0.300.
                            Apr 6 14:34:25 php-fpm 2504 /rc.newwanip: rc.newwanip: on (IP address: REMOVED FOR PRIVACY!!!!!!) (interface: []) (real interface: vmx0.300).
                            Apr 6 14:34:25 php-fpm 2504 /rc.newwanip: rc.newwanip called with empty interface.
                            Apr 6 14:34:25 php-fpm 2504 /rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - -> REMOVED FOR PRIVACY!!!!!! - Restarting packages.
                            Apr 6 14:34:25 check_reload_status Reloading filter
                            Apr 6 14:34:25 check_reload_status Starting packages
                            Apr 6 14:34:26 php-fpm 341 /rc.start_packages: Restarting/Starting all packages.
                            Apr 6 14:34:26 php-fpm 340 /interfaces_assign.php: Unbound /var/unbound/root.key file is corrupt, removing and recreating.
                            Apr 6 14:34:26 login login on ttyv0 as root
                            Apr 6 14:34:29 check_reload_status updating dyndns wan
                            Apr 6 14:34:29 check_reload_status Syncing firewall
                            Apr 6 14:34:29 php-fpm 340 /interfaces_assign.php: Creating rrd update script
                            Apr 6 14:35:01 pkg-static pfSense-repo upgraded: 2.4.5 -> 2.4.5_2
                            Apr 6 14:35:09 check_reload_status Syncing firewall
                            Apr 6 14:35:14 pkg-static fusefs-libs-2.9.9_1 installed
                            Apr 6 14:35:14 pkg-static libdnet-1.13_3 installed
                            Apr 6 14:35:14 pkg-static libmspack-0.10.1 installed
                            Apr 6 14:35:14 pkg-static open-vm-tools-nox11-11.0.1_2,2 installed
                            Apr 6 14:35:14 php /etc/rc.packages: Beginning package installation for Open-VM-Tools .
                            Apr 6 14:35:14 check_reload_status Syncing firewall
                            Apr 6 14:35:14 check_reload_status Syncing firewall
                            Apr 6 14:35:14 php /etc/rc.packages: Successfully installed package: Open-VM-Tools.
                            Apr 6 14:35:14 pkg-static pfSense-pkg-Open-VM-Tools-10.1.0_2,1 installed
                            Apr 6 14:35:16 check_reload_status Reloading filter
                            Apr 6 14:35:16 check_reload_status Starting packages
                            Apr 6 13:34:57 php-fpm 340 /rc.start_packages: Restarting/Starting all packages.
                            Apr 6 14:35:18 kernel VMware memory control driver initialized

                            After a reboot of the ESXI host, everything is working again.

                            1 Reply Last reply Reply Quote 0
                            • kiokomanK
                              kiokoman LAYER 8
                              last edited by kiokoman

                              uhm check the dhcp log and the gateway log also
                              REMOVED FOR PRIVACY!!!!!! your ip is 2 lines below

                              ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
                              Please do not use chat/PM to ask for help
                              we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
                              Don't forget to Upvote with the 👍 button for any post you find to be helpful.

                              1 Reply Last reply Reply Quote 0
                              • M
                                marcel1988
                                last edited by marcel1988

                                GENERAL LOG.txt DHCP LOG.txt

                                All files attached. :)
                                Hope this helps.

                                1 Reply Last reply Reply Quote 0
                                • kiokomanK
                                  kiokoman LAYER 8
                                  last edited by

                                  No DHCPOFFERS received.

                                  maybe try with e1000 driver instead of vmnet3

                                  ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
                                  Please do not use chat/PM to ask for help
                                  we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
                                  Don't forget to Upvote with the 👍 button for any post you find to be helpful.

                                  1 Reply Last reply Reply Quote 0
                                  • M
                                    marcel1988
                                    last edited by

                                    @kiokoman

                                    So i need to reset the Pfsense ESXI to default.
                                    inside the esxi change both adapters from vmnet3 to e1000.
                                    fire up PfSense and do it all over?

                                    1 Reply Last reply Reply Quote 0
                                    • kiokomanK
                                      kiokoman LAYER 8
                                      last edited by

                                      no just stop pfsense, edit the vm change from vmxnet3 to e1000 restart the vm, do it only for wan.
                                      when you start pfsense it will noticed the change and ask you for the new wan interface in the console

                                      ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
                                      Please do not use chat/PM to ask for help
                                      we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
                                      Don't forget to Upvote with the 👍 button for any post you find to be helpful.

                                      1 Reply Last reply Reply Quote 0
                                      • M
                                        marcel1988
                                        last edited by

                                        ok perfect, i have done this now and i also cleared all the logs.

                                        1 Reply Last reply Reply Quote 0
                                        • M
                                          marcel1988
                                          last edited by

                                          AND AGAIN, it stopt :( :( :(
                                          New files are attached.DHCP LOG.txt GENERAL LOG.txt

                                          1 Reply Last reply Reply Quote 0
                                          • kiokomanK
                                            kiokoman LAYER 8
                                            last edited by

                                            there is nothing wrong in the log this time, must be something on your esxi or the network card or the cable

                                            ̿' ̿'\̵͇̿̿\з=(◕_◕)=ε/̵͇̿̿/'̿'̿ ̿
                                            Please do not use chat/PM to ask for help
                                            we must focus on silencing this @guest character. we must make up lies and alter the copyrights !
                                            Don't forget to Upvote with the 👍 button for any post you find to be helpful.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.