Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Two Pfsense each with Seprate Internet routing each other

    Scheduled Pinned Locked Moved Routing and Multi WAN
    39 Posts 2 Posters 3.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnpozJ
      johnpoz LAYER 8 Global Moderator
      last edited by

      If your so new to this - why are you involved in routing traffic between 2 sites with a fiber connection and multiple internet connections?  Make zero sense to me..  What is the current configuration of these sites?

      An intelligent man is sometimes forced to be drunk to spend time with his fools
      If you get confused: Listen to the Music Play
      Please don't Chat/PM me for help, unless mod related
      SG-4860 24.11 | Lab VMs 2.8, 24.11

      1 Reply Last reply Reply Quote 0
      • I
        irs
        last edited by

        actually i am new in pfsense and the couple of friends are working together to learn and use each other internet from far as i told you earlier.

        my apartment is about 2000ft away from my other friend. we have lurned how to splice OFC cable and it was fun.

        now as i was reading about pfsense multi wan and fail-over i need to create two way traffic between us.

        my other neighbor already sharing my internet.

        I have earlier develop a VPN between me and my another fried who lives in Chicago. I am luring a lot but some time its not that easy as tech like you can do.

        when can I expect the screen short?

        Thank you again.

        1 Reply Last reply Reply Quote 0
        • I
          irs
          last edited by

          @johnpoz:

          Sorry did not see your response.. I will try and fire up 2.3.4p1 today and get your screenshots.  But to be honest have already given you all the steps..

          johnpoz,

          Any news?

          1 Reply Last reply Reply Quote 0
          • johnpozJ
            johnpoz LAYER 8 Global Moderator
            last edited by

            Ah makes more sense now ;)

            I am firing up the VMs now - I have pf1.site1.lan up and running on 2.3.4p1, installing pf2.site2.lan and then can start taking screenshots..

            So this is how I have duplicated your setup

            pf1.site1.lan
            em2 wan: 192.168.9/24 (site 1 internet)
            em0 lan: 192.168.0.1/24
            em1 transit: 192.168.1.1/30

            pf2.site2.lan
            em2 wan: 192.168.2/24 (site 2 internet)
            em0 lan: 192.168.10.1
            em1 transit: 192.168.1.2/30

            I want to get the the 2 pfsense up and running and then take vm snapshots, etc.  So can roll them back real easy to new.. If you need me to walk through different steps, etc.  Sorry taken a bit but got side tracked ;)  pf2 is almost done its updating to 2.3.4p1 now..  But I have to go out for my morning walk, and then get ready for work here soon.  But now that have them up and running configure your setup from work and take screenshots, etc.  So for sure later today have pretty walk through for you…

            pf1.png
            pf1.png_thumb
            pf2.png
            pf2.png_thumb

            An intelligent man is sometimes forced to be drunk to spend time with his fools
            If you get confused: Listen to the Music Play
            Please don't Chat/PM me for help, unless mod related
            SG-4860 24.11 | Lab VMs 2.8, 24.11

            1 Reply Last reply Reply Quote 0
            • johnpozJ
              johnpoz LAYER 8 Global Moderator
              last edited by

              Ok created the firewall rule for transit and now pf1 and pf2 can ping each other over the transit.  I would hope you have gotten this far?

              transitup.png
              transitup.png_thumb

              An intelligent man is sometimes forced to be drunk to spend time with his fools
              If you get confused: Listen to the Music Play
              Please don't Chat/PM me for help, unless mod related
              SG-4860 24.11 | Lab VMs 2.8, 24.11

              1 Reply Last reply Reply Quote 0
              • I
                irs
                last edited by

                screen shots.

                1 Reply Last reply Reply Quote 0
                • johnpozJ
                  johnpoz LAYER 8 Global Moderator
                  last edited by

                  That is as far as I got before I had to go to work.. At work now - need to finish up some morning stuff.. Then will finish it.. So do you have your transit up and working.. Can each pfsense ping the other pfsense via the transit network you set up?

                  An intelligent man is sometimes forced to be drunk to spend time with his fools
                  If you get confused: Listen to the Music Play
                  Please don't Chat/PM me for help, unless mod related
                  SG-4860 24.11 | Lab VMs 2.8, 24.11

                  1 Reply Last reply Reply Quote 0
                  • johnpozJ
                    johnpoz LAYER 8 Global Moderator
                    last edited by

                    Ok - so now I have created the gateways pointing to the other pfsense transit IP..

                    See attached.  Notice I set ipv6 on each wan of pfsense to none.  This is only ipv4 setup and figured just remove ipv6 to have it look cleaner.

                    gateways.png
                    gateways.png_thumb

                    An intelligent man is sometimes forced to be drunk to spend time with his fools
                    If you get confused: Listen to the Music Play
                    Please don't Chat/PM me for help, unless mod related
                    SG-4860 24.11 | Lab VMs 2.8, 24.11

                    1 Reply Last reply Reply Quote 0
                    • johnpozJ
                      johnpoz LAYER 8 Global Moderator
                      last edited by

                      So now I have created the routes on each pf pointing to the network on the other pfsense.

                      See attached.

                      So there is a machine on each network 192.168.0.100 (site1) and 192.168.10.100 (site2)

                      So you can see they can ping the other machine on the other network, and if you do a trace route.  They hit their pfsense, go across the transit and hit the other side 192.168.1.1 or .2 depending on the direction your going.

                      I will now create the gateway group and create the rules to allow if your local internet is down to use the other sides internet..

                      routestoothernetworks.png
                      routestoothernetworks.png_thumb

                      An intelligent man is sometimes forced to be drunk to spend time with his fools
                      If you get confused: Listen to the Music Play
                      Please don't Chat/PM me for help, unless mod related
                      SG-4860 24.11 | Lab VMs 2.8, 24.11

                      1 Reply Last reply Reply Quote 0
                      • johnpozJ
                        johnpoz LAYER 8 Global Moderator
                        last edited by

                        Ok..

                        So I created gateway groups on each side.

                        I used packetloss or high latency.. as the failover method.

                        I then added rule on the lan to allow the other network using default routing.

                        Then on the default lan rule changed its gateway to use the failover group.

                        Now when I simulate a failure on the site2 wan it goes out the site1 connection - which you can see from the traceroutes.

                        Any questions just ask..

                        gatewaygroup.png
                        gatewaygroup.png_thumb
                        editlanrules.png
                        editlanrules.png_thumb
                        nofailover.png
                        nofailover.png_thumb
                        failedoverroute.png
                        failedoverroute.png_thumb

                        An intelligent man is sometimes forced to be drunk to spend time with his fools
                        If you get confused: Listen to the Music Play
                        Please don't Chat/PM me for help, unless mod related
                        SG-4860 24.11 | Lab VMs 2.8, 24.11

                        1 Reply Last reply Reply Quote 0
                        • I
                          irs
                          last edited by

                          @johnpoz:

                          Sorry did not see your response.. I will try and fire up 2.3.4p1 today and get your screenshots.  But to be honest have already given you all the steps..

                          1 Reply Last reply Reply Quote 0
                          • johnpozJ
                            johnpoz LAYER 8 Global Moderator
                            last edited by

                            huh??  Dude I have posted all kinds of screenshots showing all the different steps.

                            An intelligent man is sometimes forced to be drunk to spend time with his fools
                            If you get confused: Listen to the Music Play
                            Please don't Chat/PM me for help, unless mod related
                            SG-4860 24.11 | Lab VMs 2.8, 24.11

                            1 Reply Last reply Reply Quote 0
                            • I
                              irs
                              last edited by

                              I am really thankful once again for the efforts you extended for me I will use these instructions and post the after successful implementation.

                              1 Reply Last reply Reply Quote 0
                              • I
                                irs
                                last edited by

                                I followed all the instructions and images you have described but sofar am unable to get the internet on pf2.

                                pfI can access both pfsense but no internet on 192.168.10.0/24 network (the wan is down on pf2 [192.168.10.0/24])

                                1 Reply Last reply Reply Quote 0
                                • I
                                  irs
                                  last edited by

                                  I followed all the instructions and images you have described but sofar am unable to get the internet on pf2.

                                  I can access both pfsense (pf1 & pf2) but no internet on 192.168.10.0/24 network (the wan is down on pf2 [192.168.10.0/24])

                                  pf1 wan is up and working fine.

                                  ![pf2 dashboard.PNG](/public/imported_attachments/1/pf2 dashboard.PNG)
                                  ![pf2 dashboard.PNG_thumb](/public/imported_attachments/1/pf2 dashboard.PNG_thumb)
                                  ![pf1 dashboard.PNG](/public/imported_attachments/1/pf1 dashboard.PNG)
                                  ![pf1 dashboard.PNG_thumb](/public/imported_attachments/1/pf1 dashboard.PNG_thumb)

                                  1 Reply Last reply Reply Quote 0
                                  • johnpozJ
                                    johnpoz LAYER 8 Global Moderator
                                    last edited by

                                    "(the wan is down on pf2 [192.168.10.0/24])"

                                    well that would be a problem now wouldn't it.. How would it work if the wan is down??  That has nothing to do with the transit or connectivity between the pfsenses, etc.

                                    Why do you have 2 transits?

                                    What sort of wan do you have that it doesn't show an interface assigned to it for speed and duplex, etc.

                                    An intelligent man is sometimes forced to be drunk to spend time with his fools
                                    If you get confused: Listen to the Music Play
                                    Please don't Chat/PM me for help, unless mod related
                                    SG-4860 24.11 | Lab VMs 2.8, 24.11

                                    1 Reply Last reply Reply Quote 0
                                    • I
                                      irs
                                      last edited by

                                      The wan is down since morning on site 2 (pf2) but the site 1 has the internet (pf1) wan is working

                                      1 Reply Last reply Reply Quote 0
                                      • I
                                        irs
                                        last edited by

                                        @johnpoz:

                                        "(the wan is down on pf2 [192.168.10.0/24])"

                                        well that would be a problem now wouldn't it.. How would it work if the wan is down??  That has nothing to do with the transit or connectivity between the pfsenses, etc.

                                        Why do you have 2 transits?

                                        What sort of wan do you have that it doesn't show an interface assigned to it for speed and duplex, etc.

                                        i made another Transit just to see if i have made something wrong.

                                        1 Reply Last reply Reply Quote 0
                                        • I
                                          irs
                                          last edited by

                                          if one wan on any pf goes down wouldn't it takes over to other pf wan which is up through transit?

                                          1 Reply Last reply Reply Quote 0
                                          • I
                                            irs
                                            last edited by

                                            what should I do?

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.