Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Problem with TCP and GRE tunnel

    Scheduled Pinned Locked Moved General pfSense Questions
    64 Posts 3 Posters 8.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S
      stephenw10 Netgate Administrator
      last edited by

      The pcap should be identical on the local GRE and LAN interfaces. If it isn't that's probably where the problem is.

      GRE has a few quirks that OpenVPN or route-mode IPSec do not. Since you're not NATing or encrypting though you shouldn't be hitting any of them.

      S 1 Reply Last reply Reply Quote 0
      • S
        StomperG @stephenw10
        last edited by

        @stephenw10 I think they are but maybe i miss something, do you want me to upload the pcap on the same URL?

        1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator
          last edited by

          Yes please.

          S 1 Reply Last reply Reply Quote 0
          • S
            StomperG @stephenw10
            last edited by

            @stephenw10 Done

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              Ok well the delay is a lot longer there but you can see the local host sends the http request almost immediately after the handshake. So packets are being lost somewhere.

              Try running pcaps on both ends of the GRE tunnel at the same time. Run the curl command and see how they compare.

              S 1 Reply Last reply Reply Quote 0
              • S
                StomperG @stephenw10
                last edited by

                @stephenw10 Just upload them. Also how can I open the pcap files to compare them?

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Using Wireshark is easiest. Though you can also just set the view to high or full in the pfSense webgui and see the timing info etc.

                  S 1 Reply Last reply Reply Quote 0
                  • S
                    StomperG @stephenw10
                    last edited by

                    @stephenw10 But are you able to see any difference between them now?

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      Yes, you can see the local end sees the initial http request at 0.02 but no reply. It retransmits that request 10 times until it finally sees a reply at 114s.

                      At the remote end it never sees any requests arrive until 114s.

                      Something is dropping those packets in the route. They are not large packets so not an MTU issue that might be caused by encapsulation.

                      I assume you gateways setup for the GRE tunnel, do you see packet loss logged on them?

                      Just to confirm; are you using encryption here? GRE over IPSe transport?

                      S 1 Reply Last reply Reply Quote 0
                      • S
                        StomperG @stephenw10
                        last edited by

                        @stephenw10 On both sides pf say 0.0% packet loss while using curl. Also no, im not using encryption or GRE over IPSe

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          Hmm. What happens if you run curl against the webgui at the remote side?

                          Or try running an iperf test between the two pf instances.

                          1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            Also try running a pcap on the WAN interface of the local pf when running that same curl test. You should not see any traffic leaving there directly other than the GRE encapsulated traffic.

                            S 1 Reply Last reply Reply Quote 0
                            • S
                              StomperG @stephenw10
                              last edited by

                              @stephenw10 I already tried to see the traffic on WAN (local pf) and theres no traffic. I will try the other 2 things give me a sec

                              1 Reply Last reply Reply Quote 1
                              • stephenw10S
                                stephenw10 Netgate Administrator
                                last edited by

                                The other thing to test would be a pcap on both WANs at the same time so you can check if GRE packets are leaving the local WAN and just not arriving at the remote WAN. I.E. is it an actual problem in the route somewhere.

                                S 2 Replies Last reply Reply Quote 0
                                • S
                                  StomperG @stephenw10
                                  last edited by

                                  @stephenw10 I can curl without problems on the remote one. Also how can i do a iperf?

                                  1 Reply Last reply Reply Quote 0
                                  • S
                                    StomperG @stephenw10
                                    last edited by StomperG

                                    @stephenw10 I did it now and theres no logs on the local side (WAN) while doing a pcap

                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      iperf is a package you can install in the gui. You can also install just the backend pkg at the command line if you want.

                                      @StomperG said in Problem with TCP and GRE tunnel:

                                      I did it now and theres no logs on the local side (WAN) while doing a pcap

                                      So the local side isn't actually sending GRE packets even though the pcap on the GRE interface shows them?

                                      S 1 Reply Last reply Reply Quote 0
                                      • S
                                        StomperG @stephenw10
                                        last edited by

                                        @stephenw10 At least the WAN pcap on the local dont show anything

                                        K 1 Reply Last reply Reply Quote 0
                                        • stephenw10S
                                          stephenw10 Netgate Administrator
                                          last edited by

                                          Nothing at all? It must show the GRE packets if the curl command succeeds. Or do you mean just during the unexpected delay?

                                          S 2 Replies Last reply Reply Quote 0
                                          • K
                                            Konstanti @StomperG
                                            last edited by Konstanti

                                            @StomperG

                                            Hi
                                            maybe this will help
                                            I don't remember why I set up the rules this way (I think I read it in some article), but
                                            1 GRE interface (MSS 1380)
                                            2 created this floating rule for GRE interface (TUN100)

                                            2905ff65-7d7b-44ad-886b-194a33695453-image.png

                                            5f98e495-11ba-4640-9423-b5f92765c0ba-image.png

                                            7bdb0851-9887-4081-8261-86ebdd87988a-image.png

                                            here is an example of the information transfer rate through a tunnel with these settings

                                            d5ea36cd-2932-4b0b-841b-aca9563b9b03-image.png

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.