Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Port-forwarding, UPNP, NAT-PMP issues I can't resolve...

    Scheduled Pinned Locked Moved Firewalling
    17 Posts 2 Posters 4.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnpozJ
      johnpoz LAYER 8 Global Moderator
      last edited by johnpoz

      @occamsrazor said in Port-forwarding, UPNP, NAT-PMP issues I can't resolve...:

      12:20:26.325823 IP 87.98.162.88.52390 > 192.168.0.4.10004: tcp 0
      12:20:26.326102 IP 192.168.0.4.10004 > 87.98.162.88.52390: tcp 0

      Ok there is answer to 10004.. But what was the answer maybe it was Reset.. The first there should be Syn to open the connection.. But what did he answer?

      Do the sniff on pfsense, diag, packet capture -- put in your IP 192.168.0.4 and the port using lan as capture interface - and then open the sniff in wireshark.. You should see the syn and syn,ack answer.. If sending syn,ack - and you see that on pfsense lan, but you do not see it go out the wan then you have a problem. If you see it go out pfsense wan then you go problem upstream.

      An intelligent man is sometimes forced to be drunk to spend time with his fools
      If you get confused: Listen to the Music Play
      Please don't Chat/PM me for help, unless mod related
      SG-4860 24.11 | Lab VMs 2.8, 24.11

      occamsrazorO 1 Reply Last reply Reply Quote 0
      • occamsrazorO
        occamsrazor @johnpoz
        last edited by occamsrazor

        @johnpoz said in Port-forwarding, UPNP, NAT-PMP issues I can't resolve...:

        Do the sniff on pfsense, diag, packet capture -- put in your IP 192.168.0.4 and the port using lan as capture interface - and then open the sniff in wireshark.. You should see the syn and syn,ack answer.. If sending syn,ack - and you see that on pfsense lan, but you do not see it go out the wan then you have a problem. If you see it go out pfsense wan then you go problem upstream.

        Here is the capture on the LAN for Mac Mini host 192.168.0.4 and port 10004:

        0_1535190789033_Wireshark LAN capture.jpg

        When I do the same capture on WAN it is empty.

        I then tried on the Macbook and got this:

        0_1535191539195_Wireshark MacbookLAN capture.jpg

        I don't see the Transmission port check server there, and now the Macbook is having the same issue and is showing port closed like the Mac Mini did.

        EDIT: Now the Macbook is working again and this is what the LAN capture looks like:

        0_1535191915269_Screen Shot 2018-08-25 at 13.10.06.jpg

        pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
        Ubiquiti Unifi wired and wireless network, APC UPSs
        Mac OSX and IOS devices, QNAP NAS

        1 Reply Last reply Reply Quote 0
        • johnpozJ
          johnpoz LAYER 8 Global Moderator
          last edited by johnpoz

          Your first image there shows the client sending RST!!! So no the port is not going to show open because the client basically said in a nutshell - F OFF!!

          You can not actually validate UDP ports with sites like can you see me org..

          An intelligent man is sometimes forced to be drunk to spend time with his fools
          If you get confused: Listen to the Music Play
          Please don't Chat/PM me for help, unless mod related
          SG-4860 24.11 | Lab VMs 2.8, 24.11

          occamsrazorO 1 Reply Last reply Reply Quote 0
          • occamsrazorO
            occamsrazor @johnpoz
            last edited by

            @johnpoz said in Port-forwarding, UPNP, NAT-PMP issues I can't resolve...:

            Thanks again for your help in nailing down the cause, much appreciated...

            Your first image there shows the client sending RST!!! So no the port is not going to show open because the client basically said in a nutshell - F OFF!!

            Do you have any idea why it might be sending this "RST"? Is it likely the OS sending it or Transmission? Any ideas on how one might fix the problem?

            You can not actually validate UDP ports with sites like can you see me org..

            I think the problematic packet and the RST are a TCP packet... no?

            pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
            Ubiquiti Unifi wired and wireless network, APC UPSs
            Mac OSX and IOS devices, QNAP NAS

            1 Reply Last reply Reply Quote 0
            • johnpozJ
              johnpoz LAYER 8 Global Moderator
              last edited by

              The RST is tcp yes... But you can not actually know if something is working or not with canyouseeme if its UDP. P2P is going to normally be tcp and udp..

              As to why your client is answer back with RST, no idea - but that is not anything to do with with pfsense.. You would have to get with mac os users or forum support your transmission client, etc.

              What OS you running on this mac mini? Is apple or a linux OS? If linux could be of some help, but I don't use OS X so not going to be much help trying to figure out what is sending RST... What I can tell you is that is BAD practice.. Especially to a public IP.. sending RST to IP that is on the same local network is ok - but answering RST to some ip that is not local is bad.. Firewalls don't normally do that, because its bad idea and if under attack for some sort of dos attack your just going to be hurting yourself sending a RST..

              Is it sending a icmp redirection as well? Sniff for the IP on the pfsense lan and do your test again.. Any as the protocol, ipv4

              An intelligent man is sometimes forced to be drunk to spend time with his fools
              If you get confused: Listen to the Music Play
              Please don't Chat/PM me for help, unless mod related
              SG-4860 24.11 | Lab VMs 2.8, 24.11

              occamsrazorO 1 Reply Last reply Reply Quote 0
              • occamsrazorO
                occamsrazor @johnpoz
                last edited by occamsrazor

                @johnpoz said in Port-forwarding, UPNP, NAT-PMP issues I can't resolve...:

                As to why your client is answer back with RST, no idea - but that is not anything to do with with pfsense.. You would have to get with mac os users or forum support your transmission client, etc.

                Thanks. Ugh, I think this is going to be hard to nail down. I'm running Mac OSX 10.12.

                Is it sending a icmp redirection as well? Sniff for the IP on the pfsense lan and do your test again.. Any as the protocol, ipv4

                I don't think so. Here is an all ports capture of the Mac Mini.

                0_1535264354125_MacMini all ports.jpg

                I have tried complete uninstall and reinstall of Transmission but it didn't help. I am thinking it must be something in the OS itself, rather than Transmission, because the same issue happens when I try to get remote access to Plex media server....

                0_1535264429260_Plex RST.jpg

                PS - Ignore the change from 192.168.0.4 to .2 - that was me changing the IP for testing, it's the same machine.

                I've posted for advice on the r/osx subreddit here: https://www.reddit.com/r/osx/comments/9adpuk/osx_networking_issue_port_forwards_failing_rst/

                pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                Ubiquiti Unifi wired and wireless network, APC UPSs
                Mac OSX and IOS devices, QNAP NAS

                1 Reply Last reply Reply Quote 0
                • johnpozJ
                  johnpoz LAYER 8 Global Moderator
                  last edited by johnpoz

                  I would have to guess your firewall is still running.. But in a bad configuration - what OS are you running?

                  Did actually validate listening on those ports with say a netstat -an.. This command works on any os really.. window, linux, os

                  Many OSes if hit directly with no firewall will send RST when port is not listing..

                  0_1535280265901_window10RST.png

                  Im not listening on 444, if I forward 444 to my windows machine it sends back a RST..

                  An intelligent man is sometimes forced to be drunk to spend time with his fools
                  If you get confused: Listen to the Music Play
                  Please don't Chat/PM me for help, unless mod related
                  SG-4860 24.11 | Lab VMs 2.8, 24.11

                  occamsrazorO 1 Reply Last reply Reply Quote 0
                  • occamsrazorO
                    occamsrazor @johnpoz
                    last edited by

                    @johnpoz said in Port-forwarding, UPNP, NAT-PMP issues I can't resolve...:

                    I would have to guess your firewall is still running.. But in a bad configuration - what OS are you running?

                    Did actually validate listening on those ports with say a netstat -an.. This command works on any os really.. window, linux, os x

                    I did a netstat and traceroute, and posted the results in my post on Reddit here (I didn't want to clog up this forum any more seeing as it's clearly an OSX issue not pfSense): https://www.reddit.com/r/osx/comments/9adpuk/osx_networking_issue_port_forwards_failing_rst/e4urk4v/

                    I tried two other things: Using a different user account on the Mac Mini = same problem. Booting the mac Mini from a clean OSX install on external drive = NO problem. This clearly indicates to me it's an issue with the OSX install... I think when I have time I'll have to nuke the whole OS and start all over again, but that's going to take some serious time so I'll have to put that plan on hold.

                    Appreciate all the help - at least I don't need to spend any more time investigating pfSense, switches, etc.

                    pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                    Ubiquiti Unifi wired and wireless network, APC UPSs
                    Mac OSX and IOS devices, QNAP NAS

                    1 Reply Last reply Reply Quote 0
                    • johnpozJ
                      johnpoz LAYER 8 Global Moderator
                      last edited by

                      Those are netstat -r, just showing your routes... Not what your machine is actually listening on.. For example

                      See here listening on 3389 (remote desktop) on my windows machine
                      0_1535281836569_listen3389.png

                      actually validate your machine is listening on the port you think it is! tcp will send RST when not listening.. But firewall normally default to "stealth" mode..

                      An intelligent man is sometimes forced to be drunk to spend time with his fools
                      If you get confused: Listen to the Music Play
                      Please don't Chat/PM me for help, unless mod related
                      SG-4860 24.11 | Lab VMs 2.8, 24.11

                      1 Reply Last reply Reply Quote 0
                      • occamsrazorO
                        occamsrazor
                        last edited by

                        I was unable to do netstat with the "find" addition like in your screenshot, maybe syntax is different in OSX. But when I do "netstat -an" and then search for 10002 in the long list of output, I see these items (Transmission port is now set to 10002):

                        Proto Recv-Q Send-Q  Local Address          Foreign Address        (state) 
                        
                        tcp6       0      0  *.10002                *.*                    LISTEN     
                        tcp4       0      0  *.10002                *.*                    LISTEN
                        
                        tcp4       0      0  192.168.0.2.10002      185.230.125.35.37657   TIME_WAIT  
                        tcp4       0      0  192.168.0.2.10002      87.67.39.175.56083     TIME_WAIT  
                        tcp4       0      0  192.168.0.2.10002      84.104.165.198.63194   TIME_WAIT  
                        tcp4       0      0  192.168.0.2.10002      82.173.50.104.57184    TIME_WAIT 
                        
                        udp4       0      0  *.10002                *.*    
                        
                        

                        pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                        Ubiquiti Unifi wired and wireless network, APC UPSs
                        Mac OSX and IOS devices, QNAP NAS

                        1 Reply Last reply Reply Quote 0
                        • johnpozJ
                          johnpoz LAYER 8 Global Moderator
                          last edited by johnpoz

                          Well yeah its different in windows ;)

                          So something is listening on 10002, And looks like your in a time_wait connection with 4 other IPs..

                          Time wait means that hey this connection should be close but will leave the socket open until the time out..

                          You sure you don't have any sort of ACL or something in the software that says who can talk to it? Do you see the same thing for your plex?

                          Normally!!! If you your in a time_wait state and you get more traffic on that same conversation setup ie same IP and same port as source the server (listening side) would for sure send back a RST.. Telling you hey this conversation is closed..

                          If the socket was in in time_wait and it got an RST then I believe it should close right then.. You seeing sockets in time_wait is another wrench in the issue..

                          But again - this has zero to do with pfsense, or connectivity at all.. And something with the OS or application on the box.. Pfsense did its job it sent the SYN through.. It can not help the that client sends back RST..

                          An intelligent man is sometimes forced to be drunk to spend time with his fools
                          If you get confused: Listen to the Music Play
                          Please don't Chat/PM me for help, unless mod related
                          SG-4860 24.11 | Lab VMs 2.8, 24.11

                          1 Reply Last reply Reply Quote 0
                          • occamsrazorO
                            occamsrazor
                            last edited by

                            Ok I worked out the OSX netstat syntax to focus on particular ports. Here is for Transmission and then for the Plex port:

                            mediamac:~ ben$ netstat -an |grep .10002
                            tcp4       0      0  192.168.0.2.10002      94.245.58.211.60686    SYN_RCVD   
                            tcp4       0      0  192.168.0.2.10002      178.82.144.61.60173    ESTABLISHED
                            tcp6       0      0  *.10002                *.*                    LISTEN     
                            tcp4       0      0  *.10002                *.*                    LISTEN     
                            tcp4       0      0  192.168.0.2.10002      84.104.165.198.58890   TIME_WAIT  
                            udp4       0      0  *.10002                              
                            mediamac:~ ben$ netstat -an | grep .32400
                            tcp4       0      0  127.0.0.1.32400        127.0.0.1.51153        ESTABLISHED
                            tcp4       0      0  127.0.0.1.51153        127.0.0.1.32400        ESTABLISHED
                            tcp4       0      0  127.0.0.1.32400        127.0.0.1.51096        ESTABLISHED
                            tcp4       0      0  127.0.0.1.51096        127.0.0.1.32400        ESTABLISHED
                            tcp4       0      0  127.0.0.1.32400        127.0.0.1.49318        ESTABLISHED
                            tcp4       0      0  127.0.0.1.49318        127.0.0.1.32400        ESTABLISHED
                            tcp46      0      0  *.32400                *.*                    LISTEN
                            

                            So it seems same for Plex. And agreed nothing to do with pfSense....

                            pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                            Ubiquiti Unifi wired and wireless network, APC UPSs
                            Mac OSX and IOS devices, QNAP NAS

                            1 Reply Last reply Reply Quote 0
                            • johnpozJ
                              johnpoz LAYER 8 Global Moderator
                              last edited by

                              Looks like in your 10002 your in syn_rcvd state from that 1 IP.. And do have an established connection with 178.82.x.x and in a time wait for another..

                              So your going to have to work out whatever is wrong if your client or ACL... Possible your running a block list in transmission, you know keep the "spies" out... isn't there large black lists of the bad guys to try and keep out of the swarm?

                              As to plex.. Maybe something common with firewall running that you think you turned off, or 3rd party security software you running on the box?

                              An intelligent man is sometimes forced to be drunk to spend time with his fools
                              If you get confused: Listen to the Music Play
                              Please don't Chat/PM me for help, unless mod related
                              SG-4860 24.11 | Lab VMs 2.8, 24.11

                              1 Reply Last reply Reply Quote 0
                              • occamsrazorO
                                occamsrazor
                                last edited by

                                SOLVED.....

                                On the offchance it helps someone else, in the end I fixed it by...

                                1. Deleting the OSX firewall preference .plist located at /Library/Preferences/com.apple.alf.plist
                                2. Cleaning system & user caches
                                3. Restarting
                                4. Enabling the firewall
                                5. Doing this all a couple of times...

                                What's strange is this whole time the firewall was OFF in System Preferences, so I've no idea why this should affect things. In addition, I had previously during testing deleted this file but seems you have to do it and restart, maybe more than once, to really clear it.

                                Thanks for all the patient help in narrowing down the problem, really much appreciated....

                                pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                                Ubiquiti Unifi wired and wireless network, APC UPSs
                                Mac OSX and IOS devices, QNAP NAS

                                1 Reply Last reply Reply Quote 0
                                • First post
                                  Last post
                                Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.