Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    How to shape Usenet downloads?

    Scheduled Pinned Locked Moved Traffic Shaping
    10 Posts 2 Posters 4.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K
      killerb81
      last edited by

      Hello there, I'm looking for a little bit of help.
      I've got the traffic shaper working nicely with CBQ queues.

      I'm only sending entire hosts to each queue however and I would like to start breaking traffic down further by shaping  it by port.

      My question is regarding usenet traffic.  I use SABnzbd to download via a Usenet server I subscribe to.
      In my connection settings to this particular server I connect on port 8000. I think thats just the port on which authentication occurs or something.
      I'm allowed to have 20 connections to the server at any given time.

      How do I know the incoming ports on which data is being delievered?  That way I can set rules for those ports.
      If I can have 20 connections does that mean there could be 20 ports potentially?

      When I set up the rules initially to send entire hosts to the queues I followed a tutorial I found somewhere, it said to place the rules in both the Floating tab AND the LAN tab.  Is this necessary?  I'm new to pfSense and trying to learn the ins and outs.

      Thanks.

      1 Reply Last reply Reply Quote 0
      • jimpJ
        jimp Rebel Alliance Developer Netgate
        last edited by

        If it's usenet it's probably port 119 or 563.

        Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

        Need help fast? Netgate Global Support!

        Do not Chat/PM for help!

        1 Reply Last reply Reply Quote 0
        • K
          killerb81
          last edited by

          So its enough to just set rules for port 563 (for example) and ALL usenet traffic will be sent to the correct queue?
          Like I said above, if there's 20 connections downloading at the same time they all use port 563?

          1 Reply Last reply Reply Quote 0
          • jimpJ
            jimp Rebel Alliance Developer Netgate
            last edited by

            Most likely, they are all connecting to the same port. That's how they usually work.

            The only way to know would be to check Diag > States, or a packet capture, or find some way to get your usenet client to tell you.

            Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

            Need help fast? Netgate Global Support!

            Do not Chat/PM for help!

            1 Reply Last reply Reply Quote 0
            • K
              killerb81
              last edited by

              Yeah the tricky part is trying to see the connections.
              The reason is I also have pfSense connected to a VPN and all my inbound/outbound traffic is being sent through it.
              So all my traffic looks like its coming from the IP of the VPN provider.  So I can't determine what traffic is what, it doesn't show the IP of the actual host, just of the current server I'm connected to via VPN.

              Do you know of a way in sabnzdb to see the ports its currently downloading on?  (other than whats in the config options –> servers)

              For the record I'm using port 563, ssl connection.

              1 Reply Last reply Reply Quote 0
              • jimpJ
                jimp Rebel Alliance Developer Netgate
                last edited by

                If pfSense is connecting to the VPN, you should still see the individual connections on the LAN side and in the states table.

                Alternately, on your client workstation, check "netstat -na" and/or TCPview ( http://technet.microsoft.com/en-us/sysinternals/bb897437.aspx ) if it's Windows.

                Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                Need help fast? Netgate Global Support!

                Do not Chat/PM for help!

                1 Reply Last reply Reply Quote 0
                • K
                  killerb81
                  last edited by

                  Alrighty, so I used TCPview to see all the connections on the machine in question (desktop computer).
                  Below are the connections associated with the Usenet downloads:

                  http://min.us/lMXrfdAZ5jIPj

                  Now, how would I use this info to create a rule that sends this data to my Low Priority queue?
                  I've tried it like 5 different ways, most of which seemed pretty intuitive, but none works…

                  Do I make the rule on the LAN tab?  Floating?  the VPN tab that these connections are coming in on?
                  All of them?

                  I tried it so many ways, and it just seems to halt the download every time I change something.

                  Thanks again...

                  1 Reply Last reply Reply Quote 0
                  • jimpJ
                    jimp Rebel Alliance Developer Netgate
                    last edited by

                    They're all going to the same port (563). You'd use a queue rule on the Floating tab to match it.

                    If you aren't sure what the rules should look like, run through the shaper wizard and setup some of the priority rules for protocols. There is an NNTP setting there, just use it and then edit the rule to refer to 563 instead of 119.

                    Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                    Need help fast? Netgate Global Support!

                    Do not Chat/PM for help!

                    1 Reply Last reply Reply Quote 0
                    • K
                      killerb81
                      last edited by

                      Awesome. Thanks.
                      I just got it working, I ran through the shaper wizard, saw how it set it up then added the rules manually to my setup.

                      It seemed to want to see two rules, one for TCP and one for UDP.  I tried earlier using the TCP/UDP setting in the protocol list pull-down and everything else the same, it didn't work.

                      Maybe I'm misunderstanding the TCP/UDP setting.. doesn't it mean OR?  TCP OR UDP?  I guess not… because when I set up a rule just for TCP and one just for UDP it worked.

                      Thanks again.

                      1 Reply Last reply Reply Quote 0
                      • jimpJ
                        jimp Rebel Alliance Developer Netgate
                        last edited by

                        TCP/UDP rules cover both TCP and UDP, so packets can use either protocol and it will work.

                        Usenet traffic would be all TCP as far as I know.

                        Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                        Need help fast? Netgate Global Support!

                        Do not Chat/PM for help!

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post
                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.