How to shape Usenet downloads?
-
Hello there, I'm looking for a little bit of help.
I've got the traffic shaper working nicely with CBQ queues.I'm only sending entire hosts to each queue however and I would like to start breaking traffic down further by shaping it by port.
My question is regarding usenet traffic. I use SABnzbd to download via a Usenet server I subscribe to.
In my connection settings to this particular server I connect on port 8000. I think thats just the port on which authentication occurs or something.
I'm allowed to have 20 connections to the server at any given time.How do I know the incoming ports on which data is being delievered? That way I can set rules for those ports.
If I can have 20 connections does that mean there could be 20 ports potentially?When I set up the rules initially to send entire hosts to the queues I followed a tutorial I found somewhere, it said to place the rules in both the Floating tab AND the LAN tab. Is this necessary? I'm new to pfSense and trying to learn the ins and outs.
Thanks.
-
If it's usenet it's probably port 119 or 563.
-
So its enough to just set rules for port 563 (for example) and ALL usenet traffic will be sent to the correct queue?
Like I said above, if there's 20 connections downloading at the same time they all use port 563? -
Most likely, they are all connecting to the same port. That's how they usually work.
The only way to know would be to check Diag > States, or a packet capture, or find some way to get your usenet client to tell you.
-
Yeah the tricky part is trying to see the connections.
The reason is I also have pfSense connected to a VPN and all my inbound/outbound traffic is being sent through it.
So all my traffic looks like its coming from the IP of the VPN provider. So I can't determine what traffic is what, it doesn't show the IP of the actual host, just of the current server I'm connected to via VPN.Do you know of a way in sabnzdb to see the ports its currently downloading on? (other than whats in the config options –> servers)
For the record I'm using port 563, ssl connection.
-
If pfSense is connecting to the VPN, you should still see the individual connections on the LAN side and in the states table.
Alternately, on your client workstation, check "netstat -na" and/or TCPview ( http://technet.microsoft.com/en-us/sysinternals/bb897437.aspx ) if it's Windows.
-
Alrighty, so I used TCPview to see all the connections on the machine in question (desktop computer).
Below are the connections associated with the Usenet downloads:http://min.us/lMXrfdAZ5jIPj
Now, how would I use this info to create a rule that sends this data to my Low Priority queue?
I've tried it like 5 different ways, most of which seemed pretty intuitive, but none works…Do I make the rule on the LAN tab? Floating? the VPN tab that these connections are coming in on?
All of them?I tried it so many ways, and it just seems to halt the download every time I change something.
Thanks again...
-
They're all going to the same port (563). You'd use a queue rule on the Floating tab to match it.
If you aren't sure what the rules should look like, run through the shaper wizard and setup some of the priority rules for protocols. There is an NNTP setting there, just use it and then edit the rule to refer to 563 instead of 119.
-
Awesome. Thanks.
I just got it working, I ran through the shaper wizard, saw how it set it up then added the rules manually to my setup.It seemed to want to see two rules, one for TCP and one for UDP. I tried earlier using the TCP/UDP setting in the protocol list pull-down and everything else the same, it didn't work.
Maybe I'm misunderstanding the TCP/UDP setting.. doesn't it mean OR? TCP OR UDP? I guess not… because when I set up a rule just for TCP and one just for UDP it worked.
Thanks again.
-
TCP/UDP rules cover both TCP and UDP, so packets can use either protocol and it will work.
Usenet traffic would be all TCP as far as I know.