Scheduled blocks won't work without manual states reset
-
Despite trying many things, putting rules in various orders, etc., I am wholly unable to get this to work.
Can anyone offer any other solutions?
-
Please check option in setting Settings / Advanced / Miscellaneous: "Schedule States" which was set as the default "clear the states of existing connections when expiry time has come" make sure its not check.
And do note also block rules does not relates to states. meaning the settings above does not effected if you have block rules in schedule you just have to add scheduled alllow rule for the states to reset.
Have mine working effectively without resetting states manually.
Regards,
RocelBut if I have to have allow rules (instead of block rules), I basically have to allow any, any, but in general I have only very few things allowed at all (most things not available from LAN). How to implement that with scheduled access for some users?
Edit: I have now an alias for the ports to allow and a scheduled allow rule, let's see how this works!
With the block rule and 3 minutes later a "pfcrtl -F state" (via Cron job) these guys managed (with an open browser…) to re-establish states and play on 2 hours after the scheduled block had started...
EDIT: There was a syntax error in the pfcrtl command that didn't make it work, with the correct "pfcrtl -F state" it's definitely GAME OVER; however, all other users get their states killed, too. Only killing states for the respective user(s) with "pfctl -k <ip>" doesn't do the job…
PS: Some general remarks by a pro, as usual that general ("You may need to use the -k twice, etc.") that the NOOB fraction can't get where they want to without 2 hours of man pages and trial and error and and and…
https://forum.pfsense.org/index.php?topic=76053.msg418139#msg418139</ip>
-
kryptos,
That box is not checked in my config.
My rules are attached. I know I probably need to post the specifics, but at least you can see the order. Two on top for blocking based on schedule, two in the middle for allowing but with bandwidth limits, and the two default on bottom.
Right now for example the schedule should not be running – clients should have access. But they do not.
Your rules should be fine. what is schedule details?
What are your goals for this be specific.
Regards,
Rocel -
Specifically:
I have an alias created called "kids_devices." This contains assigned IPs for iPods, Kindles, and other crap devices I wish the kids didn't have. Also, the Nintendo Wii, and the family PC.
I want all of these devices to be limited to 300k down/250k up, except the Wii, at 500k down, 250k up. That worked until today, when suddenly one of the Kindles was doing 20mbps downstream. I reset the states table and it went back to being limited. First problem: my limiter works most of the time, not always. Why I can't get it to work 100% of the time is totally beyond me, seems simple enough.
Anyway, either with the limiter rules as separate rules, or adding them to schedule rules, I want to create schedule that allow "kids_devices" to access the internet from 1200-1500 and 1900-2200 hrs. I want no internet access for and of those devices outside of these times.
I'm not sure how many rule sets I need to create (ie one for allow during said times, a separate one for block during opposite times, etc) and what order to put them in. I've tried various combinations of all of it (rules for block, rules for allow, block rules on top in the stack, allow rules on top in the stack, etc) and nothing ever worked (everything was either blocked all the time or allowed all the time). I guess maybe the simplest would be to create a block rule that blocks "kids_devices", and under that create an allow rule for the specified times? Again I have no idea how to do it or what order to use, but everything I've tried to this point doesn't work.
And resetting my states table has become a daily thing for any number of reasons which seem to break the network, rules are ignored, limits are ignored, etc.
Which is annoying.
-
What I learned throughout the last weeks: Nobody is interested to make something like this really work. I have a simple block rule for the time, when internet is off-limits. Doesn't work, as the states stay alive.
Next I tried a Cron ob to kill the states for the IPs blocked, didn't work and a Cron job to kill all states doesn't work, either. Also an eMail report (which basically works via a Cron job) is not working properly. Re-installing the Cron package didn't change anything. I could try a fresh install, but I don'T have the time.
Only thing that helps: Filter the states under Diagnostics -> States and kill them.
Block or allow rules made no difference to me. I have the block rule for the kids very high in the list of firewall rules and subsequently the "allow" rules for all LAN IPs for certain ports.
-
Sad. I continue to have problems with the limiter, rules, and I've given up on schedule times.
Certainly you and I are not the only ones who would like to use this feature. Wonder why its not a priority?
-
Best guess: "Repressive parents" are the bad guys in this play, "little children looking for freedom" the good guys? ;)
-
@chemlud:
Best guess: "Repressive parents" are the bad guys in this play, "little children looking for freedom" the good guys? ;)
Ha. Well what about someone who wants to keep an ftp server running on his LAN, but only open it up for WAN access during certain hours? Or shutdown the internet completely when he's not home (without powering down the cable modem) to minimize attacks?
Surely there is more use for these schedules than repressive parents stealing freedom away from their young'ns. If only the schedules worked….
-
Try this:
-
Have your scheduled block rule in the LAN firewall rules
-
Install Cron package
-
Create a Cron job to be run 1 minute after the block becomes effective with the command:
/sbin/pfctl -k >IP on the block list<
(afaik the aliases won't work for Cron, so one job for each IP)works for me now:
https://forum.pfsense.org/index.php?topic=76053.msg424483#msg424483To monitor the states I also have an eMail Report for the states of the respective IPs, sending the output for the command /sbin/pfctl -ss | grep >IP on the block list<
You could configure the block rule to start e.g. at 20:59
At 21:00 you could run the Cron for killing the states and for reporting the states, to see how it works (I have to check if the states killer runs before the eMail Report job, I'll try this evening).;)
Edit: Work's fine with the kill and subsequent eMail Report :-)
-
-
This is my understanding, which could be wrong.
Firewall rules only apply to new connections, it would be crazy expensive to check every packet against every rule.
When a packet comes in on an interface, it firsts checks to see if an existing state exists, which is fast because of hash functions for constant time look ups. If the state does not exist, it then goes to the firewall rules to decide if a state will get created, where it does a linear time check.
Existing states: O(1)
New states: O(n) -
Might be correct, but me as an idi** expects a scheduled block rule to BLOCK EVERYTHING when the schedule is due. So the block rule should kill automatically the respective states (which it is supposed to do in pfSense, as there is an option NOT to kill the states for firewall block rules).
To me it's a mystery why my pfSense doesn't kill the states automatically…
-
Agree.
Even a cheap TP-Link home router is able to block everything when the schedule is due. There's a nice option in their firmware's web interface to do that. -
I'm dealing with this same issue trying to shut off internet to two IPs on my lan at 11pm through 10am.
The System/Advanced/Misc check box for "Schedule States" says:
"By default schedules clear the states of existing connections when the expiration time has come. This option overrides that behavior by not clearing states for existing connections. "
Note that what I'm describing below requires the above checkbox to be UNchecked, which is the default.
The point is that there actually IS an Automatic reset of the related states from the state table like you (we ) desire, but this state reset only occurs at rule expiration time. This makes sure that any connections that are being allowed by the rule are killed when the rule goes away.
So the logic we need to use is that the traffic of interest is normally BLOCKED by an always active rule, and during the scheduled interval a preceding rule will ALLOW the traffic. When the ALLOW rule is active it will allow the packets and prevent the always active Blocking rule from being hit.
When the scheduled rule expires, the states (any active connections that were being allowed) will be reset and both existing and new connections will be prevented by the always active block rule which is below the scheduled rule.
When the scheduled rule goes active again at the next scheduled interval start, it will allow connections and not care about the "state of the state table".
Seems logical anyway… here's a screenshot of what I'm about to try(it's outside the schedule time in this view):
(Also note that I had IPv6 enabled on the kids dekstops and they could still get to google etc that had an IPv6 site... so turn of ipv6 on the hosts or add duplicate rules for ipv6)
-
"So the logic we need to use is that the traffic of interest is normally BLOCKED by an always active rule, and during the scheduled interval a preceding rule will ALLOW the traffic."
Yeah, but with your setup you allow each and everything within the kids hours, I allow only very specific things (http, https, smtps, imaps and very few other ports) and this setup is rather difficult to obtain with your kind of rules, as you would need a rule for every port (or some/ a lot of additional aliases for the IPs/ports allowed…).
-
@chemlud:
"So the logic we need to use is that the traffic of interest is normally BLOCKED by an always active rule, and during the scheduled interval a preceding rule will ALLOW the traffic."
Yeah, but with your setup you allow each and everything within the kids hours, I allow only very specific things (http, https, smtps, imaps and very few other ports) and this setup is rather difficult to obtain with your kind of rules, as you would need a rule for every port (or some/ a lot of additional aliases for the IPs/ports allowed…).
that's true, but you must already have the appropriate allow rules as you explain… so just make those scheduled, and follow them with a single block rule... you can block all right? not just block the ports of interest, so you only need the one block rule.
-
But I have very different blocking times for different user groups. I tried it once with your setup, but gave up after some hours and found the solution described above, which works fine for me now… ;-) I still think it'S the better option for complex situations and restrained internet access with a general block rule and isolated services allowed.
-
Now in my Case things are working totally differently
An Alias called Block_Access with IPs = 192.168.0.12 and 192.168.0.13
Schedule : Mon to Sun 6:30 PM to 9:00PM and Mon-Sun 10:00PM to 23:59PM
FW rule on LAN : IPV4 block Source= Single host or Alias = Block_Access
I get access blocked no issue when clock hits the scheduled time my device can't do anything; but when block schedule expires my device still stays blocked and never gets access to internet.
only way so far i have tried is simply disable the rule; as in block there is no state that i need to clear. -
Now in my Case things are working totally differently
An Alias called Block_Access with IPs = 192.168.0.12 and 192.168.0.13
Schedule : Mon to Sun 6:30 PM to 9:00PM and Mon-Sun 10:00PM to 23:59PM
FW rule on LAN : IPV4 block Source= Single host or Alias = Block_Access
I get access blocked no issue when clock hits the scheduled time my device can't do anything; but when block schedule expires my device still stays blocked and never gets access to internet.
only way so far i have tried is simply disable the rule; as in block there is no state that i need to clear.I believe it works better if you create a 'PASS' rule with the scheduled time for when you want to 'ALLOW' access and also create another 'BLOCK' rule for the alias/IP.
You also need to pay attention to the order of the rules.. the 'BLOCK' rule needs to be below the scheduled 'PASS' rule..
-
The relevant code that kills states when a scheduled rule expires is this pfSense project patch to the FreeBSD pf code: https://github.com/pfsense/FreeBSD-src/commit/49045005c714cd18a0f844d1a70047abaab7523a
The code keeps track of states that are part of a schedule rule by tagging them as they are created, so it is a trivial matter to remove them when the schedule expires. It seems it would be a bit more complicated to dig through all the states looking for the ones that match a scheduled block. I had hoped to tackle this with a patch; maybe some day.
Apologies for posting an apology with no action, but I wanted to leave a lasting note here of where the relevant code is so that I or someone else can find it in the future.
P.S. I am using the "pass rule that expires" work-around to make sure that states get killed when my scheduled reject rule begins.
-
How can I apply the patch?
My pfsense version is 2.3.2-RELEASE-p1 and use the web interface patches, How much do test, the result is:
Patch can NOT be applied cleanly (detail)
Patch can NOT be reverted cleanly (detail)/usr/bin/patch –directory=/ -t -p1 -i /var/patches/586c4515ba093.patch --check --forward --ignore-whitespace
Hmm... Looks like a unified diff to me...
The text leading up to this was:|From 49045005c714cd18a0f844d1a70047abaab7523a Mon Sep 17 00:00:00 2001
|From: Renato Botelho
|Date: Mon, 17 Aug 2015 13:52:56 -0300
|Subject: [PATCH] Importing pfSense patch schedule_label.RELENG_10.diff
|
|–-
| sbin/pfctl/parse.y | 44 ++++++++++++++++++++++++++++++++++++++++++--
| sbin/pfctl/pfctl.c | 32 +++++++++++++++++++++++++++++++-
| sys/net/pfvar.h | 7 +++++++
| sys/netpfil/pf/pf_ioctl.c | 24 ++++++++++++++++++++++++
| 4 files changed, 104 insertions(+), 3 deletions(-)
|
|diff --git a/sbin/pfctl/parse.y b/sbin/pfctl/parse.y
|index 2991473..62a78d1 100644
|--- a/sbin/pfctl/parse.y+++ b/sbin/pfctl/parse.y No file to patch. Skipping... Hunk #1 ignored at 235. Hunk #2 ignored at 343. Hunk #3 ignored at 446. Hunk #4 ignored at 491. Hunk #5 ignored at 1913. Hunk #6 ignored at 2371. Hunk #7 ignored at 3722. Hunk #8 ignored at 5123. Hunk #9 ignored at 5132. Hunk #10 ignored at 5185. Hunk #11 ignored at 5196. Hunk #12 ignored at 5459. Hunk #13 ignored at 6091. 13 out of 13 hunks ignored while patching sbin/pfctl/parse.y Hmm... The next patch looks like a unified diff to me... The text leading up to this was:
|diff --git a/sbin/pfctl/pfctl.c b/sbin/pfctl/pfctl.c
|index 64b4a05..1e957f6 100644
|--- a/sbin/pfctl/pfctl.c+++ b/sbin/pfctl/pfctl.c No file to patch. Skipping... Hunk #1 ignored at 78. Hunk #2 ignored at 118. Hunk #3 ignored at 656. Hunk #4 ignored at 2024. Hunk #5 ignored at 2138. Hunk #6 ignored at 2352. 6 out of 6 hunks ignored while patching sbin/pfctl/pfctl.c Hmm... The next patch looks like a unified diff to me... The text leading up to this was:
|diff --git a/sys/net/pfvar.h b/sys/net/pfvar.h
|index 0b8f0ac..ba8b1d9 100644
|--- a/sys/net/pfvar.h+++ b/sys/net/pfvar.h No file to patch. Skipping... Hunk #1 ignored at 488. Hunk #2 ignored at 1288. Hunk #3 ignored at 1373. 3 out of 3 hunks ignored while patching sys/net/pfvar.h Hmm... The next patch looks like a unified diff to me... The text leading up to this was:
|diff --git a/sys/netpfil/pf/pf_ioctl.c b/sys/netpfil/pf/pf_ioctl.c
|index 96abf2c..23b9efc 100644
|--- a/sys/netpfil/pf/pf_ioctl.c+++ b/sys/netpfil/pf/pf_ioctl.c No file to patch. Skipping... Hunk #1 ignored at 1709. 1 out of 1 hunks ignored while patching sys/netpfil/pf/pf_ioctl.c done /usr/bin/patch --directory=/ -f -p1 -i /var/patches/586c4515ba093.patch --check --reverse --ignore-whitespace
Hmm... Looks like a unified diff to me...
The text leading up to this was:|From 49045005c714cd18a0f844d1a70047abaab7523a Mon Sep 17 00:00:00 2001
|From: Renato Botelho
|Date: Mon, 17 Aug 2015 13:52:56 -0300
|Subject: [PATCH] Importing pfSense patch schedule_label.RELENG_10.diff
|
|–-
| sbin/pfctl/parse.y | 44 ++++++++++++++++++++++++++++++++++++++++++--
| sbin/pfctl/pfctl.c | 32 +++++++++++++++++++++++++++++++-
| sys/net/pfvar.h | 7 +++++++
| sys/netpfil/pf/pf_ioctl.c | 24 ++++++++++++++++++++++++
| 4 files changed, 104 insertions(+), 3 deletions(-)
|
|diff --git a/sbin/pfctl/parse.y b/sbin/pfctl/parse.y
|index 2991473..62a78d1 100644
|--- a/sbin/pfctl/parse.y+++ b/sbin/pfctl/parse.y No file to patch. Skipping... Hunk #1 ignored at 235. Hunk #2 ignored at 342. Hunk #3 ignored at 444. Hunk #4 ignored at 489. Hunk #5 ignored at 1911. Hunk #6 ignored at 2366. Hunk #7 ignored at 3710. Hunk #8 ignored at 5106. Hunk #9 ignored at 5114. Hunk #10 ignored at 5165. Hunk #11 ignored at 5173. Hunk #12 ignored at 5434. Hunk #13 ignored at 6065. 13 out of 13 hunks ignored while patching sbin/pfctl/parse.y Hmm... The next patch looks like a unified diff to me... The text leading up to this was:
|diff --git a/sbin/pfctl/pfctl.c b/sbin/pfctl/pfctl.c
|index 64b4a05..1e957f6 100644
|--- a/sbin/pfctl/pfctl.c+++ b/sbin/pfctl/pfctl.c No file to patch. Skipping... Hunk #1 ignored at 78. Hunk #2 ignored at 117. Hunk #3 ignored at 654. Hunk #4 ignored at 2003. Hunk #5 ignored at 2117. Hunk #6 ignored at 2325. 6 out of 6 hunks ignored while patching sbin/pfctl/pfctl.c Hmm... The next patch looks like a unified diff to me... The text leading up to this was:
|diff --git a/sys/net/pfvar.h b/sys/net/pfvar.h
|index 0b8f0ac..ba8b1d9 100644
|--- a/sys/net/pfvar.h+++ b/sys/net/pfvar.h No file to patch. Skipping... Hunk #1 ignored at 488. Hunk #2 ignored at 1287. Hunk #3 ignored at 1367. 3 out of 3 hunks ignored while patching sys/net/pfvar.h Hmm... The next patch looks like a unified diff to me... The text leading up to this was:
|diff --git a/sys/netpfil/pf/pf_ioctl.c b/sys/netpfil/pf/pf_ioctl.c
|index 96abf2c..23b9efc 100644
|--- a/sys/netpfil/pf/pf_ioctl.c+++ b/sys/netpfil/pf/pf_ioctl.c No file to patch. Skipping... Hunk #1 ignored at 1709. 1 out of 1 hunks ignored while patching sys/netpfil/pf/pf_ioctl.c done Is this solution included in a beta version or binari files compiled?
Thanks for any help.
-
Sorry to mislead. The link I posted is not a patch to add this feature, it is the CURRENT pfSense code that implements state killing for expiring pass rules.
The code works by finding states that have been marked by the scheduled pass rule. To implement state killing for scheduled block rules, new code would be needed to find all not marked states that match the block rule, which this code doesn't do at all.
-
Searching the forum I ran into this thread. Seems my post from this morning relates to this issue.
In my case even a (UDP) state returns after manual kill of state enabling Skype to keep running. Please have a look at: https://forum.pfsense.org/index.php?topic=125534.0Earlier in this thread I read about same issue (Skype keeps running).
-
Good luck, I have been chasing this for months..
I find the rules work until you modify the schedule portion of the rule.. If you manually clear states for the target IP after changing the schedule, they do re-establish, even though people on this forum swear this shouldn't happen.
I find the only way to fix is to try to reset all states and if that doesn't fix, reboot.
Seems to be something broken with the schedules and how they relate to the rules.
-
So in my hunting it would appear that setting up a schedule with pfsense isn't very likely to happen? I'm messing with this here at home first, as I have a customer with a similar request. So at home my daughters ipod has become the guinea pig.
Basically I have created a static mapping for her device. I've also created a schedule. I've created a block rule for the IP of the ipod, as well as an allow rule, which has the schedule selected. It appears to be working for the most part, however imessage continues to work.
I downloaded the cron package, and I was going to use the pfctl -F command. Is this going to work, or am I beating a dead horse here with this setup?
-RYknow
-
I have had hit and miss success with the cron task and filtering Steam.
My setup is to BLOCK the ALIAS and then place an ALLOW rule with schedule ABOVE the BLOCK rule in the LAN tab.
The wheels fall off if I modify a schedule. I find clearing states does not work as expected and a full reboot is required to get things back on track after adjusting the schedule.
-
I'll need to double check how I have things setup.
I'm wondering if my issue is IPv6 related? Does that make any sense?
-RYknow
-
Possibly but I have blocked IPv6 on my network.
-
That's my next step. I'll just block it and see if it fixes my problem.
EDIT: IPv6 seems to have been the ticket. Since disabling IPv6 traffic on my network, all the devices are working correctly with the above mentioned schedule.
-RYknow
-
That's my next step. I'll just block it and see if it fixes my problem.
EDIT: IPv6 seems to have been the ticket. Since disabling IPv6 traffic on my network, all the devices are working correctly with the above mentioned schedule.
-RYknow
Have you modified schedules, waited until the next schedule change and found the states remain on some UDP packets?
-
Yes. I was never able to get it to work correctly with the ipod. I ended up just creating the schedule via the unifi software… but I would like to get it sorted at the router level instead.
-RYknow
-
The thing that surprises me the most is how long this issue has been floating around without being addressed.. Surely there would be others who could use this feature?
-
Yeah, you triggered my memory about this and I went and played with it last night… I set an ipod up with just strickly a block rule, (picked block... and chose the IP). and imessage still works... I have I have ipv6 disabled, as I was thinking maybe the traffic was using ipv6.... but imessage still works. Very strange.
-RYknow
-
Yeah, I can get this working on a test laptop reliably with a cron task to kill off states after the schedule expires but it doesn't work on the existing rules.
I will delete all the rules and start fresh.
-
Did you have any limiters on your rules for the Ipod?
-
I don't have any limiters on the iPod. Initially I was using a schedule I had created. At this point for testing I've gotten rid of the schedule completely, and I'm just using the block rule. When I disable it for any length of time, and re-enable it, the imessage stuff still works.
I'm going to test it some more over the weekend, I moved the ipod block to be the very first rule in the list. See if that makes much of a difference.
-RYknow
-
I am really confused now, I deleted all pass/block rules and now the schedule works on one host but not the other?
I even copied the rule and just changed the alias to suit the new rules…
I'm going to default my router one more time and if that doesn't fix it, I'm going to try another product.
-
I've tried several variations I found online for using a Cron job to kill the states after a rule becomes active and none of them work. The only way to ensure Skype and active game sessions get killed after the scheduled block rules kick in is to manually reset the states in the Diagnostics menu. It's a brand new install.
If someone can suggest the exact spelling with the full path of the Cron job other than what I already tried or maybe a different way other than Cron jobs if there is a way? I've tried the following Cron commands:
/sbin/pfctl -F state
/sbin/pfctl -k >IP on the block list< -
I can confirm:
/sbin/pfctl -F state works sometimes (cron task)
pfctl -F state works sometimes (cron task)/sbin/pfctl -k >IP on the block list<works sometimes="" (cron="" task)<br="">pfctl -k >IP on the block list <works sometimes="" (cron="" task)<br="">Both also seem to work in the Diagnostics/Command Prompt however, nothing reliably clears established UDP states.
After the PASS schedule expires, all states are cleared and then a few (Steam and Teamspeak in my case) immediately re-establish.</works></works>
-
Thanks to alot of my own trial and error I have figured out why it doesn't work for me and how I can make it work.
If I have the schedule block at 10pm at night and schedule the cron job to clear a specific IP states at 10:01pm it doesn't work.
If I change the cron job to run at 1 minute past the hour for every hour, it works!
To confirm the obvious, yes my computer time and pfsense times are correct and i've run the test several times. I've run now at 4pm scheduled block with cron to block at 1 minute past every hour and it worked immediately. I had it try before at 3pm scheduled block with 3:01pm run same cron job. It doesn't work.
So for some reason, cron doesn't recognize the specific hour! It's in 24 hour clock military time. I haven't checked if I can do 12 hour clock time if it's possible. But I obviously have the Cron job programmed correctly and everything else correct as the only difference that makes it work is specify to run the job every hour at 1 minute past the hour, rather than at the specific time. This is not a good solution as it can cause interrupts every hour.
I expect to be the first person to find the solution to this as no one has an answer anywhere I could find. Please prove me wrong and beat me to it.
-
I managed to get cron to work without saying * for the hour. I found out that although the schedule runs at 1800 hours (6pm) I have to schedule Cron to run at 2201 hours for it to think it is 1 minute past the hour. It then successfully runs the cron job 1 minute after the scheduled job and clears the state table. So for Cron to run the job 1 minute after the scheduled rule, I have to actually program Cron to run 4 hours and 1 minute after the scheduled rule.
My question now is why does Cron think it is 2200 hours when it is 1800 hours? In other words, why does Cron think the time is 4 hours ahead of what the schedule does?