Switched to Python unbound Mode and now have issue

[serbus]

Hello!

Maybe related to this? :

https://github.com/NLnetLabs/unbound/issues/372

What about adding unbound to the Service Watchdog?

John

[RonpfS]

@serbus said in Switched to Python unbound Mode and now have issue:

What about adding unbound to the Service Watchdog?

Bad idea, Unbound or pfblockerNG services are not happy with it.

[thezfunk]

@ronpfs

Well, I think I fixed it. After you pointing out that a file was missing according to the log, I just reinstalled it. This time, when I started DNSBL and checked the services, unbound DNS Resolver was still running and the logs showed the file was now in place. Whatever that python file it is that it looks for.

Right now I am slowly turning my feeds back on and it seems to be working. Now, if I can only figure out why my credit union Android app won't connect and the reports show nothing blocked for those IP address. Existing problem I started a thread on that this update doesn't seem to have solved.

[RonpfS]

@thezfunk Updating/Re-installing pfblockerNG while it is active is prone to fail.
Disable pfblockerNG before, update, review settings, enable, run Force Update, Force Reload All.

[serbus]

@ronpfs said in Switched to Python unbound Mode and now have issue:

Bad idea, Unbound or pfblockerNG services are not happy with it.

Hello!

Unbound is listed as standard option for Service Watchdog. What sort of issues are there?

John

[RonpfS]

@serbus Search the forum to get more info. ;-)

[thezfunk]

@ronpfs said in Switched to Python unbound Mode and now have issue:

@thezfunk Updating/Re-installing pfblockerNG while it is active is prone to fail.
Disable pfblockerNG before, update, review settings, enable, run Force Update, Force Reload All.

That is exactly what I did do originally. I was following the instructions laid out after other people had issues.

[Gertjan]

@serbus said in Switched to Python unbound Mode and now have issue:

Unbound is listed as standard option for Service Watchdog. What sort of issues are there?

You'll enter into timing critical issues, and these are, by there nature, very hard to debug.

The service watchdog exists to create a controlled major fail of the entire system .... and have it running to the bitter (close !) end.

See it like drilling extra holes into a sinking ship's hull to permit it to sink horizontally.
Remember Titanic ? Evacuation on a more then 45 ° deck angle is hard.

edit :

a core pfBlockerNG-devel file can't be found. or, per instructions, unbound needs it to start.
It /var/unbound/pfb_unbound.py, should be there, after a pfBlockerNG-devel 3.0.0_8 install or upgrade. Things go bad without it.

[BBcan177]

@gertjan said in Switched to Python unbound Mode and now have issue:

It /var/unbound/pfb_unbound.py, should be there, after a pfBlockerNG-devel 3.0.0_8 install or upgrade. Things go bad without it.

If the OP has Ramdisks enabled, that would wipe the /var/unbound folder and delete the Python script.

The Pkg needs to be re-installed and RamDisk option disabled.

[thezfunk]

@bbcan177 said in Switched to Python unbound Mode and now have issue:

@gertjan said in Switched to Python unbound Mode and now have issue:

It /var/unbound/pfb_unbound.py, should be there, after a pfBlockerNG-devel 3.0.0_8 install or upgrade. Things go bad without it.

If the OP has Ramdisks enabled, that would wipe the /var/unbound folder and delete the Python script.

The Pkg needs to be re-installed and RamDisk option disabled.

I did not but a reinstall did fix my issue.

[netblues]

I have a slight different issue
The py script is in place, however I get
File "pfb_unbound.py", line 1147, in operate if qstate_valid and pfb['safeSearchDB']: KeyError: 'safeSearchDB'

And unbound fails to start.

Playing with options for safesearch didn't do any difference

Disabling the python module "resolves" the issue

pfsense 2.5 stable, pdblockerngdevel ver 3.0.0_15

[McFuzz]

@netblues said in Switched to Python unbound Mode and now have issue:

I have a slight different issue
The py script is in place, however I get
File "pfb_unbound.py", line 1147, in operate if qstate_valid and pfb['safeSearchDB']: KeyError: 'safeSearchDB'

And unbound fails to start.

Playing with options for safesearch didn't do any difference

Disabling the python module "resolves" the issue

pfsense 2.5 stable, pdblockerngdevel ver 3.0.0_15

Wanted to point out that I have the same issue with 2.5, 3.0.0_15 and python...

[BBcan177]

@mcfuzz
Can you post the contents of this file when Unbound python mode is enabled: /var/unbound/pfb_py_ss.txt

[netblues]

@bbcan177 No such file exists
Even tried touching and disabling - reenabling.

Is the file name correct?

[BBcan177]

@netblues
Did you enable Python mode and Safe Search? Then Run a Force Update.

[RonpfS]

@netblues Maybe save DNSBL Settings, SafeSearch Settings, Force Update / Reload ALL while monitoring pfblockerng.log.

[McFuzz]

@bbcan177 said in Switched to Python unbound Mode and now have issue:

@netblues
Did you enable Python mode and Safe Search? Then Run a Force Update.

So - this worked for me, but only after I’ve done a second time! After the first time I had the same issue and after doing the second time, it started working flawlessly. Odd... could be something on my end but so far, everything’s working well.

[netblues]

Enabled safesearch, enabled python mode., applied and force updated

Loading DNSBL Statistics... completed
Loading DNSBL SafeSearch... enabled
Loading DNSBL Whitelist... completed
DNSBL - SafeSearch changes found - Rebuilding!

-Assembling DNSBL database...... completed [ 03/29/21 22:26:48 ]
Removing DNSBL Unbound python integration settings
DNS Resolver ( enabled ) unbound.conf modifications:
Removed DNSBL Unbound Python mode
Removed DNSBL Unbound Python mode script

Saving DNSBL statistics... completed [ 03/29/21 22:31:10 ]
Resolver Live Sync analysis... completed [ 03/29/21 22:31:24 ]
Resolver Live Sync finalizing:

And hungs there, with no dns service, unbound process at 100% for 15 minutes now..

After killing unbound process
Resolver Live Sync ... FAILED!
Stopping Unbound Resolver
Unbound stopped in 1 sec.
Additional mounts:
Unmounting: /lib
Removing duplicate mounts (2): /dev
Unmounting: /var/log/pfblockerng
Unmounting: /usr/local/share/GeoIP
Removing DNSBL Unbound python mounts:
Unmounting: /usr/local/bin
Removing: /var/unbound/usr/local/bin
Unmounting: /usr/local/lib
Removing: /var/unbound/usr/local/lib
Removing: /var/unbound/usr/local
Removing: /var/unbound/usr

Starting Unbound Resolver... completed [ 03/29/21 22:46:33 ]
DNSBL update [ 801834 | PASSED ]... completed [ 03/29/21 22:46:35 ]

and safesearch appeared on google search
python mode was found disabled again.

Re enabled python mode in resolver at this stage
and
Mar 29 22:55:55 unbound 55552 [55552:1] error: pythonmod: Exception occurred in function operate, event: module_event_new
Mar 29 22:55:55 unbound 55552 [55552:1] error: pythonmod: python error: Traceback (most recent call last): File "pfb_unbound.py", line 1147, in operate if qstate_valid and pfb['safeSearchDB']: KeyError: 'safeSearchDB'

STILL NO FILE!!!

[netblues]

@mcfuzz Is python mode on in resolver?

[RonpfS]

@netblues said in Switched to Python unbound Mode and now have issue:

Re enabled python mode in resolver at this stage

You can not simply enable Python in DNS Resolver / General Settings tab, you have to do that in pfBlockerNG / DNSBL tab, then run a Force Update.