IP lists are not updating

[Unwoven8507]

Hi,

I have a problem that IP lists are not updated even though when running update process, pfBlockerNG can 'see' that there are lists with much longer set of IP addresses.

Below example for Alienvault_v4 list.

• the list that is used in the feed has 609 lines of IP addresses (https://reputation.alienvault.com/reputation.snort.gz)
• the list that pfBlockerNG is using has only 37 lines of addresses

[ Alienvault_v4 ] Reload [ 03/30/23 14:57:51 ] . completed ..

Original Master Final

609 37 37 [ Pass ]

After running update process:

[23.01-RELEASE][root@pfSense.home.lan]/var/db/pfblockerng/deny: wc -l Alienvault_v4.txt
37 Alienvault_v4.txt

Any ideas?

Regards,
Marek

[SteveITS]

@unwoven8507 Do you have deduplication enabled?

[Unwoven8507]

@steveits thank you for quick response.

I just disabled deduplication and I see the lists got updated as expected.

So my understanding of deduplication in this case was wrong. I would think that only the same addresses that are used in different lists should not be updated multiple times. Interesting :)

Thank you!
Marek