pfblockeer 3.2.8 + pfsense 2.8.0: top1m db download fail
-
Since updating to pfsense CE 2.8.0 with pfblocker 3.2.8 (have tried both devel and non devel), the top1m db fails to download.
Tranco TOP1M error:
TOP1M Database downloading ( approx 21MB ) ... Please wait ...
Building TOP1M Whitelist [
TOP1M conversion Failed. File: top-1m.csv, not found...Cisco top1m error:
TOP1M Database downloading ( approx 21MB ) ... Please wait ...
[PFB_FILTER - 17] Failed or invalid Mime Type: [application/octet-stream|0] Building TOP1M Whitelist [
TOP1M conversion Failed. File: top-1m.csv, not found...Things I have tried:
resetting files with the two checkbox save reload thing
switch to non devel version, re test, etc, same issues
reset files againhave also looked around in /var/db/pfblockerng for any half downloaded top1m files with weird perms or anything else that might be interfering with the dl, but nothing. I'm not sure where it downloads the top1m to though.
Since i'm using ramdisk /var and /tmp it's possible the release note about perms change on those could have impacted this...or that the state is just weird from the update.
lmk if there are other things i can/should try, or other info that would be useful in diagnosing.
Thanks!
-
@crusher4
Hello !
Same issue for me
have a good day ! -
This is sort-of expected...
The first lines of the file look like this:
Notice: This file is deprecated and is not being updated anymore.
This file was last updated on February 1, 2023.
This file will not be available from
http://s3.amazonaws.com/alexa-static/top-1m.csv.zip after
July 31, 2023.Either you need to use a version already downloaded (which won't get updated), or remove it from your sources.
I would upload the file here, but even zipped it's 8MB and the limit is 2.
-
You can download it here now:
https://raw.githubusercontent.com/ianb/alexa-sites/refs/heads/master/top-1m.csv
