pfblocker not downloading ASN list

[johnpoz]

@michmoor I think it tries to download from here api.bgpview.io

Currently getting a 500 error from them

They seem to be down.

[JonathanLee]

@johnpoz is this still down?? Does he have a secondary mirror option? Primary only??

[johnpoz]

@JonathanLee the website directly seems to answer now - but horrible slow...

And if try to use the api, still getting

And if you search just on the main page for something you get this

So yeah I would say its still down, there are other places to lookup such info.. For example https://asnlookup.com/asn/AS714/ or https://www.bigdatacloud.com/asn-lookup/714 or https://bgp.he.net/AS714#_prefixes or just something like this

But I am not aware of pfblocker having a backup location to use if that one doesn't answer or is sluggish, etc. I would assume they will be back shortly..

[michmoor]

@johnpoz
Nice catch John.
I do wonder how large the database is and if downloading it onto local is possible. It’s an option for those who have large local storage. A diff is done say monthly between local and website and download the changes. Ehh just a thought not sure on what the policies are with the website.

[jrey]

@michmoor
Not an issue with the size, - the API only pulls the prefixes for the given ASN so there is no issue downloading an ASN in this regard.
On their side, the ASN's are sync'd almost instantly when the ranges (prefixes) are changed upstream.

Their "Mock Servers" are current responding as expected, but as noted the production servers are currently in a bad state.

Dashboard is showing the failures here as I would expect in cases like this, and nothing bad happens, just continues to use the previous values.

[johnpoz]

@michmoor I was able to get to https://bgp.tools/as/714#prefixes

But man did it take a while..

And via api url still showing a 500 error..

[michmoor]

@johnpoz
Appreciate the assist. Went to your link - https://bgp.tools/as/714#prefixes - I got the prefixes and did a bulk import for the alias.
Works without issue as a workaround to the issue with pfBlocker.

[johnpoz]

@michmoor not sure I would call it an issue with pfblocker - seems more to me an issue with the site that pfblocker uses to get the info ;) But yeah for sure that is a work around until such time that site is fully operational again..

[jrey]

@johnpoz said in pfblocker not downloading ASN list:

seems more to me an issue with the site that pfblocker uses to get the info

which is back running as of about 15 minutes ago, albeit still a little sluggish.

[johnpoz]

@jrey I think they are still having major problems..

I just got this trying to do a search for asn off their main page

Whoops, looks like something went wrong.

[jrey]

@johnpoz

didn't try that -
only tried the api calls and were/are responding (little slower than what I would call "normal" but a response at least) That's all pfblocker uses

https://api.bgpview.io/asn/714/prefixes

{"status":"ok","status_message":"Query was successful","data":{"ipv4_prefixes":[{"prefix":"17.0.0.0\/8","ip":"17.0.0.0","cidr":8,"roa_status":"None","name

etc, etc 

[johnpoz]

@jrey said in pfblocker not downloading ASN list:

https://api.bgpview.io/asn/714/prefixes

yeah that did respond.. Good that they fix the api before the main site ;) But yeah it was a bit sluggish but then it did pop with all the data..

[michmoor]

@johnpoz said in pfblocker not downloading ASN list:

not sure I would call it an issue with pfblocker

yes you are right :)
I do appreciate the help

[fireodo]

@johnpoz said in pfblocker not downloading ASN list:

@jrey said in pfblocker not downloading ASN list:

https://api.bgpview.io/asn/714/prefixes

yeah that did respond.. Good that they fix the api before the main site ;) But yeah it was a bit sluggish but then it did pop with all the data..

This morning there where again trouble with bgpview ...

 /usr/local/bin/curl -A "pfSense/pfblocker cURL download agent-ecd69ce851584cc71xxx" -sS1 https://api.bgpview.io/asn/53667/prefixes > /tmp/pfbtemp10_15438 
.. Failed to download ASN
restore bk file
. completed ..

(error repeated 5 times)
Seems there are some work underway ... I guess ...

[jrey]

@fireodo

All I can say is that at 01:20:13 Eastern it was working fine

.. completed (Download Valid)
removing bk file
. completed ..

and my next scheduled run isn't for a few hours.
(yesterday log file showed a couple of ASN's failing,
but for the most part ~95% of them they were fine.
0 failures in the run earlier today.

[fireodo]

@jrey said in pfblocker not downloading ASN list:

All I can say is that at 01:20:13 Eastern it was working fine

Ah, OK - thanks!