Ntopng not showing country flags

Asterix_cz

Hello,
I want to ask about some weird situation. I have 2 pfSense boxes, let's name them BOX-1 and BOX-2.
BOX-1 is older installation, even before "Netgate", which I upgraded regulary and now it's on latest version 2.4.4 with installed ntopng current package version 0.8.13_3, which was installed today (ntopng was on this box for a long time). Now when I log into ntopng it still says that there is a new version 3.6.0 available (ntopng Community Edition v.3.4.180911). In package dependencies it shows "ntopng-3.6.d201800910,1". It's kind of the same problem which was in previous topic "[Help] ntopng not displaying Minute Interface Top Talkers". But the point is, that when I look in flows or other places, I can see country flags by public IPs.
BOX-2 is newer insatallation, with Netgate ISO already. It's updated to same version 2.4.4, both are amd64 systems. Today I installed the newest ntopng package - version 0.8.13_3. When I log into ntopng, it shows I'm on Community Edition v.3.6.181102, which is OK. I also updated GeoIP data, but I can't see anywhere those country flags. Is it a bug or how can I get it there? It looks, that on older version it worked, but it's kind of reporting wrong version in ntopng but correct in pfsense package manager, and a fresh install on fresh pfsense install reports correct version in both places, but can't get work country flags. Any suggestions??

Networker2001

Hello,
I am also seeing these symptoms. I have a fresh install of pfsense with ntopng as the first package installed. I cannot see any data in the geomap, hosts by country, or hosts by ASN, or the country flags as mentioned by the OP. I haven't found mention of similar issues within the last year other than this post. Is anyone experiencing similar issues?

I have tried updating the geodata and even a full reinstall and default configuration of ntopng with the same result.

3freet

@networker2001 said in Ntopng not showing country flags:

Hello,
I am also seeing these symptoms. I have a fresh install of pfsense with ntopng as the first package installed. I cannot see any data in the geomap, hosts by country, or hosts by ASN, or the country flags as mentioned by the OP. I haven't found mention of similar issues within the last year other than this post. Is anyone experiencing similar issues?

I have tried updating the geodata and even a full reinstall and default configuration of ntopng with the same result.

I'm experiencing the exact same symptoms with the latest version of pfsense and ntopng (2.4.4 and 0.8.13_3).

Ntopng does not show any country data nor any information about Autonomous Systems (showing ASN 0 only).
I guess the new version does not work properly with Maxmind database.

Networker2001

I'm glad to hear that it's not just me. I have been looking to find if I missed a configuration step, or an error was logged. I haven't seen any related errors in the pfsense log or in the ntopng runtime log, so not sure where to start looking.

no_jah

I have the same issue, and also I don't see the activity map on host pages that you'll see in the vide below, if you got to 4:20.

https://www.youtube.com/watch?v=uGN6NYFkrh4

Networker2001

Has this been registered as a bug? It appears it is a bug, but haven't been able to find any confirmation. Is anyone successfully using the country flags, ASN, and country reporting in the current versions of ntopng and pfsense?

rosenstand

Just another +1. Country flags are gone and the only point I see on the geo map is my own. This used to work until the recent ntopng upgrade (or pfSense 2.4.4 -> 2.4.4p1 which was around the same time). Tried to "Update GeoIP Data" from the pfSense ntopng Settings interface but didn't seem to work.

rosenstand

@networker2001: I couldn't find anything on the bug tracker, so I opened an issue: https://redmine.pfsense.org/issues/9211

jop_

Seeing same issue here of no country flags w/ fresh install of pfSense 2.4.4p1 and ntopng pfSense package 0.8.13_3.

Also ran /usr/local/bin/geoipupdate.sh which refreshed GeoIP database and then was able to use geoiplookup but still no country flags in ntopng.

CJDeeZ

Also having the same issue. Upgrade from 2.4.3 to 2.4.4p1.
-no country flags or ASN info in ntopng 3.6
-tried updating with "Update GeoIP Data" on Package > Diagnostics >ntopng Settings page.

It was working previously in 2.4.3 and ntop 3.2

HeMaN

follow, same here
fresh install of ntopng (never used it before) and location depending options not working for hosts.
Only my own location shown on map

code4u

I'm seeing the same issue. Was this submitted as a bug? What's the estimated time to fix it?

chrismacmahon

Looks like a bug was filed:
https://redmine.pfsense.org/issues/9211

LFC

@asterix_cz

I'm new to pfSense and have the same problem. No GeoIP location, no country flags, no proper ASN just 0. I did some research and just wanted to share my findings.
Using pfSense 2.4.4-RELEASE-p2 with Ntopng Community Edition v.3.6.181116

I manually ran the /usr/local/bin/geoipupdate.sh script and got :
fetch: http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz: Not Found

Then I went to Maxmind website and found this article:
https://dev.maxmind.com/release-note/discontinuation-notice-for-geolite-legacy-databases/

It looks for me that Maxmind has ended their support and download for the legacy GeoIP data.
The only GeoIP data you can download are the GeoLite2 data. Not sure if Ntopng is compatible with that.

Anyway, thanks for a great and free product! I hope the GeoIP feature will get fixed soon.

Cheers!

CJDeeZ

ouch..

Kornstalx

Was this issue ever resolved?

Networker2001

@kornstalx
Not resolved yet, but it looks like it may be comming based on the bug tracker:

"New ntopng 3.8 (December 2018) release supports the GeoIP2 library" https://redmine.pfsense.org/issues/9211

We are currently at ntopng 3.6, So once the new version gets ported to pfsense, we may see it resolved. Fingers crossed.

bldnightowl

+1 to pulling in the latest version of ntopng asap. please

xeeaxe

Hi, I have the same issue. Has anyone been able to find a solution? The map also isn't working, it only shows my own location.

Here is my version summary:
pfSense: 2.4.4_2
ntopng: 3.6.190215 - Community Edition
nDPI 2.4.0
cURL 7.64.0
Twitter Bootstrap 3.x
Font Awesome 4.x
RRDtool 1.7.0
Redis Server 4.0.10
Mongoose web server 3.7
LuaJIT LuaJIT 2.1.0-beta3
ØMQ 4.3.1
GeoLite 1.3.2
This product includes GeoLite data created by MaxMind.
Data-Driven Documents (d3js) 2.9.1 / 3.0

Kornstalx

What kills me about this is ntop and mapping is the whole reason I switched from Sonicwall. When I saw the latest gen NetGate devices were releasing I decided to switch, and grabbed one.

And now I'm completely burned.

rosenstand

@kornstalx this should be fixed in ntopng 3.8 which was released almost 3 months ago. We’ll just have to wait for Netgate to update the package.

I would love to look at it but I was having trouble finding the packages “source” repo last time I tried...

fnarq

Every IP that I try to geo-locate shows as being in Rome, Italy. I wish :)

randombits

Is this in the pipeline to be fixed ?

Kahlen

+1 "Geolocation error [Permission denied]." always geo-locate shows as being in Rome, Italy

JaLooNz

This post is deleted!

JaLooNz

Apparently ntopng 3.6 is already using the GeoLite2 database.
https://github.com/ntop/ntopng/blob/3.6-stable/src/Geolocation.cpp#L131

The data path for the files should be...
/usr/local/share/ntopng/httpdocs/geoip/GeoLite2-ASN.mmdb
/usr/local/share/ntopng/httpdocs/geoip/GeoLite2-City.mmdb

Which can be downloaded from...
https://geolite.maxmind.com/download/geoip/database/GeoLite2-City.tar.gz
https://geolite.maxmind.com/download/geoip/database/GeoLite2-ASN.tar.gz

no_jah

I thought this issue was supposed to be fixed in the latest ntopng update, but still no country flags or host activity maps.

Camd1710

@JaLooNz muchas gracias funciono a la primera solo hay que colocar las bases de datos en la ruta especificada

Brutos

Any idea if this will every get fixed?

kiokoman

i have the same problem with pfsense 2.5.x and ntopng 0.8.13_3
it's still trying to download geoip from the wrong url

$fetchcmd = "/usr/bin/fetch";
        $geolite_city = "https://geolite.maxmind.com/download/geoip/database/GeoLiteCity.dat.gz";
        $geolite_city_v6 = "https://geolite.maxmind.com/download/geoip/database/GeoLiteCityv6-beta/GeoLiteCityv6.dat.gz";
        $geoip_asnum = "https://download.maxmind.com/download/geoip/database/asnum/GeoIPASNum.dat.gz";
        $geoip_asnum_v6 = "https://download.maxmind.com/download/geoip/database/asnum/GeoIPASNumv6.dat.gz";

i have changed it inside /usr/local/pkg/ntopng.inc as suggested here -> https://redmine.pfsense.org/issues/9211 by Mark Vejvoda to

        $geolite_city = "https://centminmod.com/centminmodparts/geoip-legacy/GeoLiteCity.dat.gz";
        $geolite_city_v6 = "https://centminmod.com/centminmodparts/geoip-legacy/GeoLiteCityv6.dat.gz";
        $geoip_asnum = "https://centminmod.com/centminmodparts/geoip-legacy/GeoIPASNum.dat.gz";
        $geoip_asnum_v6 = "https://centminmod.com/centminmodparts/geoip-legacy/GeoIPASNumv6.dat.gz";