[SOLVED] Ntop GEO MAP

dragoangel

@manjotsc I understand that I can simply put files even on pfsense with geoip. Question about that this plugins must already be officially fixed by netgate to support new API with authorization

manjotsc

@dragoangel I think they are waiting for PfSense 2.5 release, because I tried installing Ntopng 3.8 manually, but ntopng 3.8 needs some package dependencies that only supported in FreeBSD12.

manjotsc

@dragoangel Problem Solved Working Now

https://www.youtube.com/watch?v=GkPA4kb3Xoo

alt text

dragoangel

@manjotsc devel version of pfsense 2.5 has same ntopng. Thanks for video.

manjotsc

@dragoangel hmmm, sorry maybe I am confused.

dragoangel

@manjotsc yep, I doesn't know, but looks like pkg maintainer simply lost.
Direct link by simple parameters works so I updated https://forum.netgate.com/topic/141150/solved-ntop-geo-map/6 as well

manjotsc

@dragoangel Atleast this time it got solved quickly as compared to before, which was broken for months.

Sigsegv

I'm not sure if anyone else is running into issues with the above patch and the new access key requirement from maxmind, but mine still wouldn't update the GeoIP database..

It seems like fetch has an issue with the new URL, so changed the /usr/local/pkg/ntopng.inc file to use curl.. These changes are made after applying the above mentioned patch:

function ntopng_update_geoip() {
global $config;
$curlcmd = "/usr/local/bin/curl";

    $geolite_city = "https://download.maxmind.com/app/geoip_download?edition_id=GeoLite2-City&license_key=YOURKEYHERE&suffix=tar.gz";
    $geoip_asnum = "https://download.maxmind.com/app/geoip_download?edition_id=GeoLite2-ASN&license_key=YOURKEYHERE&suffix=tar.gz";

    $output_dir_city = "/usr/local/share/ntopng/GeoCity.tar.gz";
    $output_dir_asn = "/usr/local/share/ntopng/GeoASN.tar.gz";

    mwexec("{$curlcmd} --output {$output_dir_city} \"{$geolite_city}\"");
    mwexec("{$curlcmd} --output {$output_dir_asn} \"{$geoip_asnum}\"");

    ntopng_fixup_geoip();

    /* Do not (re)start services on package (re)install, only on manual GeoIP updates via the GUI */
    if ($_POST['Submit'] == "Update GeoIP Data") {
            init_config_arr(array('installedpackages', 'ntopng', 'config', 0));
            $ntopng_config = $config['installedpackages']['ntopng']['config'][0];
            ntopng_services_stop();
            if ($ntopng_config['enable'] == "on") {
                    start_service("ntopng");
            }
    }

}

pponce

@Sigsegv Fetch still works. you just need to modify the execution of the command and put quotes around the url to fetch.

I made the same changes as mentioned above but these two lines were edited in the following way:

        mwexec("{$fetchcmd} -o {$output_dir}/GeoLite2-City.tar.gz -T 5 \"{$geolite_city}\"");
        mwexec("{$fetchcmd} -o {$output_dir}/GeoLite2-ASN.tar.gz -T 5 \"{$geoip_asnum}\"");

then it should work.

Sigsegv

@pponce said in [SOLVED] Ntop GEO MAP:

@Sigsegv Fetch still works. you just need to modify the execution of the command and put quotes around the url to fetch.

I made the same changes as mentioned above but these two lines were edited in the following way:
        mwexec("{$fetchcmd} -o {$output_dir}/GeoLite2-City.tar.gz -T 5 \"{$geolite_city}\"");
        mwexec("{$fetchcmd} -o {$output_dir}/GeoLite2-ASN.tar.gz -T 5 \"{$geoip_asnum}\"");
then it should work.

OK cool. Really, my point of posting was that the patch provided no longer works, therefore, I came up with a workaround using curl.

I'm happy to modify the patch to fix the escape sequence.

pponce

@Sigsegv Didn't mean to imply what you posted wasn't helpful. Apologies if it came out that way. I was stuck with things still not working even after making your suggested curl command changes. Then realized I hadn't changed the output directory variable to include the file name like you had. In troubleshooting why it was not working I ended up figuring out why the fetch command was not working originally. Figured i'd share my findings.

If i had copied your changes exactly all would have worked perfectly.

Sigsegv

@pponce said in [SOLVED] Ntop GEO MAP:

@Sigsegv Didn't mean to imply what you posted wasn't helpful. Apologies if it came out that way. I was stuck with things still not working even after making your suggested curl command changes. Then realized I hadn't changed the output directory variable to include the file name like you had. In troubleshooting why it was not working I ended up figuring out why the fetch command was not working originally. Figured i'd share my findings.

If i had copied your changes exactly all would have worked perfectly.

No worries my friend! I was more concerned that I had posted something that was not correct and would mess up someone's system other than my own!

Thanks for the reply!

viktor_g

Please check the latest PR:
https://redmine.pfsense.org/issues/9211#note-20

dragoangel

@viktor_g looks promising.

pponce

@viktor_g thanks for pushing this through.

pponce

New version released for PFSENSE. Issue officially fixed.

manjotsc

Now let's wait for ntopng 4.0 to arrive on pfsense.

erbalo

Hello Guys,

By me the GeoIP is not really working with the fix on this thread. What am i dooing wrong? i did this one.

mwexec("{$fetchcmd} -o {$output_dir}/GeoLite2-City.tar.gz -T 5 "{$geolite_city}"");
mwexec("{$fetchcmd} -o {$output_dir}/GeoLite2-ASN.tar.gz -T 5 "{$geoip_asnum}"");

and:

$geolite_city = "https://download.maxmind.com/app/geoip_download?edition_id=GeoLite2-City&license_key=xxxxxhidexxxxxxxxxxxx=tar.gz";
$geoip_asnum = "https://download.maxmind.com/app/geoip_download?edition_id=GeoLite2-ASN&license_key=xxxxxxxxhidexxxxxxxxx&suffix=tar.gz";

dragoangel

@erbalo the last update of plugin already fixed this. You need remove all patches, reinstall plugin and enter your maxmind api key in ntopng settings. Read comment of @viktor_g

erbalo

@dragoangel Hello i have uninstalled and installed ntopng and put de license back but no success. I see also on the NTOP page that are an update available is 4.0. Do i need that version to install it on pfsense?