Ngtop 1.2.1 v0.5

eshield · Apr 6, 2015, 12:25 PM

The subject makes me sad:

Apr 6 16:16:54 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_trace' from file './lua_trace.lua': cannot open ./lua_trace.lua: No such file or directory]
Apr 6 16:16:44 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_utils' from file '/usr/local/share/ntopng/scripts/lua/modules/lua_utils.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/lua_utils.lua: No such file or directory]
Apr 6 16:15:24 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_trace' from file '/usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua: No such file or directory]
Apr 6 16:15:24 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_trace' from file '/usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua: No such file or directory]
Apr 6 16:11:56 ntopng: [Geolocation.cpp:59] WARNING: Unable to read GeoIP database /usr/local/share/ntopng/httpdocs/geoip/GeoIPASNumv6.dat
Apr 6 16:11:56 ntopng: [Geolocation.cpp:59] WARNING: Unable to read GeoIP database /usr/local/share/ntopng/httpdocs/geoip/GeoIPASNum.dat
Apr 6 16:11:55 php-fpm[24113]: /pkg_edit.php: The command '/usr/bin/gzip -d '/usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNumv6.dat.gz'' returned exit code '1', the output was 'gzip: /usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNumv6.dat.gz: not in gzip format'
Apr 6 16:11:55 php-fpm[24113]: /pkg_edit.php: The command '/usr/bin/gzip -d '/usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNum.dat.gz'' returned exit code '1', the output was 'gzip: /usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNum.dat.gz: not in gzip format'

jimp · Apr 6, 2015, 2:16 PM

None of those appear to be fatal, though I haven't seen that lua error before.

Though what's weird is the files appear to be coming from MaxMind named GeoIPASNum[v6].dat.gz but are apparently NOT in gzip format. Not sure of a good way around that at the moment, since it would be bad to assume the format of the files, though there may not be much of a choice.

Is this on 2.1.x or 2.2.x?

gogol · Apr 8, 2015, 8:05 AM

This is the location of these file at maxmind.com:

http://download.maxmind.com/download/geoip/database/asnum/GeoIPASNum.dat.gz
http://download.maxmind.com/download/geoip/database/asnum/GeoIPASNumv6.dat.gz

Those files were damaged and I put the above downloaded and extracted files in /usr/pbi/ntopng-amd64/local/share/ntopng. I also made symlinks to those files in /usr/pbi/ntopng-amd64/local/share/ntopng/httpdocs/geoip/

Now this error has gone:

 /pkg_edit.php: The command '/usr/bin/gzip -d '/usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNumv6.dat.gz'' returned exit code '1', the output was 'gzip: /usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNumv6.dat.gz: not in gzip format'

I guess that ~~the download location of the files is wrong~~ the files get damaged during download.

gogol · Apr 7, 2015, 8:35 PM

@Dmitriy:

The subject makes me sad:

Apr 6 16:16:54 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_trace' from file './lua_trace.lua': cannot open ./lua_trace.lua: No such file or directory]
Apr 6 16:16:44 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_utils' from file '/usr/local/share/ntopng/scripts/lua/modules/lua_utils.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/lua_utils.lua: No such file or directory]
Apr 6 16:15:24 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_trace' from file '/usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua: No such file or directory]
Apr 6 16:15:24 ntopng: [Lua.cpp:2775] WARNING: Script failure [/usr/local/share/ntopng/scripts/lua/get_host_data.lua][error loading module 'lua_trace' from file '/usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/lua_trace.lua: No such file or directory]
Apr 6 16:11:56 ntopng: [Geolocation.cpp:59] WARNING: Unable to read GeoIP database /usr/local/share/ntopng/httpdocs/geoip/GeoIPASNumv6.dat
Apr 6 16:11:56 ntopng: [Geolocation.cpp:59] WARNING: Unable to read GeoIP database /usr/local/share/ntopng/httpdocs/geoip/GeoIPASNum.dat
Apr 6 16:11:55 php-fpm[24113]: /pkg_edit.php: The command '/usr/bin/gzip -d '/usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNumv6.dat.gz'' returned exit code '1', the output was 'gzip: /usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNumv6.dat.gz: not in gzip format'
Apr 6 16:11:55 php-fpm[24113]: /pkg_edit.php: The command '/usr/bin/gzip -d '/usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNum.dat.gz'' returned exit code '1', the output was 'gzip: /usr/pbi/ntopng-amd64/share/ntopng/GeoIPASNum.dat.gz: not in gzip format'

And the directory /usr/local/share/ntopng is not installed there but within /usr/pbi/ntopng-amd64/local/share/ntopng so I made a symlink ntopng in the directory /usr/local/share to /usr/pbi/ntopng-amd64/local/share/ntopng/

#cd /usr/local/share
#ln -s /usr/pbi/ntopng-amd64/local/share/ntopng/ ntopng

eshield · Apr 8, 2015, 9:11 AM

@jimp:

None of those appear to be fatal, though I haven't seen that lua error before.

Though what's weird is the files appear to be coming from MaxMind named GeoIPASNum[v6].dat.gz but are apparently NOT in gzip format. Not sure of a good way around that at the moment, since it would be bad to assume the format of the files, though there may not be much of a choice.

Is this on 2.1.x or 2.2.x?

it's 2.2.1 x64

dennypage · Apr 8, 2015, 4:22 PM

I am also seeing these types of errors in 2.2.1. I haven't had time to investigate. It may be related to a bug I have seen: if I double click on a flow, the data area is blank. The traffic button shows a box outline, but no data.

Apr 8 09:04:00 ntopng: [Lua.cpp:2539] WARNING: Script failure [/usr/local/share/ntopng/scripts/callbacks/second.lua][/usr/local/share/ntopng/scripts/callbacks/second.lua:8: module 'lua_utils' not found: no field package.preload['lua_utils'] no file '/usr/local/share/ntopng/scripts/lua/modules/lua_utils.lua' no file './lua_utils.lua' no file '/usr/local/share/luajit-2.0.3/lua_utils.lua' no file '/usr/local/share/lua/5.1/lua_utils.lua' no file '/usr/local/share/lua/5.1/lua_utils/init.lua' no file './lua_utils.so' no file '/usr/local/lib/lua/5.1/lua_utils.so' no file '/usr/local/lib/lua/5.1/loadall.so']
Apr 8 09:04:00 ntopng: [Lua.cpp:2539] WARNING: Script failure [/usr/local/share/ntopng/scripts/callbacks/minute.lua][error loading module 'top_talkers' from file '/usr/local/share/ntopng/scripts/lua/modules/top_talkers.lua': cannot open /usr/local/share/ntopng/scripts/lua/modules/top_talkers.lua: No such file or directory]
Apr 8 06:05:00 ntopng: [Lua.cpp:2539] WARNING: Script failure [/usr/local/share/ntopng/scripts/callbacks/second.lua][/usr/local/share/ntopng/scripts/lua/modules/lua_utils.lua:9: loop or previous error loading module 'lua_utils']
Apr 8 04:03:27 ntopng: [Lua.cpp:2539] WARNING: Script failure [/usr/local/share/ntopng/scripts/callbacks/second.lua][/usr/local/share/ntopng/scripts/callbacks/second.lua:9: module 'graph_utils' not found: no field package.preload['graph_utils'] no file '/usr/local/share/ntopng/scripts/lua/modules/graph_utils.lua' no file './graph_utils.lua' no file '/usr/local/share/luajit-2.0.3/graph_utils.lua' no file '/usr/local/share/lua/5.1/graph_utils.lua' no file '/usr/local/share/lua/5.1/graph_utils/init.lua' no file './graph_utils.so' no file '/usr/local/lib/lua/5.1/graph_utils.so' no file '/usr/local/lib/lua/5.1/loadall.so']

laiclair · Jun 13, 2015, 3:05 PM

Hello,

This is linked to bug :
https://redmine.pfsense.org/issues/4567
Is there a way to reopen it ?