Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Ntopng development

    Scheduled Pinned Locked Moved Traffic Monitoring
    83 Posts 28 Posters 36.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dennypageD
      dennypage
      last edited by

      Would you mind checking the sum on ntopng.inc please?

      The command is this: sum /usr/local/pkg/ntopng.inc

      The expected output is this: 51966 12 /usr/local/pkg/ntopng.inc

      Thanks

      1 Reply Last reply Reply Quote 0
      • dennypageD
        dennypage
        last edited by

        @luckman212:

        Denny, do you know what the main reason is that the 2.4 version of ntopng isn't available in pfSense?

        I don't have direct knowledge, but if I had to guess I would say that it's a fair bit of work and nobody has volunteered or been assigned for it.

        1 Reply Last reply Reply Quote 0
        • luckman212L
          luckman212 LAYER 8
          last edited by

          Hmm ok I didn't realize it was much work after the FreeBSD port.  Ok, I wish I could help somehow.  I looked at the "Developing Packages" page but tbh I wouldn't know where to start :(

          1 Reply Last reply Reply Quote 0
          • R
            r_e_d_b_a_r_o_n
            last edited by

            @dennypage:

            Would you mind checking the sum on ntopng.inc please?

            The command is this: sum /usr/local/pkg/ntopng.inc

            The expected output is this: 51966 12 /usr/local/pkg/ntopng.inc

            Thanks

            This is output of sum:

            51966 12 /usr/local/pkg/ntopng.inc

            As kesawi mention I also have certificate at place and it's regenerating.

            1 Reply Last reply Reply Quote 0
            • dennypageD
              dennypage
              last edited by

              Regeneration of the ssl certificate every time you save settings or reboot is expected.

              r_e_d_b_a_r_o_n, can you post the unmodified content of /usr/local/etc/rc.d/ntopng.sh please?

              And can you clarify the version of pfSense you are running as well?

              Thanks

              1 Reply Last reply Reply Quote 0
              • R
                r_e_d_b_a_r_o_n
                last edited by

                @dennypage:

                Regeneration of the ssl certificate every time you save settings or reboot is expected.

                r_e_d_b_a_r_o_n, can you post the unmodified content of /usr/local/etc/rc.d/ntopng.sh please?

                And can you clarify the version of pfSense you are running as well?

                Thanks

                So I uninstalled package and checked that every file belonging to ntopng is deleted and reinstalled;

                Output from sum is: 59748 12 /usr/local/pkg/ntopng.inc (so previosly file was modified by me);

                ntopng-cert.pem is avalable in /usr/local/share/ntopng/httpdocs/ssl;

                Contents of /usr/local/etc/rc.d/ntopng.sh:
                #!/bin/sh

                This file was automatically generated

                by the pfSense service handler.

                rc_start() {
                /usr/local/bin/redis-server –dir /var/db/ntopng/ --dbfilename ntopng.rdb &
                /usr/local/bin/ntopng -d /var/db/ntopng -G /var/run/ntopng.pid -s -e -w 0 -W 3000
                    -i 'vmx1' -i 'vmx2' --dns-mode '0'  --local-networks '192.168.0.0/16,172.16.0.0/12,10.0.0.0/8' &

                }

                rc_stop() {
                /usr/bin/killall ntopng redis-cli redis-server

                }

                case $1 in
                start)
                rc_start
                ;;
                stop)
                rc_stop
                ;;
                restart)
                rc_stop
                rc_start
                ;;
                esac

                pfSense vewrsion I am running is:

                2.3.2-RELEASE (amd64)
                built on Tue Jul 19 12:44:43 CDT 2016
                FreeBSD 10.3-RELEASE-p5

                1 Reply Last reply Reply Quote 0
                • kesawiK
                  kesawi
                  last edited by

                  @dennypage:

                  Would you mind checking the sum on ntopng.inc please?

                  The command is this: sum /usr/local/pkg/ntopng.inc

                  The expected output is this: 51966 12 /usr/local/pkg/ntopng.inc

                  My output is different:

                  59748 12 /usr/local/pkg/ntopng.inc
                  

                  Also my  /usr/local/etc/rc.d/ntopng.sh:

                  #!/bin/sh
                  # This file was automatically generated
                  # by the pfSense service handler.
                  
                  rc_start() {
                                  /usr/local/bin/redis-server --dir /var/db/ntopng/ --dbfilename ntopng.rdb &
                          /usr/local/bin/ntopng -d /var/db/ntopng -G /var/run/ntopng.pid -s -e -w 0 -W 3000
                   -H   -i 'lagg0_vlan2' --dns-mode '0'  --local-networks '192.168.0.0/16,172.16.0.0/12,10.0.0.0/8' &
                  
                  }
                  
                  rc_stop() {
                          /usr/bin/killall ntopng redis-cli redis-server
                  
                  }
                  
                  case $1 in
                          start)
                                  rc_start
                                  ;;
                          stop)
                                  rc_stop
                                  ;;
                  esac
                  
                  

                  I notice I have -H in the rc_start.

                  When I manually launch ntopng.sh

                   /usr/local/etc/rc.d/ntopng.sh start
                                  _._
                             _.-``__ ''-._
                        _.-``    `.  `_.  ''-._           Redis 3.0.7 (00000000/0) 64 bit
                    .-`` .-```.  ```\/    _.,_ ''-._
                   (    '      ,       .-`  | `,    )     Running in standalone mode
                   |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
                   |    `-._   `._    /     _.-'    |     PID: 13809
                    `-._    `-._  `-./  _.-'    _.-'
                   |`-._`-._    `-.__.-'    _.-'_.-'|
                   |    `-._`-._        _.-'_.-'    |           http://redis.io
                    `-._    `-._`-.__.-'_.-'    _.-'
                   |`-._`-._    `-.__.-'    _.-'_.-'|
                   |    `-._`-._        _.-'_.-'    |
                    `-._    `-._`-.__.-'_.-'    _.-'
                        `-._    `-.__.-'    _.-'
                            `-._        _.-'
                                `-.__.-'
                  
                  13809:M 05 Sep 06:32:26.174 # Server started, Redis version 3.0.7
                  13809:M 05 Sep 06:32:26.180 * DB loaded from disk: 0.006 seconds
                  13809:M 05 Sep 06:32:26.180 * The server is now ready to accept connections on port 6379
                  05/Sep/2016 06:32:26 [Prefs.cpp:915] Logging into /var/db/ntopng/ntopng.log
                  05/Sep/2016 06:32:26 [Ntop.cpp:1013] Setting local networks to 127.0.0.0/8
                  05/Sep/2016 06:32:26 [Redis.cpp:92] Successfully connected to redis 127.0.0.1:6379@0
                  05/Sep/2016 06:32:26 [Ntop.cpp:987] Parent process is exiting (this is normal)
                  /usr/local/etc/rc.d/ntopng.sh: -H: not found
                  
                  

                  I modified ntopng.sh to remove the line break before the -H and then ran it manually, and the script started without error, but still received [HTTPserver.cpp:503] ERROR in the log files.

                  1 Reply Last reply Reply Quote 0
                  • dennypageD
                    dennypage
                    last edited by

                    @r_e_d_b_a_r_o_n:

                    Output from sum is: 59748 12 /usr/local/pkg/ntopng.inc (so previosly file was modified by me);

                    Yep, that's the old version of ntopng.inc.

                    The problem is in the repository. There are three branches in the repository that are pertinent, devel, 2_3, and 2_3_2. As you would expect, development happens in the devel branch, and changes are then back-ported as appropriate to the other branches. The changed files (Makefile, ntopng.inc) are in devel, and were ported to 2_3 (currently seen as the 2.3.3 test distribution), but the port to 2_3_2 was incomplete. The Makefile change is there, but the ntopng.inc change is not.

                    There is a new PR to update the version number. I don't believe that the build server will be updated until Monday or possibly Tuesday. In the meantime, you can apply the following patch:

                    /usr/local/pkg: diff ntopng.inc.old ntopng.inc.new
                    149c149
                    < $http_args = "-w 0 -W 3000\n";
                    –-

                    $http_args = "-w 0 -W 3000";
                    152c152
                    < $http_args = "-w 3000\n";


                    $http_args = "-w 3000";

                    1 Reply Last reply Reply Quote 0
                    • kesawiK
                      kesawi
                      last edited by

                      Made the changes, saved the configuration through the GUI, still getting the error.

                      1 Reply Last reply Reply Quote 0
                      • dennypageD
                        dennypage
                        last edited by

                        Okay, let's start over following these steps:

                        1. Confirm the sum of ntopng.inc. It should be 51966.

                        2. Save the configuration on the ntopng settings page.

                        3. Post the contents of /usr/local/etc/rc.d/ntopng.sh as generated. Please use a code section to ensure that there are no changes in posting.

                        4. Post the entire output from ntopng startup (including the error message).

                        1 Reply Last reply Reply Quote 0
                        • kesawiK
                          kesawi
                          last edited by

                          @dennypage:

                          Okay, let's start over following these steps:

                          1. Confirm the sum of ntopng.inc. It should be 51966.

                          sum /usr/local/pkg/ntopng.inc
                          51966 12 /usr/local/pkg/ntopng.inc
                          
                          

                          2. Save the configuration on the ntopng settings page.

                          Done

                          3. Post the contents of /usr/local/etc/rc.d/ntopng.sh as generated. Please use a code section to ensure that there are no changes in posting.

                          cat /usr/local/etc/rc.d/ntopng.sh
                          #!/bin/sh
                          # This file was automatically generated
                          # by the pfSense service handler.
                          
                          rc_start() {
                                          /usr/local/bin/redis-server --dir /var/db/ntopng/ --dbfilename ntopng.rdb &
                                  /usr/local/bin/ntopng -d /var/db/ntopng -G /var/run/ntopng.pid -s -e -w 0 -W 3000 -H   -i 'lagg0_vlan2' -i 'lagg0_vlan10' -i 'lagg0_vlan15' --dns-mode '0'  --local-networks '192.168.2.0/24,192.168.10.0/24,192.168.15.0/28' &
                          
                          }
                          
                          rc_stop() {
                                  /usr/bin/killall ntopng redis-cli redis-server
                          
                          }
                          
                          case $1 in
                                  start)
                                          rc_start
                                          ;;
                                  stop)
                                          rc_stop
                                          ;;
                                  restart)
                                          rc_stop
                                          rc_start
                                          ;;
                          esac
                          
                          

                          4. Post the entire output from ntopng startup (including the error message).

                           /usr/local/etc/rc.d/ntopng.sh start
                                           _._                                                                                                                                                                      
                                     _.-``__ ''-._
                                _.-``    `.  `_.  ''-._           Redis 3.0.7 (00000000/0) 64 bit
                            .-`` .-```.  ```\/    _.,_ ''-._
                           (    '      ,       .-`  | `,    )     Running in standalone mode
                           |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
                           |    `-._   `._    /     _.-'    |     PID: 87223
                            `-._    `-._  `-./  _.-'    _.-'
                           |`-._`-._    `-.__.-'    _.-'_.-'|
                           |    `-._`-._        _.-'_.-'    |           http://redis.io
                            `-._    `-._`-.__.-'_.-'    _.-'
                           |`-._`-._    `-.__.-'    _.-'_.-'|
                           |    `-._`-._        _.-'_.-'    |
                            `-._    `-._`-.__.-'_.-'    _.-'
                                `-._    `-.__.-'    _.-'
                                    `-._        _.-'
                                        `-.__.-'
                          
                          87223:M 05 Sep 21:29:15.310 # Server started, Redis version 3.0.7
                          87223:M 05 Sep 21:29:15.316 * DB loaded from disk: 0.005 seconds
                          87223:M 05 Sep 21:29:15.316 * The server is now ready to accept connections on port 6379
                          05/Sep/2016 21:29:15 [Prefs.cpp:915] Logging into /var/db/ntopng/ntopng.log
                          05/Sep/2016 21:29:15 [Ntop.cpp:1013] Setting local networks to 192.168.2.0/24,192.168.10.0/24,192.168.15.0/28
                          05/Sep/2016 21:29:15 [Redis.cpp:92] Successfully connected to redis 127.0.0.1:6379@0
                          05/Sep/2016 21:29:15 [Ntop.cpp:987] Parent process is exiting (this is normal)
                          
                          
                          1 Reply Last reply Reply Quote 0
                          • P
                            polcape
                            last edited by

                            I have the same problem. It's caused by an error to build the ssl certificate /usr/local/share/ntopng/httpdocs/ssl/ntopng-cert.pem

                            If you edit this file you have to change line between the certificate and the private key from
                            –---END CERTIFICATE----------BEGIN PRIVATE KEY-----
                            to
                            -----END CERTIFICATE-----
                            -----BEGIN PRIVATE KEY-----

                            So you have to add the newline with enter key.

                            Now works fine.

                            1 Reply Last reply Reply Quote 0
                            • kesawiK
                              kesawi
                              last edited by

                              @polcape:

                              I have the same problem. It's caused by an error to build the ssl certificate /usr/local/share/ntopng/httpdocs/ssl/ntopng-cert.pem

                              Thanks, that fixed it.

                              1 Reply Last reply Reply Quote 0
                              • dennypageD
                                dennypage
                                last edited by

                                Odd that your CERT doesn't have a new line at the end. Easy enough to fix. Where did the certificate originate from? Was it generated or imported?

                                1 Reply Last reply Reply Quote 0
                                • P
                                  polcape
                                  last edited by

                                  My CERT is imported.
                                  Where I find it in PFSense to add newline?

                                  Thanks

                                  1 Reply Last reply Reply Quote 0
                                  • dennypageD
                                    dennypage
                                    last edited by

                                    Unfortunately once a cert is imported, you cannot edit it. You can edit CAs, but not certs.

                                    1 Reply Last reply Reply Quote 0
                                    • kesawiK
                                      kesawi
                                      last edited by

                                      @dennypage:

                                      Odd that your CERT doesn't have a new line at the end. Easy enough to fix. Where did the certificate originate from? Was it generated or imported?

                                      I imported mine as well. Certificate works fine on the pfSense WebGUI

                                      @dennypage:

                                      Unfortunately once a cert is imported, you cannot edit it. You can edit CAs, but not certs.

                                      When importing a certificate into pfSense, the key and the certificate are pasted into separate form fields, so if the new line is skipped, it would be something to do with the way pfSense processes the data.

                                      1 Reply Last reply Reply Quote 0
                                      • dennypageD
                                        dennypage
                                        last edited by

                                        pfSense takes the pasted data exactly as is, so it means that the certificated when pasted didn't end in a newline. What you would see in the input box is that after the paste the cursor is at the end of the line that says "–---END CERTIFICATE-----" rather than on the next line.

                                        My guess is that the certificate originated on a Windows system which sometimes omits the newline on files.

                                        1 Reply Last reply Reply Quote 0
                                        • dennypageD
                                          dennypage
                                          last edited by

                                          A PR has been created.

                                          1 Reply Last reply Reply Quote 0
                                          • dennypageD
                                            dennypage
                                            last edited by

                                            Version 0.8.4_4 has the fix for the missing newline at the end of the certificate.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.