Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Grafana Dashboard using Telegraf with additional plugins

    pfSense Packages
    28
    173
    59.6k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • V
      VictorRobellini @bigjohns97
      last edited by

      @bigjohns97 Awesome! I'll update the repo shortly.

      1 Reply Last reply Reply Quote 1
      • V
        VictorRobellini @bigjohns97
        last edited by

        @bigjohns97 Thanks again, I've updated the repo with some basic instructions. How are you showing the measurements in the dashbord? When I tried converting from microseconds to milliseconds things didn't look right.

        B 1 Reply Last reply Reply Quote 0
        • B
          bigjohns97 @VictorRobellini
          last edited by bigjohns97

          @VictorRobellini said in Grafana Dashboard using Telegraf with additional plugins:

          @bigjohns97 Thanks again, I've updated the repo with some basic instructions. How are you showing the measurements in the dashbord? When I tried converting from microseconds to milliseconds things didn't look right.

          I am using the default microseconds, I don't specify an ip address so it uses my WAN default gateway which does show in microseconds which I think is nice.

          I really don't need to see 1ms it's more useful to 4-8 microseconds even though the difference is very small, kinda lets you know when you start reaching the limits of your connection.

          BTW it looks like the graph will switch back to milliseconds as soon as the value gets that high and then it goes back to micro once things calm down.

          1 Reply Last reply Reply Quote 0
          • J
            JohnKap
            last edited by JohnKap

            I'm not sure if it's something on my system, but I needed to modify the telegraf_gateways.py script.

            Changed this:

                print("gateways,gateway_name="+values[0]+" rtt="+str(int(values[1])/100.0)+ \
          ",rttsd="+str(int(values[2])/100.0)+",loss="+str(int(values[3]))+"i")

            to this:

                print("gateways,gateway_name="+values[0]+" rtt="+str(int(values[1])/1.0)+ \
          ",rttsd="+str(int(values[2])/1.0)+",loss="+str(int(values[3]))+"i")

            The figures displayed are now correct and match what is displayed on the pfsense dashboard.

            • Green is my ISP connection, sits at ~10ms.
            • Yellow is a VPN tunnel to the other side of the world and ~400ms is about right.

            2fa9d679-fdf8-4226-9f5f-bc5842353bb4-image.png

            B V 2 Replies Last reply Reply Quote 2
            • B
              bigjohns97 @JohnKap
              last edited by bigjohns97

              @JohnKap after actually pinging the address from a machine that shows below 1ms you are correct, I never went and actually checked the accuracy of this.

              LOL at me thinking I had 8 microseconds to my first hop 😂

              1 Reply Last reply Reply Quote 2
              • V
                VictorRobellini @JohnKap
                last edited by

                @JohnKap I never understood the reason to /100. I just never took the time to dig deeper.

                Thank you

                1 Reply Last reply Reply Quote 0
                • V
                  veldthui
                  last edited by

                  Thanks for this Dashboard. I am just starting to have a play around with it and now have most things working.

                  My setup is IGB0.10 is my WAN and have this set in the variable
                  I have IGB1 and my LAN, IGB2 as my 10GB LAN, IGB1.30 as my IP Phone network and IGB1.40 as my Guest network.

                  The WAN shows but in and out look the same on the graph but show different values.
                  For the LAN it only shows IGB0 and OPVNS1. Not sure where all the other LANS are or why it does not display them.

                  This is my first look at Telegraf and InfluxDB so am a complete noob at it.

                  V 1 Reply Last reply Reply Quote 0
                  • V
                    VictorRobellini @veldthui
                    last edited by

                    @veldthui I'm not sure I understand what's going on. Can you post a screenshot?

                    V 1 Reply Last reply Reply Quote 0
                    • V
                      veldthui @VictorRobellini
                      last edited by

                      Attached is an image of the lower part which should show the WAN and LANs. It shows the WAN but does not look right and does not show the correct LANs

                      pfSense.jpg

                      V 1 Reply Last reply Reply Quote 0
                      • V
                        VictorRobellini @veldthui
                        last edited by

                        @veldthui Can you share how you have the interfaces defined in the grafana variable config?

                        V 1 Reply Last reply Reply Quote 0
                        • V
                          veldthui @VictorRobellini
                          last edited by

                          @VictorRobellini Okay I worked out that the WAN only had one of the values multiplied by 8 to change it to bytes. Changed the other and it looks okay now.

                          Below is the definition which is how it was downloaded. If I add a $ to igb1, igb2, and igb3 I can then see the igb1.30 and igb1.40 networks but not igb1 and igb0.10 should not be in the list as that is the WAN.

                          pfSense1.jpg

                          V 1 Reply Last reply Reply Quote 0
                          • V
                            VictorRobellini @veldthui
                            last edited by VictorRobellini

                            @veldthui said in Grafana Dashboard using Telegraf with additional plugins:

                            What is your Regex?
                            What adapter(s) is your WAN?
                            What adapters to you want displayed?

                            Please take a look at the github page. There's plenty written up in the Readme

                            V 1 Reply Last reply Reply Quote 0
                            • V
                              veldthui @VictorRobellini
                              last edited by

                              @VictorRobellini

                              The regex is as above. My WAN is on the IGB0 adapter as VLAN 10 which shows as igb0.10.

                              I want to display this as the WAN which it is doing. For the LAN I want to display igb1, igb1.30, igb1.40, and igb2.
                              igb3 and igb4 are not in use at present but may be in future. I have read the readme file but it does not explain it very well. I have only very basic understanding of regex as well

                              V 1 Reply Last reply Reply Quote 0
                              • V
                                VictorRobellini @veldthui
                                last edited by

                                @veldthui said in Grafana Dashboard using Telegraf with additional plugins:
                                The content of the "Regex" field is the same as what I have posted to github and it does not match what you are saying.
                                Please review the content on Github, specifically the section titled, Configuration
                                If the instructions are unclear, please let me know what I can add to make them better.

                                V 1 Reply Last reply Reply Quote 0
                                • V
                                  veldthui @VictorRobellini
                                  last edited by

                                  @VictorRobellini

                                  Okay I think I have finally worked it out. my regex now looks like /^(?!igb0)/ to filter out everything on igb0 and leave the rest showing. Appears to have worked.
                                  Thanks for the help.

                                  1 Reply Last reply Reply Quote 1
                                  • O
                                    oldfart
                                    last edited by

                                    any chance of an idiots guide (me = dummy) to installing this lot?
                                    Tried from your Github page and first problem was the docker-compose example threw errors. So gave up.

                                    V 1 Reply Last reply Reply Quote 0
                                    • V
                                      VictorRobellini @oldfart
                                      last edited by

                                      @oldfart The docker-compose is just a quick way to setup influx and grafana using docker and docker-compose. There are tutorials on the internet that show how to set this up, a quick google search will turn up plenty of resources, for example: https://www.homelabrat.com/influxdb-homelab-dashboard/

                                      O A 2 Replies Last reply Reply Quote 0
                                      • O
                                        oldfart @VictorRobellini
                                        last edited by

                                        @VictorRobellini 👍

                                        1 Reply Last reply Reply Quote 0
                                        • A
                                          anx @VictorRobellini
                                          last edited by

                                          @VictorRobellini Basically this link covers all needed components setup ?

                                          1 Reply Last reply Reply Quote 0
                                          • A
                                            anx
                                            last edited by

                                            Hi Guys,

                                            I have built pfsense with grafana etc. However I am trying to figure it out how to setup addons,

                                            https://forum.netgate.com/topic/152132/grafana-dashboard-using-telegraf-with-additional-plugins

                                            "Does /usr/local/bin/python3.7 exist on your pfSense system? If so, use this telegraf_gateways-3.7.py"

                                            How could I upload this file to pfesense? as I do not see it in pfsense file hierarchy. Thanks for help

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post