Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    IMSpector package

    Scheduled Pinned Locked Moved pfSense Packages
    52 Posts 16 Posters 35.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      billm
      last edited by

      Here's what I'm working on in order:

      • Fix the MySQL logging - sql logging libraries aren't being packaged

      • ACL lists changed format between versions, fix support again

      • Update the IMSpector binary to the latest snapshot to fix MSN (the commit log says the code was untested, so who knows)

      • Fix parsing of old logs if possible (if not, just go to the shell and read the logs yourself, sheesh), new logs are FINE

      • Add new protocols and options that came with updated IMSpector (this includes message injection)

      • Output HTML escaped logs, otherwise the browser parses these (OUCH!)

      • Add Log cleanup functionality

      –Bill

      Updates: Crossed out items are believed to be completed.
      Update: March-04-2009 - Added a couple more todo's.  Should have these all cleaned up next week during the hackathon.

      pfSense core developer
      blog - http://www.ucsecurity.com/
      twitter - billmarquette

      1 Reply Last reply Reply Quote 0
      • N
        n1ko
        last edited by

        Downloading package configuration file… done.
        Saving updated package information... done.
        Downloading imspector and its dependencies... done.
        Checking for successful package installation... failed!

        Installation aborted.


        Reinstall (or install after failed reinstall) seems to b0rked. I am using 1.2.3-PRERELEASE-TESTING-VERSION
        built on Wed Feb 11 12:27:02 EST 2009

        Anyhow, thanks for the hard work billm! Its good to see active maintainer on a package as popular as imspector

        1 Reply Last reply Reply Quote 0
        • J
          jigpe
          last edited by

          Thanks for the heads up. I downloaded it:
          Checking for successful package installation… failed!
          Good luck Bill :) Ill test it again sometime

          jigp
          Davao

          1 Reply Last reply Reply Quote 0
          • H
            hadi57
            last edited by

            hi billm

            i ve been using IMSpector for a while now, but when installed, yahoo massenger audio stops working as per all my clients, so they cant communicate with their parties overseas if i install IMSpector, any reason for that?

            Thanks in advance

            hadi57

            1 Reply Last reply Reply Quote 0
            • B
              billm
              last edited by

              @n1ko:

              Downloading package configuration file… done.
              Saving updated package information... done.
              Downloading imspector and its dependencies... done.
              Checking for successful package installation... failed!

              Installation aborted.


              Reinstall (or install after failed reinstall) seems to b0rked. I am using 1.2.3-PRERELEASE-TESTING-VERSION
              built on Wed Feb 11 12:27:02 EST 2009

              Anyhow, thanks for the hard work billm! Its good to see active maintainer on a package as popular as imspector

              crap, teach me to not test the actual install after updating it.  sigh  Looks like the package installer looks in a slightly different directory than I thought - we didn't have the mysql package online.  Hoping to get it built and pushed before I head to work in a few minutes.

              –Bill

              pfSense core developer
              blog - http://www.ucsecurity.com/
              twitter - billmarquette

              1 Reply Last reply Reply Quote 0
              • B
                billm
                last edited by

                @billm:

                @n1ko:

                Downloading package configuration file… done.
                Saving updated package information... done.
                Downloading imspector and its dependencies... done.
                Checking for successful package installation... failed!

                Installation aborted.


                Reinstall (or install after failed reinstall) seems to b0rked. I am using 1.2.3-PRERELEASE-TESTING-VERSION
                built on Wed Feb 11 12:27:02 EST 2009

                Anyhow, thanks for the hard work billm! Its good to see active maintainer on a package as popular as imspector

                crap, teach me to not test the actual install after updating it.  sigh  Looks like the package installer looks in a slightly different directory than I thought - we didn't have the mysql package online.  Hoping to get it built and pushed before I head to work in a few minutes.

                –Bill

                Erm…in the meantime, I'm going to disable the mysql and sqlite installs again.

                --Bill

                pfSense core developer
                blog - http://www.ucsecurity.com/
                twitter - billmarquette

                1 Reply Last reply Reply Quote 0
                • N
                  n1ko
                  last edited by

                  Installed fine now o/

                  Thanks alot bill for the quick fix :)

                  1 Reply Last reply Reply Quote 0
                  • B
                    billm
                    last edited by

                    @n1ko:

                    Installed fine now o/

                    Thanks alot bill for the quick fix :)

                    0.8-5 is getting pushed now, it should fix mysql.  It takes a few minutes to sync with the package repo - I'll test it quick and roll back if it doesn't install.

                    Update1: mysql installs now, made a typo in the sqlite install…syncing now.
                    Update2: sqlite3 install works now, package looks to be fixed.

                    --Bill

                    pfSense core developer
                    blog - http://www.ucsecurity.com/
                    twitter - billmarquette

                    1 Reply Last reply Reply Quote 0
                    • A
                      AudiAddict
                      last edited by

                      Great work bill, I will test the package and verify if the msn issue has been fixed.

                      1 Reply Last reply Reply Quote 0
                      • A
                        AudiAddict
                        last edited by

                        Bill, just a suggestion for the future (no priority) I would suggest adding a log rotation/cleaup function.

                        Delete logs older than 14 days for example. I tried finding a cronjob tutorial for pfsense ( normaly I do this with webmin on my debian machines…:P) but I couldn't find any.

                        Could you tell us how to schedule some kind of weekly cronjob to delete all log files in the impsector dir?

                        1 Reply Last reply Reply Quote 0
                        • B
                          billm
                          last edited by

                          @AudiAddict:

                          Bill, just a suggestion for the future (no priority) I would suggest adding a log rotation/cleaup function.

                          Delete logs older than 14 days for example. I tried finding a cronjob tutorial for pfsense ( normaly I do this with webmin on my debian machines…:P) but I couldn't find any.

                          Could you tell us how to schedule some kind of weekly cronjob to delete all log files in the impsector dir?

                          Good point, I'll see what I can do about that.  In the meantime insert this into /conf/config.xml before the and reboot (or back up, edit, and restore the config file):
                          <minute>0</minute>
                          <hour>0</hour>
                          <mday></mday>
                          <month>
                          </month>
                          <wday>*</wday>
                          <who>root</who>
                          <command></command>find /var/imspector -ctime +14 -type f -delete

                          Note, I didn't test the above, it should work, I don't believe there are any special characters that the XML will barf on in there.

                          –Bill

                          pfSense core developer
                          blog - http://www.ucsecurity.com/
                          twitter - billmarquette

                          1 Reply Last reply Reply Quote 0
                          • A
                            AudiAddict
                            last edited by

                            Awesome thanks for the new feature, I will test it sometime this weekend ( I dont' really have the option to reboot the firewall during the weekdays :P)

                            Do I need to update/reinstall the imspector package to make this feature work? Or is this feature independent vs the imspector package and it doesn't display the feature in the webgui under imspector?

                            Last but not least, the files are directories (example MSN\msnprofile\files) Does it do a rm -r ?

                            1 Reply Last reply Reply Quote 0
                            • B
                              billm
                              last edited by

                              @AudiAddict:

                              Awesome thanks for the new feature, I will test it sometime this weekend ( I dont' really have the option to reboot the firewall during the weekdays :P)

                              Do I need to update/reinstall the imspector package to make this feature work? Or is this feature independent vs the imspector package and it doesn't display the feature in the webgui under imspector?

                              The cron settings are built into pfSense, not part of the IMSpector package.  What I'll be doing is adding the above XML (slightly differently) to the package install.

                              @AudiAddict:

                              Last but not least, the files are directories (example MSN\msnprofile\files) Does it do a rm -r ?

                              find will recurse.

                              –Bill

                              pfSense core developer
                              blog - http://www.ucsecurity.com/
                              twitter - billmarquette

                              1 Reply Last reply Reply Quote 0
                              • A
                                AudiAddict
                                last edited by

                                Update the IMSpector binary to the latest snapshot to fix MSN (the commit log says the code was untested, so who knows)

                                Bill just to confirm the fix you added for the MSN log bug seems to be solved!!

                                The latest msn version is now being logged properly again by Imspector. Thanks allot for the help!!

                                I'm hoping to see the log clean up functionality in the package aswel instead of editing files with ssh :)

                                1 Reply Last reply Reply Quote 0
                                • F
                                  funnyfrish
                                  last edited by

                                  hello bilim

                                  You did a great work! I have installed ver. 8.5 and it is logging (tested with irc an msn).
                                  I have tried the mysql function, entered die required parameters but it doesn't connect i think,
                                  however, its not that important as the other protocols.

                                  What about the other protocols such as gtalk? When are you going to tackle that?

                                  And for other people who own a paypal account, dont hesitate to make a donations for bilim.

                                  1 Reply Last reply Reply Quote 0
                                  • B
                                    billm
                                    last edited by

                                    @funnyfrish:

                                    hello bilim

                                    You did a great work! I have installed ver. 8.5 and it is logging (tested with irc an msn).
                                    I have tried the mysql function, entered die required parameters but it doesn't connect i think,
                                    however, its not that important as the other protocols.

                                    I've got a mysql server up local here, I'll test out the mysql here and see what's up, it should work at this point.

                                    @funnyfrish:

                                    What about the other protocols such as gtalk? When are you going to tackle that?

                                    And for other people who own a paypal account, dont hesitate to make a donations for bilim.

                                    Soon, been tied up on some contract work.  Worst case, this might wait until the hackathon.

                                    –Bill

                                    pfSense core developer
                                    blog - http://www.ucsecurity.com/
                                    twitter - billmarquette

                                    1 Reply Last reply Reply Quote 0
                                    • J
                                      jigpe
                                      last edited by

                                      Hello. No luck for gtalk? Been testing yahoo messenger, msn and irc but gtalk wont log in pfsense 1.2.2 impector version 8 .
                                      jigp
                                      Davao City

                                      1 Reply Last reply Reply Quote 0
                                      • B
                                        billm
                                        last edited by

                                        @jigpe:

                                        Hello. No luck for gtalk? Been testing yahoo messenger, msn and irc but gtalk wont log in pfsense 1.2.2 impector version 8 .
                                        jigp
                                        Davao City

                                        Do you even bother to read the threads you post in?  Two messages above you, the question was asked (by the only person financially interested in this package) and replied to in the message immediately prior to your post.  No.  It'll be in, when it's in.

                                        –Bill

                                        pfSense core developer
                                        blog - http://www.ucsecurity.com/
                                        twitter - billmarquette

                                        1 Reply Last reply Reply Quote 0
                                        • GertjanG
                                          Gertjan
                                          last edited by

                                          @billm:

                                          I've got a mysql server up local here, I'll test out the mysql here and see what's up, it should work at this point.

                                          Me to, having a mysql 5.2.x running around for logging for other equipment on the lan.

                                          But imsepctor 'should' tell that the mysql 'could' be used as a logging plugin, if it's included in the build.
                                          I tried the -d parameter, but nothing …
                                          Looking at the source of the Mysql plugin code, it should some log lines, as these :

                                          …
                                          Feb 21 11:26:59 imspector: Logging Plugin name: File IMSpector logging plugin
                                          Feb 21 11:26:59 imspector: Filter Plugin name: Misc IMSpector filter plugin
                                          Feb 21 11:26:59 imspector: Protocol Plugin name: Yahoo IMSpector protocol plugin
                                          Feb 21 11:26:59 imspector: Protocol Plugin name: MSN IMSpector protocol plugin
                                          Feb 21 11:26:59 imspector: Protocol Plugin name: IRC IMSpector protocol plugin
                                          Feb 21 11:26:59 imspector: Protocol Plugin name: ICQ-AIM IMSpector protocol plugin
                                          Feb 21 11:26:59 imspector: Protocol Plugin name: MSN IMSpector protocol plugin
                                          ...

                                          But there's nothing from the MySQL log plugin.
                                          I think it's not present in the build right now.

                                          Said that, I'll keep in mind that pfsense is a firewall - it's already marvellous it works as it does right now.

                                          No "help me" PM's please. Use the forum, the community will thank you.
                                          Edit : and where are the logs ??

                                          1 Reply Last reply Reply Quote 0
                                          • B
                                            billm
                                            last edited by

                                            @Gertjan:

                                            @billm:

                                            I've got a mysql server up local here, I'll test out the mysql here and see what's up, it should work at this point.

                                            Me to, having a mysql 5.2.x running around for logging for other equipment on the lan.

                                            But imsepctor 'should' tell that the mysql 'could' be used as a logging plugin, if it's included in the build.
                                            I tried the -d parameter, but nothing …

                                            It was in the build.  I see what happened, I didn't update the packing list in the FreeBSD port when I added the mysql plugin to the build.  I'll push out a new update later today that should (really!) fix mysql logging.

                                            –Bill

                                            pfSense core developer
                                            blog - http://www.ucsecurity.com/
                                            twitter - billmarquette

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.