Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    package or way to modify links

    Scheduled Pinned Locked Moved General pfSense Questions
    8 Posts 3 Posters 725 Views 3 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P Offline
      pooperman
      last edited by pooperman

      hi folks,

      is there a way known or a package, to auto modify links according to rules?

      e.g.
      https://mydealz.digidip.net/visit?url=https%3A%2F%2Fwww.saturn.de%2Fde%2Fproduct%2F_xiaomi-redmi-9a-2667686.html&ppref=https%3A%2F%2Fwww.mydealz.de%2Fdeals%2Fxiaomi-redmi-9a-32gb-dual-sim-3-farben-fur-je-7890eur-inkl-versandkosten-1693872&ref=1148037647

      that link includes all reference stuff that i dont want.

      just want to get:
      https://www.saturn.de/de/product/_xiaomi-redmi-9a-2667686.html

      1 Reply Last reply Reply Quote 0
      • stephenw10S Offline
        stephenw10 Netgate Administrator
        last edited by

        Squidguard has a url re-write feature you might be able to use with some careful regex. It's unlikely to work well across numerous pages though.

        Why not just use the link directly?

        Steve

        1 Reply Last reply Reply Quote 0
        • P Offline
          pooperman
          last edited by

          hi Steve, thanks for your post.

          i am aware that some kind of rule needs to be written for every single page, but that would be fine.

          Would like to have it automatized because digidip is a huge data octopus and manually changing the URL is annoying. The URL is unfortunately never directly visible. so you need to inspect within your browser.

          Will check on squidguard!

          1 Reply Last reply Reply Quote 0
          • johnpozJ Online
            johnpoz LAYER 8 Global Moderator
            last edited by johnpoz

            Ok going to show you a addon you might be interested in ;)

            https://addons.mozilla.org/en-US/firefox/addon/clearurls/

            This is not something you would do on pfsense, this is something you would do in you browser..

            So take your link there

            cleanurl.png

            Now I paste that url - and get exactly what your after..

            pasted.png

            https://gitlab.com/KevinRoebert/ClearUrls
            ClearURLs is an add-on based on the new WebExtensions technology and will automatically remove tracking elements from URLs to help protect your privacy when browse through the Internet.

            it works in the background - you shouldn't have to copy and paste, that is just feature you can use with it.. Which I did to show you how it works..

            An intelligent man is sometimes forced to be drunk to spend time with his fools
            If you get confused: Listen to the Music Play
            Please don't Chat/PM me for help, unless mod related
            SG-4860 24.11 | Lab VMs 2.8, 24.11

            P 1 Reply Last reply Reply Quote 2
            • P Offline
              pooperman @johnpoz
              last edited by

              @johnpoz
              thanks for presenting the addon, will check it.

              just for my education, why do I dont want to have this integrated into pfsense?

              1 Reply Last reply Reply Quote 0
              • johnpozJ Online
                johnpoz LAYER 8 Global Moderator
                last edited by johnpoz

                Because you would have to proxy all your connections through it.. How do you think that would work when everything is inside a https tunnels these days?

                How would pfsense even see the urls on the website?

                Https is laymans terms a vpn between your browser and the webserver.. You have an encrypted tunnel between the browser and the server.. Your router can not see whats inside this tunnel.

                For something like this to work, you would need to proxy all your connections and do mitm on all https traffic.. Why you do it in your browser..

                What your asking is for every https connection to be proxied, and for the proxy to rewrite the destination as well.. Makes no sense to do.. When you proxy a https connection you send a connect.. So your proxy would have to rewrite that connect, and figure out where you want to go, and send you there - but that is not where your browser thought you were going.. So its going to scream bloody murder at that for sure..

                An intelligent man is sometimes forced to be drunk to spend time with his fools
                If you get confused: Listen to the Music Play
                Please don't Chat/PM me for help, unless mod related
                SG-4860 24.11 | Lab VMs 2.8, 24.11

                1 Reply Last reply Reply Quote 1
                • stephenw10S Offline
                  stephenw10 Netgate Administrator
                  last edited by stephenw10

                  Not really sure what digidip is or why you would want to go there. I tried to visit it though and find it's blocked as advertising so that tells me all I need to know. 😉

                  But, yeah, a browser extension seems like a much better way to go here.

                  Steve

                  1 Reply Last reply Reply Quote 1
                  • johnpozJ Online
                    johnpoz LAYER 8 Global Moderator
                    last edited by johnpoz

                    I think the idea is he doesn't want to go there ;)

                    He just wants to go to the site, vs routing it through that site... Something like this is done on the browser.. Before you ever go anywhere.

                    If I try and proxy that with proxy stripping out the shit and going to where you want to go..

                    https://shitsite.com/blahblah-https://realsite.tld

                    You send connect to your proxy saying you want to go to shitsite.com, but it really goes to realsite.tld and tries to send that back you browser is going to say wtf is this.. That is not shitsite.com..

                    You do it at the browser level, so browser goes to realsite.tld

                    Keep in mind - with links your going to click on, the addon might not change those... Which is why you use the copy and paste clean option on something you want to click on..

                    I was not all that worried about tracking stuff via browser called stuff in the site.. But wanted a simple way to clean up shit links before I sent them to friends, etc. Or posted them on forums without having to do it manually..

                    But what the addon on does in the background is removing tracking stuff in say scripts and other stuff called by a website your loading..

                    you can turn on local logging to see what its doing in the background.. But for stuff like an email your reading with some shit link like you posted, and you want to just go to where it ends up without routing you through some tracking that you clicked their link - the copy paste is the best option. Or the addon has a little tool you can load to copy paste stuff..

                    tool.png

                    An intelligent man is sometimes forced to be drunk to spend time with his fools
                    If you get confused: Listen to the Music Play
                    Please don't Chat/PM me for help, unless mod related
                    SG-4860 24.11 | Lab VMs 2.8, 24.11

                    1 Reply Last reply Reply Quote 1
                    • First post
                      Last post
                    Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.