Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Syntax for bulk adding Domain Overrides to DNS Resolver

    Scheduled Pinned Locked Moved General pfSense Questions
    22 Posts 4 Posters 5.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • R Offline
      RickyBaker
      last edited by

      Thanks for the tips.  Though I'm internally debating whether backing up and editing an xml file is really, all that much faster than just adding them through the GUI.  As a clarification, I'm looking to add DOMAIN overrides.  How would that change your example (if at all)?

      1 Reply Last reply Reply Quote 0
      • KOMK Offline
        KOM
        last edited by

        How would that change your example (if at all)?

        
         <unbound>...
        
            <domainoverrides><domain>facebook.com</domain>
                <ip>10.0.0.1</ip></domainoverrides></unbound> 
        
        
        1 Reply Last reply Reply Quote 0
        • johnpozJ Online
          johnpoz LAYER 8 Global Moderator
          last edited by

          "I need to add a good number of Domain Overrides to the DNS Resolver"

          How many?  And why?  Are these actual domains that are resolved by some downstream local NS?  Or are you trying to block access to specific domains?

          An intelligent man is sometimes forced to be drunk to spend time with his fools
          If you get confused: Listen to the Music Play
          Please don't Chat/PM me for help, unless mod related
          SG-4860 25.07 | Lab VMs 2.8, 25.07

          1 Reply Last reply Reply Quote 0
          • D Offline
            doktornotor Banned
            last edited by

            @johnpoz:

            How many?  And why?  Are these actual domains that are resolved by some downstream local NS?  Or are you trying to block access to specific domains?

            Reinventing pfBNG I guess :D

            1 Reply Last reply Reply Quote 0
            • johnpozJ Online
              johnpoz LAYER 8 Global Moderator
              last edited by

              ^ Yeah that is why I ask..

              An intelligent man is sometimes forced to be drunk to spend time with his fools
              If you get confused: Listen to the Music Play
              Please don't Chat/PM me for help, unless mod related
              SG-4860 25.07 | Lab VMs 2.8, 25.07

              1 Reply Last reply Reply Quote 0
              • R Offline
                RickyBaker
                last edited by

                @johnpoz:

                "I need to add a good number of Domain Overrides to the DNS Resolver"

                How many?  And why?  Are these actual domains that are resolved by some downstream local NS?  Or are you trying to block access to specific domains?

                ~180 for now. I have a program or 2 that I'd prefer not update automatically through conventional means.

                Why? should I be checking out pfBlockerNG?

                1 Reply Last reply Reply Quote 0
                • D Offline
                  doktornotor Banned
                  last edited by

                  And you need 180 domain overrides to stop the shit from automatic updates? That program being W10, or what?

                  1 Reply Last reply Reply Quote 0
                  • johnpozJ Online
                    johnpoz LAYER 8 Global Moderator
                    last edited by

                    So you want to block them.. Then that is easy..

                    in your advanced box
                    server:
                    include: /etc/unbound_blockstuff

                    In in the file unbound_blockstuff
                    local-zone: "domain.com" redirect
                    local-data: "domain.com A 127.0.0.1"
                    local-zone: "otherdomain.org" redirect
                    local-data: "otherdomain.org A 127.0.0.1"

                    you could use 0.0.0.0 if you like that better, add as many domains as you want here..

                    You could put all the domains in the custom box directly.. But 180 is a lot!!

                    An intelligent man is sometimes forced to be drunk to spend time with his fools
                    If you get confused: Listen to the Music Play
                    Please don't Chat/PM me for help, unless mod related
                    SG-4860 25.07 | Lab VMs 2.8, 25.07

                    1 Reply Last reply Reply Quote 0
                    • KOMK Offline
                      KOM
                      last edited by

                      You could put all the domains in the custom box directly.

                      Thanks, I did not know that.

                      1 Reply Last reply Reply Quote 0
                      • R Offline
                        RickyBaker
                        last edited by

                        @doktornotor:

                        And you need 180 domain overrides to stop the shit from automatic updates? That program being W10, or what?

                        I used to use Little Snitch, but that is annoying and stopped working with the last Mac OSX update.  180 is from a curated list (that admits it may be overkill) that I found on a reddit thread very specifically for this suite of programs…

                        @johnpoz:

                        So you want to block them.. Then that is easy..

                        in your advanced box
                        server:
                        include: /etc/unbound_blockstuff

                        In in the file unbound_blockstuff
                        local-zone: "domain.com" redirect
                        local-data: "domain.com A 127.0.0.1"
                        local-zone: "otherdomain.org" redirect
                        local-data: "otherdomain.org A 127.0.0.1"

                        you could use 0.0.0.0 if you like that better, add as many domains as you want here..

                        You could put all the domains in the custom box directly.. But 180 is a lot!!

                        Great thanks so much! I'll report back when I test it out!

                        1 Reply Last reply Reply Quote 0
                        • johnpozJ Online
                          johnpoz LAYER 8 Global Moderator
                          last edited by

                          so curious are these domains all actual domains, or subdomains of parent.  180 domains for phone home seems a bit much.. I am guessing they are just all hosts/subs off a parent or a couple of parents.

                          so you have

                          something.domain.tld, and somethingelse.domain.tld or something.something.domain.tld, etc..

                          If that is the case then you really only need 1 redirect that anything.domain.tld would return loopback or 0.0.0.0

                          That some device would use 180 actual different domains trying to update just seems nuts..

                          An intelligent man is sometimes forced to be drunk to spend time with his fools
                          If you get confused: Listen to the Music Play
                          Please don't Chat/PM me for help, unless mod related
                          SG-4860 25.07 | Lab VMs 2.8, 25.07

                          1 Reply Last reply Reply Quote 0
                          • R Offline
                            RickyBaker
                            last edited by

                            @johnpoz:

                            you could use 0.0.0.0 if you like that better, add as many domains as you want here..

                            You could put all the domains in the custom box directly.. But 180 is a lot!!

                            I've read that 0.0.0.0 is better cause it avoids a windows issue with avoids the slowdown issue with the TCP loopback interface on later version of windows.  Is there anything special I need to add to the file to use 0.0.0.0?

                            edit: Sorry! didn't see your response!  As I was going through the list and adding it to a txt file like you described I noticed a few reduncancies.  Such as www.example.*, then 8 more entries like www.example.com, www.example.de, www.example.ntp etc.  but the vast majority of them are more in line with different numbered name servers, like ns1.example.com, ns2.example.com.  I think the list is actually meant to block the phone home but still allow the user to visit the core example.com.  That is pure speculation and yes it does seem excessive, but when I did run Little Snitch there were still a ton of rules that adding wildcards couldn't capture fully (fwiw)

                            1 Reply Last reply Reply Quote 0
                            • johnpozJ Online
                              johnpoz LAYER 8 Global Moderator
                              last edited by

                              yeah if they are using say country codes for the tld, you would need to put those all in, example.de, example.us, example.nl, etc.. or .org, .com, .net etc..

                              Sure there is debate which is better 127.x or 0.0.0.0 comes down to what is the client and what it actually does - its possible that 0.0.0.0 could be some ms faster.. So sure use that if not working on specific client or causing you problems on client then use the old 127.0.0.1 trick, etc.

                              An intelligent man is sometimes forced to be drunk to spend time with his fools
                              If you get confused: Listen to the Music Play
                              Please don't Chat/PM me for help, unless mod related
                              SG-4860 25.07 | Lab VMs 2.8, 25.07

                              1 Reply Last reply Reply Quote 0
                              • R Offline
                                RickyBaker
                                last edited by

                                @johnpoz:

                                yeah if they are using say country codes for the tld, you would need to put those all in, example.de, example.us, example.nl, etc.. or .org, .com, .net etc..

                                Sure there is debate which is better 127.x or 0.0.0.0 comes down to what is the client and what it actually does - its possible that 0.0.0.0 could be some ms faster.. So sure use that if not working on specific client or causing you problems on client then use the old 127.0.0.1 trick, etc.

                                But nothing special to add to this or the client's host files?  I suppose its easy enough to replace all on the text file so I'll give it a spin tonight, just wasn't sure if 0.0.0.0 required some special finagling.

                                1 Reply Last reply Reply Quote 0
                                • johnpozJ Online
                                  johnpoz LAYER 8 Global Moderator
                                  last edited by

                                  nope nothing to do on the clients, as long as they are using pfsense for their dns.

                                  You can use 0.0.0.0 just like you would the loopback 127.0.0.1 in entry you put in the file.  Up to you which one you like better. I have used both in the past.  Been using the 0.0.0.0 as of late but really have noticed any sort of difference in either.

                                  An intelligent man is sometimes forced to be drunk to spend time with his fools
                                  If you get confused: Listen to the Music Play
                                  Please don't Chat/PM me for help, unless mod related
                                  SG-4860 25.07 | Lab VMs 2.8, 25.07

                                  1 Reply Last reply Reply Quote 0
                                  • R Offline
                                    RickyBaker
                                    last edited by

                                    haha well it worked! Cause I couldn't access a few of the domains that I purposely blocked….but somehow I also blocked the Google Name Servers and couldn't even do a normal search :o  I guess that's the risk of creating a text file of hundreds of domains from a curated list you didn't make :). Maybe I'll start smaller.  Or maybe I'll check out this PFBlockerNG...

                                    1 Reply Last reply Reply Quote 0
                                    • johnpozJ Online
                                      johnpoz LAYER 8 Global Moderator
                                      last edited by

                                      google ns would be

                                      ;; QUESTION SECTION:
                                      ;google.com.                    IN      NS

                                      ;; ANSWER SECTION:
                                      google.com.            345600  IN      NS      ns4.google.com.
                                      google.com.            345600  IN      NS      ns2.google.com.
                                      google.com.            345600  IN      NS      ns3.google.com.
                                      google.com.            345600  IN      NS      ns1.google.com.

                                      ;; ADDITIONAL SECTION:
                                      ns4.google.com.        345600  IN      A      216.239.38.10
                                      ns2.google.com.        345600  IN      A      216.239.34.10
                                      ns3.google.com.        345600  IN      A      216.239.36.10
                                      ns1.google.com.        345600  IN      A      216.239.32.10

                                      Yeah blocking those would block access to google ;)

                                      An intelligent man is sometimes forced to be drunk to spend time with his fools
                                      If you get confused: Listen to the Music Play
                                      Please don't Chat/PM me for help, unless mod related
                                      SG-4860 25.07 | Lab VMs 2.8, 25.07

                                      1 Reply Last reply Reply Quote 0
                                      • R Offline
                                        RickyBaker
                                        last edited by

                                        I can't say I totally understand what you posted there, but I didn't input any of those domains into the text file.  There are a number of IP address "domains" but none of them start with 216.x…and I (hope I) wouldn't be dumb enough to put a domain with the word google in there:)

                                        1 Reply Last reply Reply Quote 0
                                        • R Offline
                                          RickyBaker
                                          last edited by

                                          Soooo i pared down the list extensively and when I applied the changes, google's name servers were still blocked by pfsense.  Here's the list from the unbound_domains2block txt file, with names changed to protect the innocent:

                                          local-zone: "*.licenses.example.com" redirect
                                          local-data: "*.licenses.example.com A 0.0.0.0"
                                          local-zone: "*.examplelogin.com" redirect
                                          local-data: "*.examplelogin.com A 0.0.0.0"
                                          local-zone: "ims-na1.examplelogin.com" redirect
                                          local-data: "ims-na1.examplelogin.com A 0.0.0.0"
                                          local-zone: "ims-prod06.examplelogin.com" redirect
                                          local-data: "ims-prod06.examplelogin.com A 0.0.0.0"
                                          local-zone: "ims-prod07.examplelogin.com" redirect
                                          local-data: "ims-prod07.examplelogin.com A 0.0.0.0"
                                          local-zone: "exampleid-na1.services.example.com" redirect
                                          local-data: "exampleid-na1.services.example.com A 0.0.0.0"
                                          local-zone: "na1e-acc.services.example.com" redirect
                                          local-data: "na1e-acc.services.example.com A 0.0.0.0"
                                          local-zone: "na1r.services.example.com" redirect
                                          local-data: "na1r.services.example.com A 0.0.0.0"
                                          local-zone: "ems.example.com" redirect
                                          local-data: "ems.example.com A 0.0.0.0"
                                          

                                          Any idea why any of these would block google's name servers?

                                          1 Reply Last reply Reply Quote 0
                                          • R Offline
                                            RickyBaker
                                            last edited by

                                            Realizing that I had a much more managable set of domains to enter into the default gui I decided to try these domains out one by one.  I was able to input all but the 2 at the top with the wildcard and the Google nameservers went unblocked.  The ones with the asterix gave this error:

                                            The following input errors were detected:
                                            A valid domain must be specified.
                                            

                                            Now maybe the issue with this new paired down list was the asterix, and it wasn't just Google's name servers that were being blocked but maybe EVERYTHING?  However, looking at my old 180 domain long list, there are no entries that begin with a wild card, but a few that end it one.  However, Testing this pared down version without asterixes still blocks google's name servers.

                                            Finally, I also tested with the redirect to 127.0.0.1 with the same results as 0.0.0.0

                                            So I'm still curious why using the domains in a text file like you suggested @johnpoz is blocking Google nameservers (and possibly everything?) and also curious if I can use a wildcard symbol for domains in the default UI to accomplish "*.licenses.example.com"?

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.