4. DNS Resolver Log Error sending queries to 1.1.1.1

DNS Resolver Log Error sending queries to 1.1.1.1

  • P

    Hello All,

    I pointed my DNS Resolver to the CLOUDFLARE DNS Server for queries and I am getting the following error in the logs:

    Apr 4 00:02:24 unbound 8198:3 debug: tcp error for address 1.1.1.1 port 853
    Apr 4 00:02:24 unbound 8198:3 debug: outnettcp got tcp error -1
    Apr 4 00:02:24 unbound 8198:3 debug: cache memory msg=99133 rrset=121685 infra=5722 val=78919
    Apr 4 00:02:24 unbound 8198:3 debug: sending to target: <.> 1.1.1.1#853

    It seems that all my queries are resolved by the the secondary server(1.0.0.1) and not the primary. Any ideas why this would be?

    Thank you!

    0 1 Reply
  • C

    I'm having the same issue to both the ipv4 and ipv6 resolvers on 853.

    Everything is fine over port 53.

    Log excerpt…

    
Apr  4 01:09:56 edi unbound: [51210:0] info: iterator operate: query ps-667.pubnub.com. A IN
Apr  4 01:09:56 edi unbound: [51210:0] info: processQueryTargets: ps-667.pubnub.com. A IN
Apr  4 01:09:56 edi unbound: [51210:0] info: sending query: ps-667.pubnub.com. A IN
Apr  4 01:09:56 edi unbound: [51210:0] debug: sending to target: <.> 1.0.0.1#853
Apr  4 01:09:56 edi unbound: [51210:0] debug: cache memory msg=37518 rrset=33048 infra=4193 val=33248
Apr  4 01:09:56 edi unbound: [51210:0] debug: outnettcp got tcp error -1
Apr  4 01:09:56 edi unbound: [51210:0] debug: tcp error for address 1.0.0.1 port 853
Apr  4 01:09:56 edi unbound: [51210:0] debug: iterator[module 1] operate: extstate:module_wait_reply event:module_event_noreply

    Pcap on igb0 for port 853 show traffic going out and coming back.

    Running 'openssl s_client -connect 1.1.1.1:853' also works, so I know it's not an ISP block upstream.

    0
  • R

    Seeing similar issues on my end when trying to set up tcp forwarding:

    Apr  4 04:35:48 pfsense.home unbound: [33395:0] info: iterator operate: query ps-275.pubnub.com. A IN
    Apr  4 04:35:48 pfsense.home unbound: [33395:0] info: processQueryTargets: ps-275.pubnub.com. A IN
    Apr  4 04:35:48 pfsense.home unbound: [33395:0] info: sending query: ps-275.pubnub.com. A IN
    Apr  4 04:35:48 pfsense.home unbound: [33395:0] debug: sending to target: <.> 1.1.1.1#853
    Apr  4 04:35:48 pfsense.home unbound: [33395:0] debug: cache memory msg=52480 rrset=33048 infra=4193 val=33248
    Apr  4 04:35:49 pfsense.home unbound: [33395:0] debug: outnettcp got tcp error -1
    Apr  4 04:35:49 pfsense.home unbound: [33395:0] debug: tcp error for address 1.1.1.1 port 853
    Apr  4 04:35:49 pfsense.home unbound: [33395:0] debug: iterator[module 1] operate: extstate:module_wait_reply event:module_event_noreply

    I do see active states for port 853 on 1.1.1.1, so not sure why it isn't able to communicate. Not seeing anything like firewall blocking connections or anything like that… Note that I did not include the 1.0.0.1 server in my config while trying to debug this. I see the same results if I try Quad9's servers, too (9.9.9.9).

    edit: looks like switching to quad9 9.9.9.9 does work as expected. Must be something up with 1.1.1.1.

    0
  • Galactic Empire

    We're seeing it as well. While we're investigating this issue, it seems to work with quad9 so I suggest you try it.

    0
  • P

    UPDATE: This morning I was not able to resolve any DNS Queries until I removed the CLOUDFLARE Config. My pfsense router cannot connect to either CLOUDFLARE Name Server over TLS.

    0
  • C

    @ivor:

    We're seeing it as well. While we're investigating this issue, it seems to work with quad9 so I suggest you try it.

    Yep, I switched to Quad9, and so far no issues working with them over 853.

    If it makes any difference, I'm using a SG-2220 appliance.

    EDIT:

    It occurs to me the above is probably not that helpful overall, so…

    
System	
Netgate SG-2220

BIOS
Vendor: coreboot
Version: ADI_DFF2-01.00.00.17-nodebug
Release Date: Mon Sep 18 2017 

Version
2.4.3-RELEASE (amd64) 
built on Wed Mar 28 16:32:48 CDT 2018 
FreeBSD 11.1-RELEASE-p7 

CPU Type
Intel(R) Atom(TM) CPU C2338 @ 1.74GHz
2 CPUs: 1 package(s) x 2 core(s)
AES-NI CPU Crypto: Yes (active)

Hardware crypto
AES-CBC,AES-XTS,AES-GCM,AES-ICM

Kernel PTI
Enabled
    0
  • P

    Thank you! I will try the QUAD9 Server.

    0
  • Galactic Empire

    We have updated the blog post with Quad9 settings https://www.netgate.com/blog/dns-over-tls-with-pfsense.html

    0
  • C

    The Quad9 IPV4 and IPV6 resolvers are all working for me over TLS/853 with the same settings I was trying to use for CloudFlare.

    ¯_(ツ)_/¯

    0
  • B

    I'm also getting the following error once i switch to using cloudflare

    There were error(s) loading the rules: /tmp/rules.debug:19: cannot define table bogonsv6: Cannot allocate memory - The line in question reads [19]: table <bogonsv6> persist file "/etc/bogonsv6"
    @ 2018-04-04 19:21:23

    This is using 2.4.3 w/8gb of mem.

    I'm pretty sure I saw this was being looked at in 2.4.4

    0
  • P

    Do we have to wait for an update for this to be fixed? Was anybody successful in getting the Cloudflare config to work?

    Thanks!

    0
  • G

    @promo:

    Do we have to wait for an update for this to be fixed? Was anybody successful in getting the Cloudflare config to work?

    Thanks!

    It worked until this morning so I left the config in place and added entries for Quad9 as well. If they both provide the DNS TLS might as well have both in the list.

    0
  • P

    @gsmornot:

    @promo:

    Do we have to wait for an update for this to be fixed? Was anybody successful in getting the Cloudflare config to work?

    Thanks!

    It worked until this morning so I left the config in place and added entries for Quad9 as well. If they both provide the DNS TLS might as well have both in the list.

    The point is to be able to use Cloudflare as the primary DNS since their service is faster.

    0
  • G

    @promo:

    @gsmornot:

    @promo:

    Do we have to wait for an update for this to be fixed? Was anybody successful in getting the Cloudflare config to work?

    Thanks!

    It worked until this morning so I left the config in place and added entries for Quad9 as well. If they both provide the DNS TLS might as well have both in the list.

    The point is to be able to use Cloudflare as the primary DNS since their service is faster.

    Agree but it does not work for me. If I only have Cloudflare in my config I cannot resolve.

    Apr 5 09:08:16 unbound 70814:1 error: SSL_read syscall: Connection reset by peer

    Quad9 works though.

    0

  • The Cloudflare settings still are not working and Cloudflare is reporting that they are not experiencing any service problems. Perhaps they have made some change that either inadvertently or deliberately blocks this? Regardless, it seems that it isn’t likely to work “as is”.

    Hope I’m wrong.😕

    0
  • P

    @wgstarks:

    The Cloudflare settings still are not working and Cloudflare is reporting that they are not experiencing any service problems. Perhaps they have made some change that either inadvertently or deliberately blocks this? Regardless, it seems that it isn’t likely to work “as is”.

    Hope I’m wrong.😕

    I was reading a post on one of the forums and some there seems to think this is a pfsense issue with the Cloudflare certificate.

    0
  • G

    @promo:

    @wgstarks:

    The Cloudflare settings still are not working and Cloudflare is reporting that they are not experiencing any service problems. Perhaps they have made some change that either inadvertently or deliberately blocks this? Regardless, it seems that it isn’t likely to work “as is”.

    Hope I’m wrong.😕

    I was reading a post on one of the forums and some there seems to think this is a pfsense issue with the Cloudflare certificate.

    Stange thing is, it worked for two days before it stopped at @ Midnight local two nights ago.

    0

  • https://tech.slashdot.org/story/18/04/05/0420247/1111-cloudflares-new-dns-attracting-gigabits-per-second-of-rubbish

    If they can't handle the bogus traffic, maybe they should move to a host that specializes in DDoS protections…  ;D ;D

    0
  • LAYER 8 Global Moderator

    ^ exactly… Why anyone would even want to point their dns to this is beyond me....

    0
  • P

    @johnpoz:

    ^ exactly… Why anyone would even want to point their dns to this is beyond me....

    Do you use QUAD9?

    0
  • LAYER 8 Global Moderator

    No I resolve with dnssec.. Not going to forward my queries to any specific dns thank you very much.  I will just run my own resolver as it should be..

    0
  • R

    I use Quad9 and I find value in their service. I have had 2 issues with them and contacting Quad9 has been to my surprise very easy; they are very professional and responsive. They have addressed the issues rather quickly and have been kind enough to follow up with me.

    0
  • R

    Quad9 seems to provide a nice value-add by attaching block lists to their results. Likely a setup that you could easily recreate with pfSense, although something to be said for the ease of pointing to them & getting it for free. Also I'd assume they have access to more exhaustive lists than what we could maintain privately.

    I'm actually in touch with their support right now and agree that they're pretty responsive. There's one or two hops between me and their service that drop lots of packets… Results in occasional long delays for a DNS lookup (at least, that's my theory as to why I see this). I sent them a couple example reports from mtr; maybe they'll have better luck contacting whomever is responsible for those systems than I would.

    0
  • Galactic Empire

    @promo:

    I was reading a post on one of the forums and some there seems to think this is a pfsense issue with the Cloudflare certificate.

    I'm not sure what you read, but Cloudflare person said clearly:

    Thanks for the report! This is going to be fixed in the next upgrade that's being rolled out.
    There was an interop issue in the last upgrade with Unbound as it sends the frame size and the actual DNS message in two separate packets instead of both at once.

    From: https://community.cloudflare.com/t/1-1-1-1-was-working-but-not-anymore/15136/4

    0
  • LAYER 8 Global Moderator

    Yeah shepherds are normally very attentive to their sheep, as they gather their flock ;) heheheeh

    0
  • P

    @ivor:

    @promo:

    I was reading a post on one of the forums and some there seems to think this is a pfsense issue with the Cloudflare certificate.

    I'm not sure what you read, but Cloudflare person said clearly:

    Thanks for the report! This is going to be fixed in the next upgrade that's being rolled out.
    There was an interop issue in the last upgrade with Unbound as it sends the frame size and the actual DNS message in two separate packets instead of both at once.

    From: https://community.cloudflare.com/t/1-1-1-1-was-working-but-not-anymore/15136/4

    I stand corrected! My apologies!

    0
  • P

    @johnpoz:

    No I resolve with dnssec.. Not going to forward my queries to any specific dns thank you very much.  I will just run my own resolver as it should be..

    So when your resolver does not know a host's IP because it is not cached, where does it forward the query? No need to get upset, I am just asking a question!

    0
  • C

    @ivor:

    We have updated the blog post with Quad9 settings https://www.netgate.com/blog/dns-over-tls-with-pfsense.html

    Hi,

    First of all, thanks for the Tips&Tricks guide :)

    DNS over TLS doesn't work for me. I run into this issue and lost Internet to.

    Apr 5 18:29:19    unbound    7412:0    info: start of service (unbound 1.6..
Apr 5 18:29:19    unbound    7412:0    error: duplicate forward zone . ignored.
Apr 5 18:29:19    unbound    7412:3    error: duplicate forward zone . ignored.
Apr 5 18:29:19    unbound    7412:2    error: duplicate forward zone . ignored.
Apr 5 18:29:19    unbound    7412:1    error: duplicate forward zone . ignored.
Apr 5 18:29:19    unbound    7412:0    notice: init module 1: iterator
Apr 5 18:29:19    unbound    7412:0    notice: init module 0: validator
Apr 5 18:29:19    unbound    7412:0    notice: Restart of unbound 1.6.8.
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 3: requestlist max 0 avg 0 exceeded 0 jostled 0
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 3: 0 queries, 0 answers from cache, 0 recursions, 0 prefetch, 0 rejected by ip ratelimiting
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 2: requestlist max 0 avg 0 exceeded 0 jostled 0
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 2: 0 queries, 0 answers from cache, 0 recursions, 0 prefetch, 0 rejected by ip ratelimiting
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 1: requestlist max 0 avg 0 exceeded 0 jostled 0
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 1: 0 queries, 0 answers from cache, 0 recursions, 0 prefetch, 0 rejected by ip ratelimiting
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 0: requestlist max 0 avg 0 exceeded 0 jostled 0
Apr 5 18:29:19    unbound    7412:0    info: server stats for thread 0: 0 queries, 0 answers from cache, 0 recursions, 0 prefetch, 0 rejected by ip ratelimiting
Apr 5 18:29:19    unbound    7412:0    info: service stopped (unbound 1.6..
Apr 5 18:29:19    unbound    7412:0    info: start of service (unbound 1.6..
    0

  • So when your resolver does not know a host's IP because it is not cached, where does it forward the query?

    The root servers, of course.

    https://en.wikipedia.org/wiki/Root_name_server

    0
  • R

    So when your resolver does not know a host's IP because it is not cached, where does it forward the query? No need to get upset, I am just asking a question!

    promo, just ignore the passive-aggressive tone. Don't worry about it :)

    “Your greatness is measured by your kindness; your education and intellect by your modesty; your ignorance is betrayed by your suspicions and prejudices, and your real caliber is measured by the consideration and tolerance you have for others.” ~William J.H. Boetcker

    Unbound is a DNS resolver, which means that it doesn't necessarily need to forward queries to another DNS resolver/forwarder such as Quad9, Google, Cloudflare, OpenDNS, etc. Instead it can query "root hints" servers by itself without any of the previously mentioned providers in between. There is a trade in that process, root hints can be really slow responding to queries. With that in mind, different providers (such as the ones above mentioned and others) put DNS servers closer to you to speed things up. Since their resources is so vast and their services is generally used by millions of users, chances are that your query will most likely hit their cache instead of having to go back to "root hints" to pull a record; which dramatically increases DNS resolution speed, translated into faster browsing experience and so on.

    Implementing DNSSEC and querying "root hints" reduces the chances of getting poisoned or bogus responses. Yet it does not make your DNS immune to eavesdropping. Anyone (specially your ISP) "listening" on the network for DNS queries can see which sites you're visiting by looking at your DNS queries (DNS isn't encrypted by default), for example.

    Using services such as Cloudflare, Quad9 and others, may in fact help you escape the eavesdropping by implementing DNS over TLS or HTTPS on top of speeding up your DNS resolution. Yet your DNS queries are at the mercy of the upstream provider. The trade in this case is basically a matter of "trust" in the provider you choose to forward your queries to.

    That's the watered down version  :)

    0
  • P

    @rafaelr:

    So when your resolver does not know a host's IP because it is not cached, where does it forward the query? No need to get upset, I am just asking a question!

    promo, just ignore the passive-aggressive tone. Don't worry about it :)

    “Your greatness is measured by your kindness; your education and intellect by your modesty; your ignorance is betrayed by your suspicions and prejudices, and your real caliber is measured by the consideration and tolerance you have for others.” ~William J.H. Boetcker

    Unbound is a DNS resolver, which means that it doesn't necessarily need to forward queries to another DNS resolver/forwarder such as Quad9, Google, Cloudflare, OpenDNS, etc. Instead it can query "root hints" servers by itself without any of the previously mentioned providers in between. There is a trade in that process, root hints can be really slow responding to queries. With that in mind, different providers (such as the ones above mentioned and others) put DNS servers closer to you to speed things up. Since their resources is so vast and their services is generally used by millions of users, chances are that your query will most likely hit their cache instead of having to go back to "root hints" to pull a record; which dramatically increases DNS resolution speed, translated into faster browsing experience and so on.

    Implementing DNSSEC and querying "root hints" reduces the chances of getting poisoned or bogus responses. Yet it does not make your DNS immune to eavesdropping. Anyone (specially your ISP) "listening" on the network for DNS queries can see which sites you're visiting by looking at your DNS queries (DNS isn't encrypted by default), for example.

    Using services such as Cloudflare, Quad9 and others, may in fact help you escape the eavesdropping by implementing DNS over TLS or HTTPS on top of speeding up your DNS resolution. Yet your DNS queries are at the mercy of the upstream provider. The trade in this case is basically a matter of "trust" in the provider you choose to forward your queries to.

    That's the watered down version  :)

    Exactly what I was leading up to! ;)

    0
  • M

    Just want to say that I niether could get Cloudflare to work when DNS over tls, but Quad9 works.

    Haven't looked into logs yet, just that I seemed able to ping sites from within Pfsense, but not from my desktop and other.

    0
  • C

    @mirkwoody:

    Just want to say that I niether could get Cloudflare to work when DNS over tls, but Quad9 works.

    Haven't looked into logs yet, just that I seemed able to ping sites from within Pfsense, but not from my desktop and other.

    Same here.

    0
  • C

    @ivor:

    @promo:

    I was reading a post on one of the forums and some there seems to think this is a pfsense issue with the Cloudflare certificate.

    I'm not sure what you read, but Cloudflare person said clearly:

    Thanks for the report! This is going to be fixed in the next upgrade that's being rolled out.
    There was an interop issue in the last upgrade with Unbound as it sends the frame size and the actual DNS message in two separate packets instead of both at once.

    From: https://community.cloudflare.com/t/1-1-1-1-was-working-but-not-anymore/15136/4

    Just to circle back, the above CloudFlare community post indicates a fix was pushed on the CF side to resolve the problem sometime on the 5th.

    Indeed, as of today, I switched back to the CloudFlare resolvers on 853, and appear to be up and running now.

    0
  • G

    Since both provide a good service I left both in the config. Until I run into an issue it provides me with a backup. If you didn't know, the first line after server: is due to pfBlockerng.

    server:
    include: /var/unbound/pfb_dnsbl.*conf
    forward-zone:
    name: "."
    forward-ssl-upstream: yes
    forward-addr: 1.1.1.1@853
    forward-addr: 1.0.0.1@853
    forward-addr: 9.9.9.9@853
    forward-addr: 149.112.112.112@853
    forward-addr: 2606:4700:4700::1111@853
    forward-addr: 2606:4700:4700::1001@853
    forward-addr: 2620:fe::fe

    0

  • @promo

    Wonder this issue was ever resolved for 1.1.1.1

    Thx

    0
    B
     1 Reply
  • B

    I'm trying to use DNS over TLS using Cloudflare's servers. DNS appears to work -- but Cloudflare's page indicates it isn't. 0_1550567261763_Screen Shot 2019-02-18 at 8.58.02 PM.png

    Thoughts?

    0 1 Reply

  • @bldnightowl

    What's URL to this test page ?

    0
  • B

    "page" is a link in my post above.

    0 2 Replies

  • @bldnightowl

    It was blocked by pfbNG for some reason

    I see that page work for me https://snag.gy/oNvPsI.jpg

    0
    B
     1 Reply
Log in to reply
 

Products

Applications

Support

Services

News

Resources

Company

Our Mission

As host of the pfSense open source firewall project, Netgate believes in enhancing network connectivity that maintains both security and privacy. We also believe everyone should be able to afford it.

Subscribe to our Newsletter

Product information, software announcements, and special offers. See our newsletter archive for past announcements.

© Copyright 2002 - 2019 Rubicon Communications, LLC | Privacy Policy