Filterdns stops working
-
hi,
i have a 2.4.2 pfsense with suricata and pfblockerng (i updated recently to the 2.4.2 release, before it was 2.3.4).
the problem is, that filterdns stops updating the aliases.
i have aliases like:
google: 64.233.160.0/19, 66.102.0.0/20, 66.249.64.0/19, 72.14.192.0/18, 74.125.0.0/16, 209.85.128.0/17, 216.239.32.0/19, 173.194.0.0/16, 172.217.0.0/16, 216.58.192.0/19
timeserver: 130.149.17.21, 192.53.103.103, 192.53.103.104, 192.53.103.108
heise: heise.de
allowlist: google, timeserver, heisethen i have a firewall-rule that will allow traffic to everything in alias allowlist.
that works like intended, but after some time the filterdns stops updating the aliases. if heise.de changes its ip, the entry in the table stays on the old ip.
if i enter a new ip-alias with an url and make a rule with it, it wont resolve the url. the according table of the alias stays empty.the dns resolver log only shows:
Dec 12 12:45:04 gw-wg filterdns: clearing entry 10.1.4.55 from pf table C84975_61 on host c84975-61.prokas2.birken.pk2 Dec 12 12:45:04 gw-wg filterdns: clearing entry 2606:2800:234:660:118e:28f:1d8a:2522 from pf table Deny on host fast.fonts.net Dec 12 12:45:04 gw-wg filterdns: clearing entry 68.232.35.182 from pf table Deny on host fast.fonts.net Dec 12 12:45:04 gw-wg filterdns: clearing entry 104.96.38.230 from pf table Deny on host static.etracker.com Dec 12 12:45:04 gw-wg filterdns: clearing entry 62.201.164.117 from pf table Deny on host www.etracker.de Dec 12 12:52:51 gw-wg unbound: [49198:0] info: service stopped (unbound 1.6.6). Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 0: 89 queries, 15 answers from cache, 74 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 0: requestlist max 8 avg 1.48649 exceeded 0 jostled 0 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: average recursion processing time 0.028766 sec Dec 12 12:52:51 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:52:51 gw-wg unbound: [49198:0] info: [25%]=0.00840758 median[50%]=0.016384 [75%]=0.0469675 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000000 0.000001 12 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000256 0.000512 4 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000512 0.001024 2 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.008192 0.016384 19 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.016384 0.032768 12 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.032768 0.065536 15 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.065536 0.131072 9 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.131072 0.262144 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 1: 17 queries, 0 answers from cache, 17 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 1: requestlist max 2 avg 0.176471 exceeded 0 jostled 0 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: average recursion processing time 0.038271 sec Dec 12 12:52:51 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:52:51 gw-wg unbound: [49198:0] info: [25%]=0.0200704 median[50%]=0.0270336 [75%]=0.045056 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000000 0.000001 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.008192 0.016384 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.016384 0.032768 10 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.032768 0.065536 2 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.065536 0.131072 3 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 2: 101 queries, 18 answers from cache, 83 recursions, 1 prefetch, 0 rejected by ip ratelimiting Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 2: requestlist max 5 avg 0.369048 exceeded 0 jostled 0 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: average recursion processing time 0.039225 sec Dec 12 12:52:51 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:52:51 gw-wg unbound: [49198:0] info: [25%]=0.0122027 median[50%]=0.0230156 [75%]=0.049664 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000000 0.000001 8 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000256 0.000512 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.008192 0.016384 24 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.016384 0.032768 21 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.032768 0.065536 16 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.065536 0.131072 8 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.131072 0.262144 4 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.262144 0.524288 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 3: 41 queries, 2 answers from cache, 39 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:52:51 gw-wg unbound: [49198:0] info: server stats for thread 3: requestlist max 1 avg 0.25641 exceeded 0 jostled 0 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: average recursion processing time 3.871467 sec Dec 12 12:52:51 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:52:51 gw-wg unbound: [49198:0] info: [25%]=0.0121417 median[50%]=0.02048 [75%]=0.04096 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000000 0.000001 2 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.000256 0.000512 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.008192 0.016384 14 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.016384 0.032768 10 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.032768 0.065536 9 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 0.065536 0.131072 2 Dec 12 12:52:51 gw-wg unbound: [49198:0] info: 128.000000 256.000000 1 Dec 12 12:52:51 gw-wg unbound: [49198:0] notice: Restart of unbound 1.6.6. Dec 12 12:52:51 gw-wg unbound: [49198:0] notice: init module 0: validator Dec 12 12:52:51 gw-wg unbound: [49198:0] notice: init module 1: iterator Dec 12 12:52:51 gw-wg unbound: [49198:0] info: start of service (unbound 1.6.6). Dec 12 12:54:17 gw-wg unbound: [49198:0] info: service stopped (unbound 1.6.6). Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 0: 11 queries, 0 answers from cache, 11 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 0: requestlist max 2 avg 0.272727 exceeded 0 jostled 0 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: average recursion processing time 0.039542 sec Dec 12 12:54:17 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:54:17 gw-wg unbound: [49198:0] info: [25%]=0.022528 median[50%]=0.04096 [75%]=0.0559787 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.000000 0.000001 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.008192 0.016384 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.016384 0.032768 2 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.032768 0.065536 6 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.065536 0.131072 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 1: 3 queries, 0 answers from cache, 3 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 1: requestlist max 0 avg 0 exceeded 0 jostled 0 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: average recursion processing time 0.112245 sec Dec 12 12:54:17 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:54:17 gw-wg unbound: [49198:0] info: [25%]=0 median[50%]=0 [75%]=0 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.065536 0.131072 2 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.131072 0.262144 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 2: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 2: requestlist max 0 avg 0 exceeded 0 jostled 0 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: average recursion processing time 0.101974 sec Dec 12 12:54:17 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:54:17 gw-wg unbound: [49198:0] info: [25%]=0 median[50%]=0 [75%]=0 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.065536 0.131072 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 3: 6 queries, 1 answers from cache, 5 recursions, 0 prefetch, 0 rejected by ip ratelimiting Dec 12 12:54:17 gw-wg unbound: [49198:0] info: server stats for thread 3: requestlist max 0 avg 0 exceeded 0 jostled 0 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: average recursion processing time 0.049375 sec Dec 12 12:54:17 gw-wg unbound: [49198:0] info: histogram of recursion processing times Dec 12 12:54:17 gw-wg unbound: [49198:0] info: [25%]=0.02048 median[50%]=0.049152 [75%]=0.090112 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: lower(secs) upper(secs) recursions Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.008192 0.016384 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.016384 0.032768 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.032768 0.065536 1 Dec 12 12:54:17 gw-wg unbound: [49198:0] info: 0.065536 0.131072 2 Dec 12 12:54:17 gw-wg unbound: [49198:0] notice: Restart of unbound 1.6.6.the first lines show the last working filterdns entries. after that it only repeats the last part.
system.log doesnt show anything at that time.if i (re)start the filterdns manually with /usr/local/sbin/filterdns -p /var/run/filterdns.pid -i 300 -c /var/etc/filterdns.conf -d 1 then everything works again for some time.
the Firewall Maximum Table Entries is set to 6000000.
i also tried to change the dns-servers with 127.0.0.1 as first server, but that also didn't help.any clues what i could check/change to resolve this problem?
-
You are talking about Firewall => Aliases, right ?
You saw this :
An IP range such as 192.168.1.1-192.168.1.10 or a small subnet such as 192.168.1.16/28 may also be entered and a list of individual IP addresses will be generated.
I addded a simple 66.102.0.0**/20** which boils down to a whopping :
66.102.0.0 66.102.0.1 66.102.0.2 66.102.0.3 66.102.0.4 66.102.0.5 66.102.0.6 66.102.0.7 66.102.0.8 66.102.0.9 66.102.0.10 66.102.0.11 66.102.0.12 66.102.0.13 66.102.0.14 66.102.0.15 66.102.0.16 66.102.0.17 66.102.0.18 66.102.0.19 66.102.0.20 66.102.0.21 66.102.0.22 66.102.0.23 66.102.0.24 66.102.0.25 66.102.0.26 66.102.0.27 66.102.0.28 66.102.0.29 66.102.0.30 66.102.0.31 66.102.0.32 66.102.0.33 66.102.0.34 66.102.0.35 66.102.0.36 66.102.0.37 66.102.0.38 66.102.0.39 66.102.0.40 66.102.0.41 66.102.0.42 66.102.0.43 66.102.0.44 66.102.0.45 66.102.0.46 66.102.0.47 66.102.0.48 66.102.0.49 66.102.0.50 66.102.0.51 66.102.0.52 66.102.0.53 66.102.0.54 66.102.0.55 66.102.0.56 66.102.0.57 66.102.0.58 66.102.0.59 66.102.0.60 66.102.0.61 66.102.0.62 66.102.0.63 66.102.0.64 66.102.0.65 66.102.0.66 66.102.0.67 66.102.0.68 66.102.0.69 66.102.0.70 66.102.0.71 66.102.0.72 66.102.0.73 66.102.0.74 66.102.0.75 66.102.0.76 66.102.0.77 66.102.0.78 66.102.0.79 66.102.0.80 66.102.0.81 66.102.0.82 66.102.0.83 66.102.0.84 66.102.0.85 66.102.0.86 66.102.0.87 66.102.0.88 66.102.0.89 66.102.0.90 66.102.0.91 66.102.0.92 66.102.0.93 66.102.0.94 66.102.0.95 66.102.0.96 66.102.0.97 66.102.0.98 66.102.0.99 66.102.0.100 66.102.0.101 66.102.0.102 66.102.0.103 66.102.0.104 66.102.0.105 66.102.0.106 66.102.0.107 66.102.0.108 66.102.0.109 66.102.0.110 66.102.0.111 66.102.0.112 66.102.0.113 66.102.0.114 66.102.0.115 66.102.0.116 66.102.0.117 66.102.0.118 66.102.0.119 66.102.0.120 66.102.0.121 66.102.0.122 66.102.0.123 66.102.0.124 66.102.0.125 66.102.0.126 66.102.0.127 66.102.0.128 66.102.0.129 66.102.0.130 66.102.0.131 66.102.0.132 66.102.0.133 66.102.0.134 66.102.0.135 66.102.0.136 66.102.0.137 66.102.0.138 66.102.0.139 66.102.0.140 66.102.0.141 66.102.0.142 66.102.0.143 66.102.0.144 66.102.0.145 66.102.0.146 66.102.0.147 66.102.0.148 66.102.0.149 66.102.0.150 66.102.0.151 66.102.0.152 66.102.0.153 66.102.0.154 66.102.0.155 66.102.0.156 66.102.0.157 66.102.0.158 66.102.0.159 66.102.0.160 66.102.0.161 66.102.0.162 66.102.0.163 66.102.0.164 66.102.0.165 66.102.0.166 66.102.0.167 66.102.0.168 66.102.0.169 66.102.0.170 66.102.0.171 66.102.0.172 66.102.0.173 66.102.0.174 66.102.0.175 66.102.0.176 66.102.0.177 66.102.0.178 66.102.0.179 66.102.0.180 66.102.0.181 66.102.0.182 66.102.0.183 66.102.0.184 66.102.0.185 66.102.0.186 66.102.0.187 66.102.0.188 66.102.0.189 66.102.0.190 66.102.0.191 66.102.0.192 66.102.0.193 66.102.0.194 66.102.0.195 66.102.0.196 66.102.0.197 66.102.0.198 66.102.0.199 66.102.0.200 66.102.0.201 66.102.0.202 66.102.0.203 66.102.0.204 66.102.0.205 66.102.0.206 66.102.0.207 66.102.0.208 66.102.0.209 66.102.0.210 66.102.0.211 66.102.0.212 66.102.0.213 66.102.0.214 66.102.0.215 66.102.0.216 66.102.0.217 66.102.0.218 66.102.0.219 66.102.0.220 66.102.0.221 66.102.0.222 66.102.0.223 66.102.0.224 66.102.0.225 66.102.0.226 66.102.0.227 66.102.0.228 66.102.0.229 66.102.0.230 66.102.0.231 66.102.0.232 66.102.0.233 66.102.0.234 66.102.0.235 66.102.0.236 66.102.0.237 66.102.0.238 66.102.0.239 66.102.0.240 66.102.0.241 66.102.0.242 66.102.0.243 66.102.0.244 66.102.0.245 66.102.0.246 66.102.0.247 66.102.0.248 66.102.0.249 66.102.0.250 66.102.0.251 66.102.0.252 66.102.0.253 66.102.0.254 66.102.0.255 66.102.1.0 66.102.1.1 66.102.1.2 66.102.1.3 66.102.1.4 66.102.1.5 66.102.1.6 66.102.1.7 66.102.1.8 66.102.1.9 66.102.1.10 66.102.1.11 66.102.1.12 66.102.1.13 66.102.1.14 66.102.1.15 66.102.1.16 66.102.1.17 66.102.1.18 66.102.1.19 66.102.1.20 66.102.1.21 66.102.1.22 66.102.1.23 66.102.1.24 66.102.1.25 66.102.1.26 66.102.1.27 66.102.1.28 66.102.1.29 66.102.1.30 66.102.1.31 66.102.1.32 66.102.1.33 66.102.1.34 66.102.1.35 66.102.1.36 66.102.1.37 66.102.1.38 66.102.1.39 66.102.1.40 66.102.1.41 66.102.1.42 66.102.1.43 66.102.1.44 66.102.1.45 66.102.1.46 66.102.1.47 66.102.1.48 66.102.1.49 66.102.1.50 66.102.1.51 66.102.1.52 66.102.1.53 66.102.1.54 66.102.1.55 66.102.1.56 66.102.1.57 66.102.1.58 66.102.1.59 66.102.1.60 66.102.1.61 66.102.1.62 66.102.1.63 66.102.1.64 66.102.1.65 66.102.1.66 66.102.1.67 66.102.1.68 66.102.1.69 66.102.1.70 66.102.1.71 66.102.1.72 66.102.1.73 66.102.1.74 66.102.1.75 66.102.1.76 66.102.1.77 66.102.1.78 66.102.1.79 66.102.1.80 66.102.1.81 66.102.1.82 66.102.1.83 66.102.1.84 66.102.1.85 66.102.1.86 66.102.1.87 66.102.1.88 66.102.1.89 66.102.1.90 66.102.1.91 66.102.1.92 66.102.1.93 66.102.1.94 66.102.1.95 66.102.1.96 66.102.1.97 66.102.1.98 66.102.1.99 66.102.1.100 66.102.1.101 66.102.1.102 66.102.1.103 66.102.1.104 66.102.1.105 66.102.1.106 66.102.1.107 66.102.1.108 66.102.1.109 66.102.1.110 66.102.1.111 66.102.1.112 66.102.1.113 66.102.1.114 66.102.1.115 66.102.1.116 66.102.1.117 66.102.1.118 66.102.1.119 66.102.1.120 66.102.1.121 66.102.1.122 66.102.1.123 66.102.1.124 66.102.1.125 66.102.1.126 66.102.1.127 66.102.1.128 66.102.1.129 66.102.1.130 66.102.1.131 66.102.1.132 66.102.1.133 66.102.1.134 66.102.1.135 66.102.1.136 66.102.1.137 66.102.1.138 66.102.1.139 66.102.1.140 66.102.1.141 66.102.1.142 66.102.1.143 66.102.1.144 66.102.1.145 66.102.1.146 66.102.1.147 66.102.1.148 66.102.1.149 66.102.1.150 66.102.1.151 66.102.1.152 66.102.1.153 66.102.1.154 66.102.1.155 66.102.1.156 66.102.1.157 66.102.1.158 66.102.1.159 66.102.1.160 66.102.1.161 66.102.1.162 66.102.1.163 66.102.1.164 66.102.1.165 66.102.1.166 66.102.1.167 66.102.1.168 66.102.1.169 66.102.1.170 66.102.1.171 66.102.1.172 66.102.1.173 66.102.1.174 66.102.1.175 66.102.1.176 66.102.1.177 66.102.1.178 66.102.1.179 66.102.1.180 66.102.1.181 66.102.1.182 66.102.1.183 66.102.1.184 66.102.1.185 66.102.1.186 66.102.1.187 66.102.1.188 66.102.1.189 66.102.1.190 66.102.1.191 66.102.1.192 66.102.1.193 66.102.1.194 66.102.1.195 66.102.1.196 66.102.1.197 66.102.1.198 66.102.1.199 66.102.1.200 66.102.1.201 66.102.1.202 66.102.1.203 66.102.1.204 66.102.1.205 66.102.1.206 66.102.1.207 66.102.1.208 66.102.1.209 66.102.1.210 66.102.1.211 66.102.1.212 66.102.1.213 66.102.1.214 66.102.1.215 66.102.1.216 66.102.1.217 66.102.1.218 66.102.1.219 66.102.1.220 66.102.1.221 66.102.1.222 66.102.1.223 66.102.1.224 66.102.1.225 66.102.1.226 66.102.1.227 66.102.1.228 66.102.1.229 66.102.1.230 66.102.1.231 66.102.1.232 66.102.1.233 66.102.1.234 66.102.1.235 66.102.1.236 66.102.1.237 66.102.1.238 66.102.1.239 66.102.1.240 66.102.1.241 66.102.1.242 66.102.1.243 66.102.1.244 66.102.1.245 66.102.1.246 66.102.1.247 66.102.1.248 66.102.1.249 66.102.1.250 66.102.1.251 66.102.1.252 66.102.1.253 66.102.1.254 66.102.1.255 66.102.2.0 66.102.2.1 66.102.2.2 66.102.2.3 66.102.2.4 66.102.2.5 66.102.2.6 66.102.2.7 66.102.2.8 66.102.2.9 66.102.2.10 66.102.2.11 66.102.2.12 66.102.2.13 66.102.2.14 66.102.2.15 66.102.2.16 66.102.2.17 66.102.2.18 66.102.2.19 66.102.2.20 66.102.2.21 66.102.2.22 66.102.2.23 66.102.2.24 66.102.2.25 66.102.2.26 66.102.2.27 66.102.2.28 66.102.2.29 66.102.2.30 66.102.2.31 66.102.2.32 66.102.2.33 66.102.2.34 66.102.2.35 66.102.2.36 66.102.2.37 66.102.2.38 66.102.2.39 66.102.2.40 66.102.2.41 66.102.2.42 66.102.2.43 66.102.2.44 66.102.2.45 66.102.2.46 66.102.2.47 66.102.2.48 66.102.2.49 66.102.2.50 66.102.2.51 66.102.2.52 66.102.2.53 66.102.2.54 66.102.2.55 66.102.2.56 66.102.2.57 66.102.2.58 66.102.2.59 66.102.2.60 66.102.2.61 66.102.2.62 66.102.2.63 66.102.2.64 66.102.2.65 66.102.2.66 66.102.2.67 66.102.2.68 66.102.2.69 66.102.2.70 66.102.2.71 66.102.2.72 66.102.2.73 66.102.2.74 66.102.2.75 66.102.2.76 66.102.2.77 66.102.2.78 66.102.2.79 66.102.2.80 66.102.2.81 66.102.2.82 66.102.2.83 66.102.2.84 66.102.2.85 66.102.2.86 66.102.2.87 66.102.2.88 66.102.2.89 66.102.2.90 66.102.2.91 66.102.2.92 66.102.2.93 66.102.2.94 66.102.2.95 66.102.2.96 66.102.2.97 66.102.2.98 66.102.2.99 66.102.2.100 66.102.2.101 66.102.2.102 66.102.2.103 66.102.2.104 66.102.2.105 66.102.2.106 66.102.2.107 66.102.2.108 66.102.2.109 66.102.2.110 66.102.2.111 66.102.2.112 66.102.2.113 66.102.2.114 66.102.2.115 66.102.2.116 66.102.2.117 66.102.2.118 66.102.2.119 66.102.2.120 66.102.2.121 66.102.2.122 66.102.2.123 66.102.2.124 66.102.2.125 66.102.2.126 66.102.2.127 66.102.2.128 66.102.2.129 66.102.2.130 66.102.2.131 66.102.2.132 66.102.2.133 66.102.2.134 66.102.2.135 66.102.2.136 66.102.2.137 66.102.2.138 66.102.2.139 66.102.2.140 66.102.2.141 66.102.2.142 66.102.2.143 66.102.2.144 66.102.2.145 66.102.2.146 66.102.2.147 66.102.2.148 66.102.2.149 66.102.2.150 66.102.2.151 66.102.2.152 66.102.2.153 66.102.2.154 66.102.2.155 66.102.2.156 66.102.2.157 66.102.2.158 66.102.2.159 66.102.2.160 66.102.2.161 66.102.2.162 66.102.2.163 66.102.2.164 66.102.2.165 66.102.2.166 66.102.2.167 66.102.2.168 66.102.2.169 66.102.2.170 66.102.2.171 66.102.2.172 66.102.2.173 66.102.2.174 66.102.2.175 66.102.2.176 66.102.2.177 66.102.2.178 66.102.2.179 66.102.2.180 66.102.2.181 66.102.2.182 66.102.2.183 66.102.2.184 66.102.2.185 66.102.2.186 66.102.2.187 66.102.2.188 66.102.2.189 66.102.2.190 66.102.2.191 66.102.2.192 66.102.2.193 66.102.2.194 66.102.2.195 66.102.2.196 66.102.2.197 66.102.2.198 66.102.2.199 66.102.2.200 66.102.2.201 66.102.2.202 66.102.2.203 66.102.2.204 66.102.2.205 66.102.2.206 66.102.2.207 66.102.2.208 66.102.2.209 66.102.2.210 66.102.2.211 66.102.2.212 66.102.2.213 66.102.2.214 66.102.2.215 66.102.2.216 66.102.2.217 66.102.2.218 66.102.2.219 66.102.2.220 66.102.2.221 66.102.2.222 66.102.2.223 66.102.2.224 66.102.2.225 66.102.2.226 66.102.2.227 66.102.2.228 66.102.2.229 66.102.2.230 66.102.2.231 66.102.2.232 66.102.2.233 66.102.2.234 66.102.2.235 66.102.2.236 66.102.2.237 66.102.2.238 66.102.2.239 66.102.2.240 66.102.2.241 66.102.2.242 66.102.2.243 66.102.2.244 66.102.2.245 66.102.2.246 66.102.2.247 66.102.2.248 66.102.2.249 66.102.2.250 66.102.2.251 66.102.2.252 66.102.2.253 66.102.2.254 66.102.2.255 66.102.3.0 66.102.3.1 66.102.3.2 66.102.3.3 66.102.3.4 66.102.3.5 66.102.3.6 66.102.3.7 66.102.3.8 66.102.3.9 66.102.3.10 66.102.3.11 66.102.3.12 66.102.3.13 66.102.3.14 66.102.3.15 66.102.3.16 66.102.3.17 66.102.3.18 66.102.3.19 66.102.3.20 66.102.3.21 66.102.3.22 66.102.3.23 66.102.3.24 66.102.3.25 66.102.3.26 66.102.3.27 66.102.3.28 66.102.3.29 66.102.3.30 66.102.3.31 66.102.3.32 66.102.3.33 66.102.3.34 66.102.3.35 66.102.3.36 66.102.3.37 66.102.3.38 66.102.3.39 66.102.3.40 66.102.3.41 66.102.3.42 66.102.3.43 66.102.3.44 66.102.3.45 66.102.3.46 66.102.3.47 66.102.3.48 66.102.3.49 66.102.3.50 66.102.3.51 66.102.3.52 66.102.3.53 66.102.3.54 66.102.3.55 66.102.3.56 66.102.3.57 66.102.3.58 66.102.3.59 66.102.3.60 66.102.3.61 66.102.3.62 66.102.3.63 66.102.3.64 66.102.3.65 66.102.3.66 66.102.3.67 66.102.3.68 66.102.3.69 66.102.3.70 66.102.3.71 66.102.3.72 66.102.3.73 66.102.3.74 66.102.3.75 66.102.3.76 66.102.3.77 66.102.3.78 66.102.3.79 66.102.3.80 66.102.3.81 66.102.3.82 66.102.3.83 66.102.3.84 66.102.3.85 66.102.3.86 66.102.3.87 66.102.3.88 66.102.3.89 66.102.3.90 66.102.3.91 66.102.3.92 66.102.3.93 66.102.3.94 66.102.3.95 66.102.3.96 66.102.3.97 66.102.3.98 66.102.3.99 66.102.3.100 66.102.3.101 66.102.3.102 66.102.3.103 66.102.3.104 66.102.3.105 66.102.3.106 66.102.3.107 66.102.3.108 66.102.3.109 66.102.3.110 66.102.3.111 66.102.3.112 66.102.3.113 66.102.3.114 66.102.3.115 66.102.3.116 66.102.3.117 66.102.3.118 66.102.3.119 66.102.3.120 66.102.3.121 66.102.3.122 66.102.3.123 66.102.3.124 66.102.3.125 66.102.3.126 66.102.3.127 66.102.3.128 66.102.3.129 66.102.3.130 66.102.3.131 66.102.3.132 66.102.3.133 66.102.3.134 66.102.3.135 66.102.3.136 66.102.3.137 66.102.3.138 66.102.3.139 66.102.3.140 66.102.3.141 66.102.3.142 66.102.3.143 66.102.3.144 66.102.3.145 66.102.3.146 66.102.3.147 66.102.3.148 66.102.3.149 66.102.3.150 66.102.3.151 66.102.3.152 66.102.3.153 66.102.3.154 66.102.3.155 66.102.3.156 66.102.3.157 66.102.3.158 66.102.3.159 66.102.3.160 66.102.3.161 66.102.3.162 66.102.3.163 66.102.3.164 66.102.3.165 66.102.3.166 66.102.3.167 66.102.3.168 66.102.3.169 66.102.3.170 66.102.3.171 66.102.3.172 66.102.3.173 66.102.3.174 66.102.3.175 66.102.3.176 66.102.3.177 66.102.3.178 66.102.3.179 66.102.3.180 66.102.3.181 66.102.3.182 66.102.3.183 66.102.3.184 66.102.3.185 66.102.3.186 66.102.3.187 66.102.3.188 66.102.3.189 66.102.3.190 66.102.3.191 66.102.3.192 66.102.3.193 66.102.3.194 66.102.3.195 66.102.3.196 66.102.3.197 66.102.3.198 66.102.3.199 66.102.3.200 66.102.3.201 66.102.3.202 66.102.3.203 66.102.3.204 66.102.3.205 66.102.3.206 66.102.3.207 66.102.3.208 66.102.3.209 66.102.3.210 66.102.3.211 66.102.3.212 66.102.3.213 66.102.3.214 66.102.3.215 66.102.3.216 66.102.3.217 66.102.3.218 66.102.3.219 66.102.3.220 66.102.3.221 66.102.3.222 66.102.3.223 66.102.3.224 66.102.3.225 66.102.3.226 66.102.3.227 66.102.3.228 66.102.3.229 66.102.3.230 66.102.3.231 66.102.3.232 66.102.3.233 66.102.3.234 66.102.3.235 66.102.3.236 66.102.3.237 66.102.3.238 66.102.3.239 66.102.3.240 66.102.3.241 66.102.3.242 66.102.3.243 66.102.3.244 66.102.3.245 66.102.3.246 66.102.3.247 66.102.3.248 66.102.3.249 66.102.3.250 66.102.3.251 66.102.3.252 66.102.3.253 66.102.3.254 66.102.3.255 66.102.4.0 66.102.4.1 66.102.4.2 66.102.4.3 66.102.4.4 66.102.4.5 66.102.4.6 66.102.4.7 66.102.4.8 66.102.4.9 66.102.4.10 66.102.4.11 66.102.4.12 66.102.4.13 66.102.4.14 66.102.4.15 66.102.4.16 66.102.4.17 66.102.4.18 66.102.4.19 66.102.4.20 66.102.4.21 66.102.4.22 66.102.4.23 66.102.4.24 66.102.4.25 66.102.4.26 66.102.4.27 66.102.4.28 66.102.4.29 66.102.4.30 66.102.4.31 66.102.4.32 66.102.4.33 66.102.4.34 66.102.4.35 66.102.4.36 66.102.4.37 66.102.4.38 66.102.4.39 66.102.4.40 66.102.4.41 66.102.4.42 66.102.4.43 66.102.4.44 66.102.4.45 66.102.4.46 66.102.4.47 66.102.4.48 66.102.4.49 66.102.4.50 66.102.4.51 66.102.4.52 66.102.4.53 66.102.4.54 66.102.4.55 66.102.4.56 66.102.4.57 66.102.4.58 66.102.4.59 66.102.4.60 66.102.4.61 66.102.4.62 66.102.4.63 66.102.4.64 66.102.4.65 66.102.4.66 66.102.4.67 66.102.4.68 66.102.4.69 66.102.4.70 66.102.4.71 66.102.4.72 66.102.4.73 66.102.4.74 66.102.4.75 66.102.4.76 66.102.4.77 66.102.4.78 66.102.4.79 66.102.4.80 66.102.4.81 66.102.4.82 66.102.4.83 66.102.4.84 66.102.4.85 66.102.4.86 66.102.4.87 66.102.4.88 66.102.4.89 66.102.4.90 66.102.4.91 66.102.4.92 66.102.4.93 66.102.4.94 66.102.4.95 66.102.4.96 66.102.4.97 66.102.4.98 66.102.4.99 66.102.4.100 66.102.4.101 66.102.4.102 66.102.4.103 66.102.4.104 66.102.4.105 66.102.4.106 66.102.4.107 66.102.4.108 66.102.4.109 66.102.4.110 66.102.4.111 66.102.4.112 66.102.4.113 66.102.4.114 66.102.4.115 66.102.4.116 66.102.4.117 66.102.4.118 66.102.4.119 66.102.4.120 66.102.4.121 66.102.4.122 66.102.4.123 66.102.4.124 66.102.4.125 66.102.4.126 66.102.4.127 66.102.4.128 66.102.4.129 66.102.4.130 66.102.4.131 66.102.4.132 66.102.4.133 66.102.4.134 66.102.4.135 66.102.4.136 66.102.4.137 66.102.4.138 66.102.4.139 66.102.4.140 66.102.4.141 66.102.4.142 66.102.4.143 66.102.4.144 66.102.4.145 66.102.4.146 66.102.4.147 66.102.4.148 66.102.4.149 66.102.4.150 66.102.4.151 66.102.4.152 66.102.4.153 66.102.4.154 66.102.4.155 66.102.4.156 66.102.4.157 66.102.4.158 66.102.4.159 66.102.4.160 66.102.4.161 66.102.4.162 66.102.4.163 66.102.4.164 66.102.4.165 66.102.4.166 66.102.4.167 66.102.4.168 66.102.4.169 66.102.4.170 66.102.4.171 66.102.4.172 66.102.4.173 66.102.4.174 66.102.4.175 66.102.4.176 66.102.4.177 66.102.4.178 66.102.4.179 66.102.4.180 66.102.4.181 66.102.4.182 66.102.4.183 66.102.4.184 66.102.4.185 66.102.4.186 66.102.4.187 66.102.4.188 66.102.4.189 66.102.4.190 66.102.4.191 66.102.4.192 66.102.4.193 66.102.4.194 66.102.4.195 66.102.4.196 66.102.4.197 66.102.4.198 66.102.4.199 66.102.4.200 66.102.4.201 66.102.4.202 66.102.4.203 66.102.4.204 66.102.4.205 66.102.4.206 66.102.4.207 66.102.4.208 66.102.4.209 66.102.4.210 66.102.4.211 66.102.4.212 66.102.4.213 66.102.4.214 66.102.4.215 66.102.4.216 66.102.4.217 66.102.4.218 66.102.4.219 66.102.4.220 66.102.4.221 66.102.4.222 66.102.4.223 66.102.4.224 66.102.4.225 66.102.4.226 66.102.4.227 66.102.4.228 66.102.4.229 66.102.4.230 66.102.4.231 66.102.4.232 66.102.4.233 66.102.4.234 66.102.4.235 66.102.4.236 66.102.4.237 66.102.4.238 66.102.4.239 66.102.4.240 66.102.4.241 66.102.4.242 66.102.4.243 66.102.4.244 66.102.4.245 66.102.4.246 66.102.4.247 66.102.4.248 66.102.4.249 66.102.4.250 66.102.4.251 66.102.4.252 66.102.4.253 66.102.4.254 66.102.4.255 66.102.5.0 66.102.5.1 66.102.5.2 66.102.5.3 66.102.5.4 66.102.5.5 66.102.5.6 66.102.5.7 66.102.5.8 66.102.5.9 66.102.5.10 66.102.5.11 66.102.5.12 66.102.5.13 66.102.5.14 66.102.5.15 66.102.5.16 66.102.5.17 66.102.5.18 66.102.5.19 66.102.5.20 66.102.5.21 66.102.5.22 66.102.5.23 66.102.5.24 66.102.5.25 66.102.5.26 66.102.5.27 66.102.5.28 66.102.5.29 66.102.5.30 66.102.5.31 66.102.5.32 66.102.5.33 66.102.5.34 66.102.5.35 66.102.5.36 66.102.5.37 66.102.5.38 66.102.5.39 66.102.5.40 66.102.5.41 66.102.5.42 66.102.5.43 66.102.5.44 66.102.5.45 66.102.5.46 66.102.5.47 66.102.5.48 66.102.5.49 66.102.5.50 66.102.5.51 66.102.5.52 66.102.5.53 66.102.5.54 66.102.5.55 66.102.5.56 66.102.5.57 66.102.5.58 66.102.5.59 66.102.5.60 66.102.5.61 66.102.5.62 66.102.5.63 66.102.5.64 66.102.5.65 66.102.5.66 66.102.5.67 66.102.5.68 66.102.5.69 66.102.5.70 66.102.5.71 66.102.5.72 66.102.5.73 66.102.5.74 66.102.5.75 66.102.5.76 66.102.5.77 66.102.5.78 66.102.5.79 66.102.5.80 66.102.5.81 66.102.5.82 66.102.5.83 66.102.5.84 66.102.5.85 66.102.5.86 66.102.5.87 66.102.5.88 66.102.5.89 66.102.5.90 66.102.5.91 66.102.5.92 66.102.5.93 66.102.5.94 66.102.5.95 66.102.5.96 66.102.5.97 66.102.5.98 66.102.5.99 66.102.5.100 66.102.5.101 66.102.5.102 66.102.5.103 66.102.5.104 66.102.5.105 66.102.5.106 66.102.5.107 66.102.5.108 66.102.5.109 66.102.5.110 66.102.5.111 66.102.5.112 66.102.5.113 66.102.5.114 66.102.5.115 66.102.5.116 66.102.5.117 66.102.5.118 66.102.5.119 66.102.5.120 66.102.5.121 66.102.5.122 66.102.5.123 66.102.5.124 66.102.5.125 66.102.5.126 66.102.5.127 66.102.5.128 66.102.5.129 66.102.5.130 66.102.5.131 66.102.5.132 66.102.5.133 66.102.5.134 66.102.5.135 66.102.5.136 66.102.5.137 66.102.5.138 66.102.5.139 66.102.5.140 66.102.5.141 66.102.5.142 66.102.5.143 66.102.5.144 66.102.5.145 66.102.5.146 66.102.5.147 66.102.5.148 66.102.5.149 66.102.5.150 66.102.5.151 66.102.5.152 66.102.5.153 66.102.5.154 66.102.5.155 66.102.5.156 66.102.5.157 66.102.5.158 66.102.5.159 66.102.5.160 66.102.5.161 66.102.5.162 66.102.5.163 66.102.5.164 66.102.5.165 66.102.5.166 66.102.5.167 66.102.5.168 66.102.5.169 66.102.5.170 66.102.5.171 66.102.5.172 66.102.5.173 66.102.5.174 66.102.5.175 66.102.5.176 66.102.5.177 66.102.5.178 66.102.5.179 66.102.5.180 66.102.5.181 66.102.5.182 66.102.5.183 66.102.5.184 66.102.5.185 66.102.5.186 66.102.5.187 66.102.5.188 66.102.5.189 66.102.5.190 66.102.5.191 66.102.5.192 66.102.5.193 66.102.5.194 66.102.5.195 66.102.5.196 66.102.5.197 66.102.5.198 66.102.5.199 66.102.5.200 66.102.5.201 66.102.5.202 66.102.5.203 66.102.5.204 66.102.5.205 66.102.5.206 66.102.5.207 66.102.5.208 66.102.5.209 66.102.5.210 66.102.5.211 66.102.5.212 66.102.5.213 66.102.5.214 66.102.5.215 66.102.5.216 66.102.5.217 66.102.5.218 66.102.5.219 66.102.5.220 66.102.5.221 66.102.5.222 66.102.5.223 66.102.5.224 66.102.5.225 66.102.5.226 66.102.5.227 66.102.5.228 66.102.5.229 66.102.5.230 66.102.5.231 66.102.5.232 66.102.5.233 66.102.5.234 66.102.5.235 66.102.5.236 66.102.5.237 66.102.5.238 66.102.5.239 66.102.5.240 66.102.5.241 66.102.5.242 66.102.5.243 66.102.5.244 66.102.5.245 66.102.5.246 66.102.5.247 66.102.5.248 66.102.5.249 66.102.5.250 66.102.5.251 66.102.5.252 66.102.5.253 66.102.5.254 66.102.5.255 66.102.6.0 66.102.6.1 66.102.6.2 66.102.6.3 66.102.6.4 66.102.6.5 66.102.6.6 66.102.6.7 66.102.6.8 66.102.6.9 66.102.6.10 66.102.6.11 66.102.6.12 66.102.6.13 66.102.6.14 66.102.6.15 66.102.6.16 66.102.6.17 66.102.6.18 66.102.6.19 66.102.6.20 66.102.6.21 66.102.6.22 66.102.6.23 66.102.6.24 66.102.6.25 66.102.6.26 66.102.6.27 66.102.6.28 66.102.6.29 66.102.6.30 66.102.6.31 66.102.6.32 66.102.6.33 66.102.6.34 66.102.6.35 66.102.6.36 66.102.6.37 66.102.6.38 66.102.6.39 66.102.6.40 66.102.6.41 66.102.6.42 66.102.6.43 66.102.6.44 66.102.6.45 66.102.6.46 66.102.6.47 66.102.6.48 66.102.6.49 66.102.6.50 66.102.6.51 66.102.6.52 66.102.6.53 66.102.6.54 66.102.6.55 66.102.6.56 66.102.6.57 66.102.6.58 66.102.6.59 66.102.6.60 66.102.6.61 66.102.6.62 66.102.6.63 66.102.6.64 66.102.6.65 66.102.6.66 66.102.6.67 66.102.6.68 66.102.6.69 66.102.6.70 66.102.6.71 66.102.6.72 66.102.6.73 66.102.6.74 66.102.6.75 66.102.6.76 66.102.6.77 66.102.6.78 66.102.6.79 66.102.6.80 66.102.6.81 66.102.6.82 66.102.6.83 66.102.6.84 66.102.6.85 66.102.6.86 66.102.6.87 66.102.6.88 66.102.6.89 66.102.6.90 66.102.6.91 66.102.6.92 66.102.6.93 66.102.6.94 66.102.6.95 66.102.6.96 66.102.6.97 66.102.6.98 66.102.6.99 66.102.6.100 66.102.6.101 66.102.6.102 66.102.6.103 66.102.6.104 66.102.6.105 66.102.6.106 66.102.6.107 66.102.6.108 66.102.6.109 66.102.6.110 66.102.6.111 66.102.6.112 66.102.6.113 66.102.6.114 66.102.6.115 66.102.6.116 66.102.6.117 66.102.6.118 66.102.6.119 66.102.6.120 66.102.6.121 66.102.6.122 66.102.6.123 66.102.6.124 66.102.6.125 66.102.6.126 66.102.6.127 66.102.6.128 66.102.6.129 66.102.6.130 66.102.6.131 66.102.6.132 66.102.6.133 66.102.6.134 66.102.6.135 66.102.6.136 66.102.6.137 66.102.6.138 66.102.6.139 66.102.6.140 66.102.6.141 66.102.6.142 66.102.6.143 66.102.6.144 66.102.6.145 66.102.6.146 66.102.6.147 66.102.6.148 66.102.6.149 66.102.6.150 66.102.6.151 66.102.6.152 66.102.6.153 66.102.6.154 66.102.6.155 66.102.6.156 66.102.6.157 66.102.6.158 66.102.6.159 66.102.6.160 66.102.6.161 66.102.6.162 66.102.6.163 66.102.6.164 66.102.6.165 66.102.6.166 66.102.6.167 66.102.6.168 66.102.6.169 66.102.6.170 66.102.6.171 66.102.6.172 66.102.6.173 66.102.6.174 66.102.6.175 66.102.6.176 66.102.6.177 66.102.6.178 66.102.6.179 66.102.6.180 66.102.6.181 66.102.6.182 66.102.6.183 66.102.6.184 66.102.6.185 66.102.6.186 66.102.6.187 66.102.6.188 66.102.6.189 66.102.6.190 66.102.6.191 66.102.6.192 66.102.6.193 66.102.6.194 66.102.6.195 66.102.6.196 66.102.6.197 66.102.6.198 66.102.6.199 66.102.6.200 66.102.6.201 66.102.6.202 66.102.6.203 66.102.6.204 66.102.6.205 66.102.6.206 66.102.6.207 66.102.6.208 66.102.6.209 66.102.6.210 66.102.6.211 66.102.6.212 66.102.6.213 66.102.6.214 66.102.6.215 66.102.6.216 66.102.6.217 66.102.6.218 66.102.6.219 66.102.6.220 66.102.6.221 66.102.6.222 66.102.6.223 66.102.6.224 66.102.6.225 66.102.6.226 66.102.6.227 66.102.6.228 66.102.6.229 66.102.6.230 66.102.6.231 66.102.6.232 66.102.6.233 66.102.6.234 66.102.6.235 66.102.6.236 66.102.6.237 66.102.6.238 66.102.6.239 66.102.6.240 66.102.6.241 66.102.6.242 66.102.6.243 66.102.6.244 66.102.6.245 66.102.6.246 66.102.6.247 66.102.6.248 66.102.6.249 66.102.6.250 66.102.6.251 66.102.6.252 66.102.6.253 66.102.6.254 66.102.6.255 66.102.7.0 66.102.7.1 66.102.7.2 66.102.7.3 66.102.7.4 66.102.7.5 66.102.7.6 66.102.7.7 66.102.7.8 66.102.7.9 66.102.7.10 66.102.7.11 66.102.7.12 66.102.7.13 66.102.7.14 66.102.7.15 66.102.7.16 66.102.7.17 66.102.7.18 66.102.7.19 66.102.7.20 66.102.7.21 66.102.7.22 66.102.7.23 66.102.7.24 66.102.7.25 66.102.7.26 66.102.7.27 66.102.7.28 66.102.7.29 66.102.7.30 66.102.7.31 66.102.7.32 66.102.7.33 66.102.7.34 66.102.7.35 66.102.7.36 66.102.7.37 66.102.7.38 66.102.7.39 66.102.7.40 66.102.7.41 66.102.7.42 66.102.7.43 66.102.7.44 66.102.7.45 66.102.7.46 66.102.7.47 66.102.7.48 66.102.7.49 66.102.7.50 66.102.7.51 66.102.7.52 66.102.7.53 66.102.7.54 66.102.7.55 66.102.7.56 66.102.7.57 66.102.7.58 66.102.7.59 66.102.7.60 66.102.7.61 66.102.7.62 66.102.7.63 66.102.7.64 66.102.7.65 66.102.7.66 66.102.7.67 66.102.7.68 66.102.7.69 66.102.7.70 66.102.7.71 66.102.7.72 66.102.7.73 66.102.7.74 66.102.7.75 66.102.7.76 66.102.7.77 66.102.7.78 66.102.7.79 66.102.7.80 66.102.7.81 66.102.7.82 66.102.7.83 66.102.7.84 66.102.7.85 66.102.7.86 66.102.7.87 66.102.7.88 66.102.7.89 66.102.7.90 66.102.7.91 66.102.7.92 66.102.7.93 66.102.7.94 66.102.7.95 66.102.7.96 66.102.7.97 66.102.7.98 66.102.7.99 66.102.7.100 66.102.7.101 66.102.7.102 66.102.7.103 66.102.7.104 66.102.7.105 66.102.7.106 66.102.7.107 66.102.7.108 66.102.7.109 66.102.7.110 66.102.7.111 66.102.7.112 66.102.7.113 66.102.7.114 66.102.7.115 66.102.7.116 66.102.7.117 66.102.7.118 66.102.7.119 66.102.7.120 66.102.7.121 66.102.7.122 66.102.7.123 66.102.7.124 66.102.7.125 66.102.7.126 66.102.7.127 66.102.7.128 66.102.7.129 66.102.7.130 66.102.7.131 66.102.7.132 66.102.7.133 66.102.7.134 66.102.7.135 66.102.7.136 66.102.7.137 66.102.7.138 66.102.7.139 66.102.7.140 66.102.7.141 66.102.7.142 66.102.7.143 66.102.7.144 66.102.7.145 66.102.7.146 66.102.7.147 66.102.7.148 66.102.7.149 66.102.7.150 66.102.7.151 66.102.7.152 66.102.7.153 66.102.7.154 66.102.7.155 66.102.7.156 66.102.7.157 66.102.7.158 66.102.7.159 66.102.7.160 66.102.7.161 66.102.7.162 66.102.7.163 66.102.7.164 66.102.7.165 66.102.7.166 66.102.7.167 66.102.7.168 66.102.7.169 66.102.7.170 66.102.7.171 66.102.7.172 66.102.7.173 66.102.7.174 66.102.7.175 66.102.7.176 66.102.7.177 66.102.7.178 66.102.7.179 66.102.7.180 66.102.7.181 66.102.7.182 66.102.7.183 66.102.7.184 66.102.7.185 66.102.7.186 66.102.7.187 66.102.7.188 66.102.7.189 66.102.7.190 66.102.7.191 66.102.7.192 66.102.7.193 66.102.7.194 66.102.7.195 66.102.7.196 66.102.7.197 66.102.7.198 66.102.7.199 66.102.7.200 66.102.7.201 66.102.7.202 66.102.7.203 66.102.7.204 66.102.7.205 66.102.7.206 66.102.7.207 66.102.7.208 66.102.7.209 66.102.7.210 66.102.7.211 66.102.7.212 66.102.7.213 66.102.7.214 66.102.7.215 66.102.7.216 66.102.7.217 66.102.7.218 66.102.7.219 66.102.7.220 66.102.7.221 66.102.7.222 66.102.7.223 66.102.7.224 66.102.7.225 66.102.7.226 66.102.7.227 66.102.7.228 66.102.7.229 66.102.7.230 66.102.7.231 66.102.7.232 66.102.7.233 66.102.7.234 66.102.7.235 66.102.7.236 66.102.7.237 66.102.7.238 66.102.7.239 66.102.7.240 66.102.7.241 66.102.7.242 66.102.7.243 66.102.7.244 66.102.7.245 66.102.7.246 66.102.7.247 66.102.7.248 66.102.7.249 66.102.7.250 66.102.7.251 66.102.7.252 66.102.7.253 66.102.7.254 66.102.7.255 66.102.8.0 66.102.8.1 66.102.8.2 66.102.8.3 66.102.8.4 66.102.8.5 66.102.8.6 66.102.8.7 66.102.8.8 66.102.8.9 66.102.8.10 66.102.8.11 66.102.8.12 66.102.8.13 66.102.8.14 66.102.8.15 66.102.8.16 66.102.8.17 66.102.8.18 66.102.8.19 66.102.8.20 66.102.8.21 66.102.8.22 66.102.8.23 66.102.8.24 66.102.8.25 66.102.8.26 66.102.8.27 66.102.8.28 66.102.8.29 66.102.8.30 66.102.8.31 66.102.8.32 66.102.8.33 66.102.8.34 66.102.8.35 66.102.8.36 66.102.8.37 66.102.8.38 66.102.8.39 66.102.8.40 66.102.8.41 66.102.8.42 66.102.8.43 66.102.8.44 66.102.8.45 66.102.8.46 66.102.8.47 66.102.8.48 66.102.8.49 66.102.8.50 66.102.8.51 66.102.8.52 66.102.8.53 66.102.8.54 66.102.8.55 66.102.8.56 66.102.8.57 66.102.8.58 66.102.8.59 66.102.8.60 66.102.8.61 66.102.8.62 66.102.8.63 66.102.8.64 66.102.8.65 66.102.8.66 66.102.8.67 66.102.8.68 66.102.8.69 66.102.8.70 66.102.8.71 66.102.8.72 66.102.8.73 66.102.8.74 66.102.8.75 66.102.8.76 66.102.8.77 66.102.8.78 66.102.8.79 66.102.8.80 66.102.8.81 66.102.8.82 66.102.8.83 66.102.8.84 66.102.8.85 66.102.8.86 66.102.8.87 66.102.8.88 66.102.8.89 66.102.8.90 66.102.8.91 66.102.8.92 66.102.8.93 66.102.8.94 66.102.8.95 66.102.8.96 66.102.8.97 66.102.8.98 66.102.8.99 66.102.8.100 66.102.8.101 66.102.8.102 66.102.8.103 66.102.8.104 66.102.8.105 66.102.8.106 66.102.8.107 66.102.8.108 66.102.8.109 66.102.8.110 66.102.8.111 66.102.8.112 66.102.8.113 66.102.8.114 66.102.8.115 66.102.8.116 66.102.8.117 66.102.8.118 66.102.8.119 66.102.8.120 66.102.8.121 66.102.8.122 66.102.8.123 66.102.8.124 66.102.8.125 66.102.8.126 66.102.8.127 66.102.8.128 66.102.8.129 66.102.8.130 66.102.8.131 66.102.8.132 66.102.8.133 66.102.8.134 66.102.8.135 66.102.8.136 66.102.8.137 66.102.8.138 66.102.8.139 66.102.8.140 66.102.8.141 66.102.8.142 66.102.8.143 66.102.8.144 66.102.8.145 66.102.8.146 66.102.8.147 66.102.8.148 66.102.8.149 66.102.8.150 66.102.8.151 66.102.8.152 66.102.8.153 66.102.8.154 66.102.8.155 66.102.8.156 66.102.8.157 66.102.8.158 66.102.8.159 66.102.8.160 66.102.8.161 66.102.8.162 66.102.8.163 66.102.8.164 66.102.8.165 66.102.8.166 66.102.8.167 66.102.8.168 66.102.8.169 66.102.8.170 66.102.8.171 66.102.8.172 66.102.8.173 66.102.8.174 66.102.8.175 66.102.8.176 66.102.8.177 66.102.8.178 66.102.8.179 66.102.8.180 66.102.8.181 66.102.8.182 66.102.8.183 66.102.8.184 66.102.8.185 66.102.8.186 66.102.8.187 66.102.8.188 66.102.8.189 66.102.8.190 66.102.8.191 66.102.8.192 66.102.8.193 66.102.8.194 66.102.8.195 66.102.8.196 66.102.8.197 66.102.8.198 66.102.8.199 66.102.8.200 66.102.8.201 66.102.8.202 66.102.8.203 66.102.8.204 66.102.8.205 66.102.8.206 66.102.8.207 66.102.8.208 66.102.8.209 66.102.8.210 66.102.8.211 66.102.8.212 66.102.8.213 66.102.8.214 66.102.8.215 66.102.8.216 66.102.8.217 66.102.8.218 66.102.8.219 66.102.8.220 66.102.8.221 66.102.8.222 66.102.8.223 66.102.8.224 66.102.8.225 66.102.8.226 66.102.8.227 66.102.8.228 66.102.8.229 66.102.8.230 66.102.8.231 66.102.8.232 66.102.8.233 66.102.8.234 66.102.8.235 66.102.8.236 66.102.8.237 66.102.8.238 66.102.8.239 66.102.8.240 66.102.8.241 66.102.8.242 66.102.8.243 66.102.8.244 66.102.8.245 66.102.8.246 66.102.8.247 66.102.8.248 66.102.8.249 66.102.8.250 66.102.8.251 66.102.8.252 66.102.8.253 66.102.8.254 66.102.8.255 66.102.9.0 66.102.9.1 66.102.9.2 66.102.9.3 66.102.9.4 66.102.9.5 66.102.9.6 66.102.9.7 66.102.9.8 66.102.9.9 66.102.9.10 66.102.9.11 66.102.9.12 66.102.9.13 66.102.9.14 66.102.9.15 66.102.9.16 66.102.9.17 66.102.9.18 66.102.9.19 66.102.9.20 66.102.9.21 66.102.9.22 66.102.9.23 66.102.9.24 66.102.9.25 66.102.9.26 66.102.9.27 66.102.9.28 66.102.9.29 66.102.9.30 66.102.9.31 66.102.9.32 66.102.9.33 66.102.9.34 66.102.9.35 66.102.9.36 66.102.9.37 66.102.9.38 66.102.9.39 66.102.9.40 66.102.9.41 66.102.9.42 66.102.9.43 66.102.9.44 66.102.9.45 66.102.9.46 66.102.9.47 66.102.9.48 66.102.9.49 66.102.9.50 66.102.9.51 66.102.9.52 66.102.9.53 66.102.9.54 66.102.9.55 66.102.9.56 66.102.9.57 66.102.9.58 66.102.9.59 66.102.9.60 66.102.9.61 66.102.9.62 66.102.9.63 66.102.9.64 66.102.9.65 66.102.9.66 66.102.9.67 66.102.9.68 66.102.9.69 66.102.9.70 66.102.9.71 66.102.9.72 66.102.9.73 66.102.9.74 66.102.9.75 66.102.9.76 66.102.9.77 66.102.9.78 66.102.9.79 66.102.9.80 66.102.9.81 66.102.9.82 66.102.9.83 66.102.9.84 66.102.9.85 66.102.9.86 66.102.9.87 66.102.9.88 66.102.9.89 66.102.9.90 66.102.9.91 66.102.9.92 66.102.9.93 66.102.9.94 66.102.9.95 66.102.9.96 66.102.9.97 66.102.9.98 66.102.9.99 66.102.9.100 66.102.9.101 66.102.9.102 66.102.9.103 66.102.9.104 66.102.9.105 66.102.9.106 66.102.9.107 66.102.9.108 66.102.9.109 66.102.9.110 66.102.9.111 66.102.9.112 66.102.9.113 66.102.9.114 66.102.9.115 66.102.9.116 66.102.9.117 66.102.9.118 66.102.9.119 66.102.9.120 66.102.9.121 66.102.9.122 66.102.9.123 66.102.9.124 66.102.9.125 66.102.9.126 66.102.9.127 66.102.9.128 66.102.9.129 66.102.9.130 66.102.9.131 66.102.9.132 66.102.9.133 66.102.9.134 66.102.9.135 66.102.9.136 66.102.9.137 66.102.9.138 66.102.9.139 66.102.9.140 66.102.9.141 66.102.9.142 66.102.9.143 66.102.9.144 66.102.9.145 66.102.9.146 66.102.9.147 66.102.9.148 66.102.9.149 66.102.9.150 66.102.9.151 66.102.9.152 66.102.9.153 66.102.9.154 66.102.9.155 66.102.9.156 66.102.9.157 66.102.9.158 66.102.9.159 66.102.9.160 66.102.9.161 66.102.9.162 66.102.9.163 66.102.9.164 66.102.9.165 66.102.9.166 66.102.9.167 66.102.9.168 66.102.9.169 66.102.9.170 66.102.9.171 66.102.9.172 66.102.9.173 66.102.9.174 66.102.9.175 66.102.9.176 66.102.9.177 66.102.9.178 66.102.9.179 66.102.9.180 66.102.9.181 66.102.9.182 66.102.9.183 66.102.9.184 66.102.9.185 66.102.9.186 66.102.9.187 66.102.9.188 66.102.9.189 66.102.9.190 66.102.9.191 66.102.9.192 66.102.9.193 66.102.9.194 66.102.9.195 66.102.9.196 66.102.9.197 66.102.9.198 66.102.9.199 66.102.9.200 66.102.9.201 66.102.9.202 66.102.9.203 66.102.9.204 66.102.9.205 66.102.9.206 66.102.9.207 66.102.9.208 66.102.9.209 66.102.9.210 66.102.9.211 66.102.9.212 66.102.9.213 66.102.9.214 66.102.9.215 66.102.9.216 66.102.9.217 66.102.9.218 66.102.9.219 66.102.9.220 66.102.9.221 66.102.9.222 66.102.9.223 66.102.9.224 66.102.9.225 66.102.9.226 66.102.9.227 66.102.9.228 66.102.9.229 66.102.9.230 66.102.9.231 66.102.9.232 66.102.9.233 66.102.9.234 66.102.9.235 66.102.9.236 66.102.9.237 66.102.9.238 66.102.9.239 66.102.9.240 66.102.9.241 66.102.9.242 66.102.9.243 66.102.9.244 66.102.9.245 66.102.9.246 66.102.9.247 66.102.9.248 66.102.9.249 66.102.9.250 66.102.9.251 66.102.9.252 66.102.9.253 66.102.9.254 66.102.9.255 66.102.10.0 66.102.10.1 66.102.10.2 66.102.10.3 66.102.10.4 66.102.10.5 66.102.10.6 66.102.10.7 66.102.10.8 66.102.10.9 66.102.10.10 66.102.10.11 66.102.10.12 66.102.10.13 66.102.10.14 66.102.10.15 66.102.10.16 66.102.10.17 66.102.10.18 66.102.10.19 66.102.10.20 66.102.10.21 66.102.10.22 66.102.10.23 66.102.10.24 66.102.10.25 66.102.10.26 66.102.10.27 66.102.10.28 66.102.10.29 66.102.10.30 66.102.10.31 66.102.10.32 66.102.10.33 66.102.10.34 66.102.10.35 66.102.10.36 66.102.10.37 66.102.10.38 66.102.10.39 66.102.10.40 66.102.10.41 66.102.10.42 66.102.10.43 66.102.10.44 66.102.10.45 66.102.10.46 66.102.10.47 66.102.10.48 66.102.10.49 66.102.10.50 66.102.10.51 66.102.10.52 66.102.10.53 66.102.10.54 66.102.10.55 66.102.10.56 66.102.10.57 66.102.10.58 66.102.10.59 66.102.10.60 66.102.10.61 66.102.10.62 66.102.10.63 66.102.10.64 66.102.10.65 66.102.10.66 66.102.10.67 66.102.10.68 66.102.10.69 66.102.10.70 66.102.10.71 66.102.10.72 66.102.10.73 66.102.10.74 66.102.10.75 66.102.10.76 66.102.10.77 66.102.10.78 66.102.10.79 66.102.10.80 66.102.10.81 66.102.10.82 66.102.10.83 66.102.10.84 66.102.10.85 66.102.10.86 66.102.10.87 66.102.10.88 66.102.10.89 66.102.10.90 66.102.10.91 66.102.10.92 66.102.10.93 66.102.10.94 66.102.10.95 66.102.10.96 66.102.10.97 66.102.10.98 66.102.10.99 66.102.10.100 66.102.10.101 66.102.10.102 66.102.10.103 66.102.10.104 66.102.10.105 66.102.10.106 66.102.10.107 66.102.10.108 66.102.10.109 66.102.10.110 66.102.10.111 66.102.10.112 66.102.10.113 66.102.10.114 66.102.10.115 66.102.10.116 66.102.10.117 66.102.10.118 66.102.10.119 66.102.10.120 66.102.10.121 66.102.10.122 66.102.10.123 66.102.10.124 66.102.10.125 66.102.10.126 66.102.10.127 66.102.10.128 66.102.10.129 66.102.10.130 66.102.10.131 66.102.10.132 66.102.10.133 66.102.10.134 66.102.10.135 66.102.10.136 66.102.10.137 66.102.10.138 66.102.10.139 66.102.10.140 66.102.10.141 66.102.10.142 66.102.10.143 66.102.10.144 66.102.10.145 66.102.10.146 66.102.10.147 66.102.10.148 66.102.10.149 66.102.10.150 66.102.10.151 66.102.10.152 66.102.10.153 66.102.10.154 66.102.10.155 66.102.10.156 66.102.10.157 66.102.10.158 66.102.10.159 66.102.10.160 66.102.10.161 66.102.10.162 66.102.10.163 66.102.10.164 66.102.10.165 66.102.10.166 66.102.10.167 66.102.10.168 66.102.10.169 66.102.10.170 66.102.10.171 66.102.10.172 66.102.10.173 66.102.10.174 66.102.10.175 66.102.10.176 66.102.10.177 66.102.10.178 66.102.10.179 66.102.10.180 66.102.10.181 66.102.10.182 66.102.10.183 66.102.10.184 66.102.10.185 66.102.10.186 66.102.10.187 66.102.10.188 66.102.10.189 66.102.10.190 66.102.10.191 66.102.10.192 66.102.10.193 66.102.10.194 66.102.10.195 66.102.10.196 66.102.10.197 66.102.10.198 66.102.10.199 66.102.10.200 66.102.10.201 66.102.10.202 66.102.10.203 66.102.10.204 66.102.10.205 66.102.10.206 66.102.10.207 66.102.10.208 66.102.10.209 66.102.10.210 66.102.10.211 66.102.10.212 66.102.10.213 66.102.10.214 66.102.10.215 66.102.10.216 66.102.10.217 66.102.10.218 66.102.10.219 66.102.10.220 66.102.10.221 66.102.10.222 66.102.10.223 66.102.10.224 66.102.10.225 66.102.10.226 66.102.10.227 66.102.10.228 66.102.10.229 66.102.10.230 66.102.10.231 66.102.10.232 66.102.10.233 66.102.10.234 66.102.10.235 66.102.10.236 66.102.10.237 66.102.10.238 66.102.10.239 66.102.10.240 66.102.10.241 66.102.10.242 66.102.10.243 66.102.10.244 66.102.10.245 66.102.10.246 66.102.10.247 66.102.10.248 66.102.10.249 66.102.10.250 66.102.10.251 66.102.10.252 66.102.10.253 66.102.10.254 66.102.10.255 66.102.11.0 66.102.11.1 66.102.11.2 66.102.11.3 66.102.11.4 66.102.11.5 66.102.11.6 66.102.11.7 66.102.11.8 66.102.11.9 66.102.11.10 66.102.11.11 66.102.11.12 66.102.11.13 66.102.11.14 66.102.11.15 66.102.11.16 66.102.11.17 66.102.11.18 66.102.11.19 66.102.11.20 66.102.11.21 66.102.11.22 66.102.11.23 66.102.11.24 66.102.11.25 66.102.11.26 66.102.11.27 66.102.11.28 66.102.11.29 66.102.11.30 66.102.11.31 66.102.11.32 66.102.11.33 66.102.11.34 66.102.11.35 66.102.11.36 66.102.11.37 66.102.11.38 66.102.11.39 66.102.11.40 66.102.11.41 66.102.11.42 66.102.11.43 66.102.11.44 66.102.11.45 66.102.11.46 66.102.11.47 66.102.11.48 66.102.11.49 66.102.11.50 66.102.11.51 66.102.11.52 66.102.11.53 66.102.11.54 66.102.11.55 66.102.11.56 66.102.11.57 66.102.11.58 66.102.11.59 66.102.11.60 66.102.11.61 66.102.11.62 66.102.11.63 66.102.11.64 66.102.11.65 66.102.11.66 66.102.11.67 66.102.11.68 66.102.11.69 66.102.11.70 66.102.11.71 66.102.11.72 66.102.11.73 66.102.11.74 66.102.11.75 66.102.11.76 66.102.11.77 66.102.11.78 66.102.11.79 66.102.11.80 66.102.11.81 66.102.11.82 66.102.11.83 66.102.11.84 66.102.11.85 66.102.11.86 66.102.11.87 66.102.11.88 66.102.11.89 66.102.11.90 66.102.11.91 66.102.11.92 66.102.11.93 66.102.11.94 66.102.11.95 66.102.11.96 66.102.11.97 66.102.11.98 66.102.11.99 66.102.11.100 66.102.11.101 66.102.11.102 66.102.11.103 66.102.11.104 66.102.11.105 66.102.11.106 66.102.11.107 66.102.11.108 66.102.11.109 66.102.11.110 66.102.11.111 66.102.11.112 66.102.11.113 66.102.11.114 66.102.11.115 66.102.11.116 66.102.11.117 66.102.11.118 66.102.11.119 66.102.11.120 66.102.11.121 66.102.11.122 66.102.11.123 66.102.11.124 66.102.11.125 66.102.11.126 66.102.11.127 66.102.11.128 66.102.11.129 66.102.11.130 66.102.11.131 66.102.11.132 66.102.11.133 66.102.11.134 66.102.11.135 66.102.11.136 66.102.11.137 66.102.11.138 66.102.11.139 66.102.11.140 66.102.11.141 66.102.11.142 66.102.11.143 66.102.11.144 66.102.11.145 66.102.11.146 66.102.11.147 66.102.11.148 66.102.11.149 66.102.11.150 66.102.11.151 66.102.11.152 66.102.11.153 66.102.11.154 66.102.11.155 66.102.11.156 66.102.11.157 66.102.11.158 66.102.11.159 66.102.11.160 66.102.11.161 66.102.11.162 66.102.11.163 66.102.11.164 66.102.11.165 66.102.11.166 66.102.11.167 66.102.11.168 66.102.11.169 66.102.11.170 66.102.11.171 66.102.11.172 66.102.11.173 66.102.11.174 66.102.11.175 66.102.11.176 66.102.11.177 66.102.11.178 66.102.11.179 66.102.11.180 66.102.11.181 66.102.11.182 66.102.11.183 66.102.11.184 66.102.11.185 66.102.11.186 66.102.11.187 66.102.11.188 66.102.11.189 66.102.11.190 66.102.11.191 66.102.11.192 66.102.11.193 66.102.11.194 66.102.11.195 66.102.11.196 66.102.11.197 66.102.11.198 66.102.11.199 66.102.11.200 66.102.11.201 66.102.11.202 66.102.11.203 66.102.11.204 66.102.11.205 66.102.11.206 66.102.11.207 66.102.11.208 66.102.11.209 66.102.11.210 66.102.11.211 66.102.11.212 66.102.11.213 66.102.11.214 66.102.11.215 66.102.11.216 66.102.11.217 66.102.11.218 66.102.11.219 66.102.11.220 66.102.11.221 66.102.11.222 66.102.11.223 66.102.11.224 66.102.11.225 66.102.11.226 66.102.11.227 66.102.11.228 66.102.11.229 66.102.11.230 66.102.11.231 66.102.11.232 66.102.11.233 66.102.11.234 66.102.11.235 66.102.11.236 66.102.11.237 66.102.11.238 66.102.11.239 66.102.11.240 66.102.11.241 66.102.11.242 66.102.11.243 66.102.11.244 66.102.11.245 66.102.11.246 66.102.11.247 66.102.11.248 66.102.11.249 66.102.11.250 66.102.11.251 66.102.11.252 66.102.11.253 66.102.11.254 66.102.11.255 66.102.12.0 66.102.12.1 66.102.12.2 66.102.12.3 66.102.12.4 66.102.12.5 66.102.12.6 66.102.12.7 66.102.12.8 66.102.12.9 66.102.12.10 66.102.12.11 66.102.12.12 66.102.12.13 66.102.12.14 66.102.12.15 66.102.12.16 66.102.12.17 66.102.12.18 66.102.12.19 66.102.12.20 66.102.12.21 66.102.12.22 66.102.12.23 66.102.12.24 66.102.12.25 66.102.12.26 66.102.12.27 66.102.12.28 66.102.12.29 66.102.12.30 66.102.12.31 66.102.12.32 66.102.12.33 66.102.12.34 66.102.12.35 66.102.12.36 66.102.12.37 66.102.12.38 66.102.12.39 66.102.12.40 66.102.12.41 66.102.12.42 66.102.12.43 66.102.12.44 66.102.12.45 66.102.12.46 66.102.12.47 66.102.12.48 66.102.12.49 66.102.12.50 66.102.12.51 66.102.12.52 66.102.12.53 66.102.12.54 66.102.12.55 66.102.12.56 66.102.12.57 66.102.12.58 66.102.12.59 66.102.12.60 66.102.12.61 66.102.12.62 66.102.12.63 66.102.12.64 66.102.12.65 66.102.12.66 66.102.12.67 66.102.12.68 66.102.12.69 66.102.12.70 66.102.12.71 66.102.12.72 66.102.12.73 66.102.12.74 66.102.12.75 66.102.12.76 66.102.12.77 66.102.12.78 66.102.12.79 66.102.12.80 66.102.12.81 66.102.12.82 66.102.12.83 66.102.12.84 66.102.12.85 66.102.12.86 66.102.12.87 66.102.12.88 66.102.12.89 66.102.12.90 66.102.12.91 66.102.12.92 66.102.12.93 66.102.12.94 66.102.12.95 66.102.12.96 66.102.12.97 66.102.12.98 66.102.12.99 66.102.12.100 66.102.12.101 66.102.12.102 66.102.12.103 66.102.12.104 66.102.12.105 66.102.12.106 66.102.12.107 66.102.12.108 66.102.12.109 66.102.12.110 66.102.12.111 66.102.12.112 66.102.12.113 66.102.12.114 66.102.12.115 66.102.12.116 66.102.12.117 66.102.12.118 66.102.12.119 66.102.12.120 66.102.12.121 66.102.12.122 66.102.12.123 66.102.12.124 66.102.12.125 66.102.12.126 66.102.12.127 66.102.12.128 66.102.12.129 66.102.12.130 66.102.12.131 66.102.12.132 66.102.12.133 66.102.12.134 66.102.12.135 66.102.12.136 66.102.12.137 66.102.12.138 66.102.12.139 66.102.12.140 66.102.12.141 66.102.12.142 66.102.12.143 66.102.12.144 66.102.12.145 66.102.12.146 66.102.12.147 66.102.12.148 66.102.12.149 66.102.12.150 66.102.12.151 66.102.12.152 66.102.12.153 66.102.12.154 66.102.12.155 66.102.12.156 66.102.12.157 66.102.12.158 66.102.12.159 66.102.12.160 66.102.12.161 66.102.12.162 66.102.12.163 66.102.12.164 66.102.12.165 66.102.12.166 66.102.12.167 66.102.12.168 66.102.12.169 66.102.12.170 66.102.12.171 66.102.12.172 66.102.12.173 66.102.12.174 66.102.12.175 66.102.12.176 66.102.12.177 66.102.12.178 66.102.12.179 66.102.12.180 66.102.12.181 66.102.12.182 66.102.12.183 66.102.12.184 66.102.12.185 66.102.12.186 66.102.12.187 66.102.12.188 66.102.12.189 66.102.12.190 66.102.12.191 66.102.12.192 66.102.12.193 66.102.12.194 66.102.12.195 66.102.12.196 66.102.12.197 66.102.12.198 66.102.12.199 66.102.12.200 66.102.12.201 66.102.12.202 66.102.12.203 66.102.12.204 66.102.12.205 66.102.12.206 66.102.12.207 66.102.12.208 66.102.12.209 66.102.12.210 66.102.12.211 66.102.12.212 66.102.12.213 66.102.12.214 66.102.12.215 66.102.12.216 66.102.12.217 66.102.12.218 66.102.12.219 66.102.12.220 66.102.12.221 66.102.12.222 66.102.12.223 66.102.12.224 66.102.12.225 66.102.12.226 66.102.12.227 66.102.12.228 66.102.12.229 66.102.12.230 66.102.12.231 66.102.12.232 66.102.12.233 66.102.12.234 66.102.12.235 66.102.12.236 66.102.12.237 66.102.12.238 66.102.12.239 66.102.12.240 66.102.12.241 66.102.12.242 66.102.12.243 66.102.12.244 66.102.12.245 66.102.12.246 66.102.12.247 66.102.12.248 66.102.12.249 66.102.12.250 66.102.12.251 66.102.12.252 66.102.12.253 66.102.12.254 66.102.12.255 66.102.13.0 66.102.13.1 66.102.13.2 66.102.13.3 66.102.13.4 66.102.13.5 66.102.13.6 66.102.13.7 66.102.13.8 66.102.13.9 66.102.13.10 66.102.13.11 66.102.13.12 66.102.13.13 66.102.13.14 66.102.13.15 66.102.13.16 66.102.13.17 66.102.13.18 66.102.13.19 66.102.13.20 66.102.13.21 66.102.13.22 66.102.13.23 66.102.13.24 66.102.13.25 66.102.13.26 66.102.13.27 66.102.13.28 66.102.13.29 66.102.13.30 66.102.13.31 66.102.13.32 66.102.13.33 66.102.13.34 66.102.13.35 66.102.13.36 66.102.13.37 66.102.13.38 66.102.13.39 66.102.13.40 66.102.13.41 66.102.13.42 66.102.13.43 66.102.13.44 66.102.13.45 66.102.13.46 66.102.13.47 66.102.13.48 66.102.13.49 66.102.13.50 66.102.13.51 66.102.13.52 66.102.13.53 66.102.13.54 66.102.13.55 66.102.13.56 66.102.13.57 66.102.13.58 66.102.13.59 66.102.13.60 66.102.13.61 66.102.13.62 66.102.13.63 66.102.13.64 66.102.13.65 66.102.13.66 66.102.13.67 66.102.13.68 66.102.13.69 66.102.13.70 66.102.13.71 66.102.13.72 66.102.13.73 66.102.13.74 66.102.13.75 66.102.13.76 66.102.13.77 66.102.13.78 66.102.13.79 66.102.13.80 66.102.13.81 66.102.13.82 66.102.13.83 66.102.13.84 66.102.13.85 66.102.13.86 66.102.13.87 66.102.13.88 66.102.13.89 66.102.13.90 66.102.13.91 66.102.13.92 66.102.13.93 66.102.13.94 66.102.13.95 66.102.13.96 66.102.13.97 66.102.13.98 66.102.13.99 66.102.13.100 66.102.13.101 66.102.13.102 66.102.13.103 66.102.13.104 66.102.13.105 66.102.13.106 66.102.13.107 66.102.13.108 66.102.13.109 66.102.13.110 66.102.13.111 66.102.13.112 66.102.13.113 66.102.13.114 66.102.13.115 66.102.13.116 66.102.13.117 66.102.13.118 66.102.13.119 66.102.13.120 66.102.13.121 66.102.13.122 66.102.13.123 66.102.13.124 66.102.13.125 66.102.13.126 66.102.13.127 66.102.13.128 66.102.13.129 66.102.13.130 66.102.13.131 66.102.13.132 66.102.13.133 66.102.13.134 66.102.13.135 66.102.13.136 66.102.13.137 66.102.13.138 66.102.13.139 66.102.13.140 66.102.13.141 66.102.13.142 66.102.13.143 66.102.13.144 66.102.13.145 66.102.13.146 66.102.13.147 66.102.13.148 66.102.13.149 66.102.13.150 66.102.13.151 66.102.13.152 66.102.13.153 66.102.13.154 66.102.13.155 66.102.13.156 66.102.13.157 66.102.13.158 66.102.13.159 66.102.13.160 66.102.13.161 66.102.13.162 66.102.13.163 66.102.13.164 66.102.13.165 66.102.13.166 66.102.13.167 66.102.13.168 66.102.13.169 66.102.13.170 66.102.13.171 66.102.13.172 66.102.13.173 66.102.13.174 66.102.13.175 66.102.13.176 66.102.13.177 66.102.13.178 66.102.13.179 66.102.13.180 66.102.13.181 66.102.13.182 66.102.13.183 66.102.13.184 66.102.13.185 66.102.13.186 66.102.13.187 66.102.13.188 66.102.13.189 66.102.13.190 66.102.13.191 66.102.13.192 66.102.13.193 66.102.13.194 66.102.13.195 66.102.13.196 66.102.13.197 66.102.13.198 66.102.13.199 66.102.13.200 66.102.13.201 66.102.13.202 66.102.13.203 66.102.13.204 66.102.13.205 66.102.13.206 66.102.13.207 66.102.13.208 66.102.13.209 66.102.13.210 66.102.13.211 66.102.13.212 66.102.13.213 66.102.13.214 66.102.13.215 66.102.13.216 66.102.13.217 66.102.13.218 66.102.13.219 66.102.13.220 66.102.13.221 66.102.13.222 66.102.13.223 66.102.13.224 66.102.13.225 66.102.13.226 66.102.13.227 66.102.13.228 66.102.13.229 66.102.13.230 66.102.13.231 66.102.13.232 66.102.13.233 66.102.13.234 66.102.13.235 66.102.13.236 66.102.13.237 66.102.13.238 66.102.13.239 66.102.13.240 66.102.13.241 66.102.13.242 66.102.13.243 66.102.13.244 66.102.13.245 66.102.13.246 66.102.13.247 66.102.13.248 66.102.13.249 66.102.13.250 66.102.13.251 66.102.13.252 66.102.13.253 66.102.13.254 66.102.13.255 66.102.14.0 66.102.14.1 66.102.14.2 66.102.14.3 66.102.14.4 66.102.14.5 66.102.14.6 66.102.14.7 66.102.14.8 66.102.14.9 66.102.14.10 66.102.14.11 66.102.14.12 66.102.14.13 66.102.14.14 66.102.14.15 66.102.14.16 66.102.14.17 66.102.14.18 66.102.14.19 66.102.14.20 66.102.14.21 66.102.14.22 66.102.14.23 66.102.14.24 66.102.14.25 66.102.14.26 66.102.14.27 66.102.14.28 66.102.14.29 66.102.14.30 66.102.14.31 66.102.14.32 66.102.14.33 66.102.14.34 66.102.14.35 66.102.14.36 66.102.14.37 66.102.14.38 66.102.14.39 66.102.14.40 66.102.14.41 66.102.14.42 66.102.14.43 66.102.14.44 66.102.14.45 66.102.14.46 66.102.14.47 66.102.14.48 66.102.14.49 66.102.14.50 66.102.14.51 66.102.14.52 66.102.14.53 66.102.14.54 66.102.14.55 66.102.14.56 66.102.14.57 66.102.14.58 66.102.14.59 66.102.14.60 66.102.14.61 66.102.14.62 66.102.14.63 66.102.14.64 66.102.14.65 66.102.14.66 66.102.14.67 66.102.14.68 66.102.14.69 66.102.14.70 66.102.14.71 66.102.14.72 66.102.14.73 66.102.14.74 66.102.14.75 66.102.14.76 66.102.14.77 66.102.14.78 66.102.14.79 66.102.14.80 66.102.14.81 66.102.14.82 66.102.14.83 66.102.14.84 66.102.14.85 66.102.14.86 66.102.14.87 66.102.14.88 66.102.14.89 66.102.14.90 66.102.14.91 66.102.14.92 66.102.14.93 66.102.14.94 66.102.14.95 66.102.14.96 66.102.14.97 66.102.14.98 66.102.14.99 66.102.14.100 66.102.14.101 66.102.14.102 66.102.14.103 66.102.14.104 66.102.14.105 66.102.14.106 66.102.14.107 66.102.14.108 66.102.14.109 66.102.14.110 66.102.14.111 66.102.14.112 66.102.14.113 66.102.14.114 66.102.14.115 66.102.14.116 66.102.14.117 66.102.14.118 66.102.14.119 66.102.14.120 66.102.14.121 66.102.14.122 66.102.14.123 66.102.14.124 66.102.14.125 66.102.14.126 66.102.14.127 66.102.14.128 66.102.14.129 66.102.14.130 66.102.14.131 66.102.14.132 66.102.14.133 66.102.14.134 66.102.14.135 66.102.14.136 66.102.14.137 66.102.14.138 66.102.14.139 66.102.14.140 66.102.14.141 66.102.14.142 66.102.14.143 66.102.14.144 66.102.14.145 66.102.14.146 66.102.14.147 66.102.14.148 66.102.14.149 66.102.14.150 66.102.14.151 66.102.14.152 66.102.14.153 66.102.14.154 66.102.14.155 66.102.14.156 66.102.14.157 66.102.14.158 66.102.14.159 66.102.14.160 66.102.14.161 66.102.14.162 66.102.14.163 66.102.14.164 66.102.14.165 66.102.14.166 66.102.14.167 66.102.14.168 66.102.14.169 66.102.14.170 66.102.14.171 66.102.14.172 66.102.14.173 66.102.14.174 66.102.14.175 66.102.14.176 66.102.14.177 66.102.14.178 66.102.14.179 66.102.14.180 66.102.14.181 66.102.14.182 66.102.14.183 66.102.14.184 66.102.14.185 66.102.14.186 66.102.14.187 66.102.14.188 66.102.14.189 66.102.14.190 66.102.14.191 66.102.14.192 66.102.14.193 66.102.14.194 66.102.14.195 66.102.14.196 66.102.14.197 66.102.14.198 66.102.14.199 66.102.14.200 66.102.14.201 66.102.14.202 66.102.14.203 66.102.14.204 66.102.14.205 66.102.14.206 66.102.14.207 66.102.14.208 66.102.14.209 66.102.14.210 66.102.14.211 66.102.14.212 66.102.14.213 66.102.14.214 66.102.14.215 66.102.14.216 66.102.14.217 66.102.14.218 66.102.14.219 66.102.14.220 66.102.14.221 66.102.14.222 66.102.14.223 66.102.14.224 66.102.14.225 66.102.14.226 66.102.14.227 66.102.14.228 66.102.14.229 66.102.14.230 66.102.14.231 66.102.14.232 66.102.14.233 66.102.14.234 66.102.14.235 66.102.14.236 66.102.14.237 66.102.14.238 66.102.14.239 66.102.14.240 66.102.14.241 66.102.14.242 66.102.14.243 66.102.14.244 66.102.14.245 66.102.14.246 66.102.14.247 66.102.14.248 66.102.14.249 66.102.14.250 66.102.14.251 66.102.14.252 66.102.14.253 66.102.14.254 66.102.14.255 66.102.15.0 66.102.15.1 66.102.15.2 66.102.15.3 66.102.15.4 66.102.15.5 66.102.15.6 66.102.15.7 66.102.15.8 66.102.15.9 66.102.15.10 66.102.15.11 66.102.15.12 66.102.15.13 66.102.15.14 66.102.15.15 66.102.15.16 66.102.15.17 66.102.15.18 66.102.15.19 66.102.15.20 66.102.15.21 66.102.15.22 66.102.15.23 66.102.15.24 66.102.15.25 66.102.15.26 66.102.15.27 66.102.15.28 66.102.15.29 66.102.15.30 66.102.15.31 66.102.15.32 66.102.15.33 66.102.15.34 66.102.15.35 66.102.15.36 66.102.15.37 66.102.15.38 66.102.15.39 66.102.15.40 66.102.15.41 66.102.15.42 66.102.15.43 66.102.15.44 66.102.15.45 66.102.15.46 66.102.15.47 66.102.15.48 66.102.15.49 66.102.15.50 66.102.15.51 66.102.15.52 66.102.15.53 66.102.15.54 66.102.15.55 66.102.15.56 66.102.15.57 66.102.15.58 66.102.15.59 66.102.15.60 66.102.15.61 66.102.15.62 66.102.15.63 66.102.15.64 66.102.15.65 66.102.15.66 66.102.15.67 66.102.15.68 66.102.15.69 66.102.15.70 66.102.15.71 66.102.15.72 66.102.15.73 66.102.15.74 66.102.15.75 66.102.15.76 66.102.15.77 66.102.15.78 66.102.15.79 66.102.15.80 66.102.15.81 66.102.15.82 66.102.15.83 66.102.15.84 66.102.15.85 66.102.15.86 66.102.15.87 66.102.15.88 66.102.15.89 66.102.15.90 66.102.15.91 66.102.15.92 66.102.15.93 66.102.15.94 66.102.15.95 66.102.15.96 66.102.15.97 66.102.15.98 66.102.15.99 66.102.15.100 66.102.15.101 66.102.15.102 66.102.15.103 66.102.15.104 66.102.15.105 66.102.15.106 66.102.15.107 66.102.15.108 66.102.15.109 66.102.15.110 66.102.15.111 66.102.15.112 66.102.15.113 66.102.15.114 66.102.15.115 66.102.15.116 66.102.15.117 66.102.15.118 66.102.15.119 66.102.15.120 66.102.15.121 66.102.15.122 66.102.15.123 66.102.15.124 66.102.15.125 66.102.15.126 66.102.15.127 66.102.15.128 66.102.15.129 66.102.15.130 66.102.15.131 66.102.15.132 66.102.15.133 66.102.15.134 66.102.15.135 66.102.15.136 66.102.15.137 66.102.15.138 66.102.15.139 66.102.15.140 66.102.15.141 66.102.15.142 66.102.15.143 66.102.15.144 66.102.15.145 66.102.15.146 66.102.15.147 66.102.15.148 66.102.15.149 66.102.15.150 66.102.15.151 66.102.15.152 66.102.15.153 66.102.15.154 66.102.15.155 66.102.15.156 66.102.15.157 66.102.15.158 66.102.15.159 66.102.15.160 66.102.15.161 66.102.15.162 66.102.15.163 66.102.15.164 66.102.15.165 66.102.15.166 66.102.15.167 66.102.15.168 66.102.15.169 66.102.15.170 66.102.15.171 66.102.15.172 66.102.15.173 66.102.15.174 66.102.15.175 66.102.15.176 66.102.15.177 66.102.15.178 66.102.15.179 66.102.15.180 66.102.15.181 66.102.15.182 66.102.15.183 66.102.15.184 66.102.15.185 66.102.15.186 66.102.15.187 66.102.15.188 66.102.15.189 66.102.15.190 66.102.15.191 66.102.15.192 66.102.15.193 66.102.15.194 66.102.15.195 66.102.15.196 66.102.15.197 66.102.15.198 66.102.15.199 66.102.15.200 66.102.15.201 66.102.15.202 66.102.15.203 66.102.15.204 66.102.15.205 66.102.15.206 66.102.15.207 66.102.15.208 66.102.15.209 66.102.15.210 66.102.15.211 66.102.15.212 66.102.15.213 66.102.15.214 66.102.15.215 66.102.15.216 66.102.15.217 66.102.15.218 66.102.15.219 66.102.15.220 66.102.15.221 66.102.15.222 66.102.15.223 66.102.15.224 66.102.15.225 66.102.15.226 66.102.15.227 66.102.15.228 66.102.15.229 66.102.15.230 66.102.15.231 66.102.15.232 66.102.15.233 66.102.15.234 66.102.15.235 66.102.15.236 66.102.15.237 66.102.15.238 66.102.15.239 66.102.15.240 66.102.15.241 66.102.15.242 66.102.15.243 66.102.15.244 66.102.15.245 66.102.15.246 66.102.15.247 66.102.15.248 66.102.15.249 66.102.15.250 66.102.15.251 66.102.15.252 66.102.15.253 66.102.15.254 66.102.15.255(/20 is 1000 IP's) and you add several of them !
All as "small subnets" …...
Ok.Are you really surprised it doesn't do it's job ;)
Nice way to explode your pfSense setup.There should be actually a warning for this I guess, like :" if the light is RED, you stop your car ..."
Export your config, and have a look at <aliases><alias><name><google>- and look then at
<address>...</address>
just below that.
(hint : for every IP it tries to obtain a FQDN ....)
PS : Do not activate IPv6 yet, you're NOT ready for it ...... ;D
edit : taking in account the reply from johnpoz (next reply) : even parsing the list would take ages !</google></name></alias></aliases>
-
If your aliases is set to networks and you put in 64.233.160.0/19 it would not be resolving that.. There is nothing to update in such an alias.. Sure a name host alias like heise.de would have to resolve. But if your alias is just a list of networks there is nothing that has to be resolved. So if it stops working something else is wrong.
-
seems i forgot to add:
the google-alias is type network (the "small subnets"-hint only affects the host type i think), only timeserver and heise are type host.
the size of the google-alias should not do any harm (it is exact one line in the backup-xml:<address>64.233.160.0/19 66.102.0.0/20 66.249.64.0/19 72.14.192.0/18 74.125.0.0/16 209.85.128.0/17 216.239.32.0/19 173.194.0.0/16 172.217.0.0/16 216.58.192.0/19</address>
).
the google and timeserver aliases are always shown in the allowlist-alias table. the google ip-ranges are not split up to ips, they stay networks in the allowlist-alias table.
only the heise-alias is not resolved and then of course not added to allowlist.if it is really the size of the table, then i wonder why the same alias works on 3 other pfsenses v2.3.4.
-
If the problem is in filterdns, you need to look at what is being put here:
/var/etc/filterdns.conf
Note that when you combine FQDNs with network addresses the entire alias has to be rebuilt by the filterdns process so all of the addresses in the table must be included.
You are probably reaching the point where it might be better to separate into two aliases. One without FQDNs to be resolved and one without.
Yes, that might be a little more work.
-
in filterdns.conf the networks are one line each. the complete filterdns.conf is 83 lines long.
but maybe you are right, it might be easier to split the alias. i think i do that next time the filterdns stops working.
-
Ok, seems the problem is not solved :(
I put all FQDNs in one alias and all IPs in another. Today filterdns stopped again.
If i add a new FQDN to the alias or to a seperate new alias, it is added immediately to /var/etc/filterdns.conf (the whole file is now 18 lines long).If i check on console with "ps -A | grep filterdns" i see 5 running filterdns processes. (on my 2.3.4 machines i see only 1 process)
Stopping the unbound-service doesnt change anything.
If i try to kill the filterdns-processes, the process status only changes from Is to Ss and then switches back.Is there a normal way to stop/restart filterdns?
Or what kill-options do i have to use to stop these processes?
Then i could start a single process of filterdns and see it that solves the problem. -
Can the firewall even reliably resolve names?
Post the complete output from Diagnostics > DNS Lookup for one of the filterdns FQDNs.
-
https://redmine.pfsense.org/issues/8001 might be related.
-
Here is the output of dnslookup for heise.de:
Results Result Record type 193.99.144.80 A 2a02:2e0:3fe:1001:302:: AAAA Timings Name server Query time 127.0.0.1 14 msec 127.0.0.1 0 msec 8.8.8.8 13 msec 9.9.9.9 13 msec 81.173.194.77 8 msec 194.8.194.60 9 msechttps://redmine.pfsense.org/issues/8001 might be related.
Yep, i guess its the same bug.
Somewhere in this forum someone mentioned it could help to put in 127.0.0.1 as first DNS in general setup (thats why it is shown twice in the output above). That way one DNS always answers even when the others dont respond. -
I don't understand why you are mixing "normal" name servers like 8.8.8.8 with 9.9.9.9 - They will give different answers to the same queries. 8.8.8.8 might return A / AAAA records where 9.9.9.9 might return NXDOMAIN. This can make troubleshooting difficult.
If you want to use quad9 properly you have to use dnsmasq (DNS Forwarder), or unbound (DNS Resolver) in forwarding mode, or disable the local forwarder/resolver and tell pfSense to use quad9 exclusively and disable the localhost nameserver from the list using the checkbox on the general settings page.
Having 127.0.0.1 listed twice is also pretty much nonsense.
Is anything being logged in the resolver log that might point to what it doesn't like?
I currently have a name that's not resolving and I get:
filterdns failed to resolve host vpn1.redacted.com will retry later again.
That does get an instant NXDOMAIN, however.
The filterdns debug level is hard-coded in /etc/inc/filter.inc
You might try changing -d 1 to -d 3 there and seeing if anything meaningful is logged.
/* * FilterDNS has three debugging levels. The def ault chosen is 1. * Available are level 2 and greater then 2. */ if (isset($config['system']['aliasesresolveinter val']) && is_numeric($config['system']['aliasesresolveinterval'])) { $resolve_interval = $config['system']['a liasesresolveinterval']; } else { $resolve_interval = 300; } mwexec("/usr/local/sbin/filterdns -p {$g['varrun _path']}/filterdns.pid -i {$resolve_interval} -c {$g['varetc_path']}/filterdns.c onf -d 1"); /* <---- Change it here */ -
ok, deleted 9.9.9.9 and 127.0.0.1 from dns server settings.
i have configured unbound in forwarding mode.
the resolver.log doesnt show anything suspicious. the entries where name couldnt be resolved are already removed from all aliases (they were just old entries).
i will try changing the debug-level and see what is beeing logged, thx for the tip.i will also reboot the pfsense tomorrow, then i hopefully only have 1 instance of filterdns running.
-
There can be several different filter DNS processes running legitimately. There can be one for aliases and one for IPsec endpoints that must be resolved, for instance. There might be others.
ps axww | grep filterdns
should show them. That should also show the different config files they are using, etc.
-
As IPsec-endpoints he have IPs, so that wont need filterdns.
According to the ps axww all processes use the same config file (/var/etc/filterdns.conf) and the same .pid-file.
I guess that are instances that i manually started to make the name resolution for aliases work again. -
ok, after the restart of the pf i only have one filterdns-process running and the names are resolved correct.
lets hope it stays this way :) -
i have the same problem. after several days, filterdns stopped working. just a reboot of the pfsense solve the problem for the next few days.
i just have 5 fqdn (dynamic dns) entrys in my ip alias table.(2.4.2 p1)
-
this is annoying, it happened again this night. yesterday after 11pm no more updates.
for the moment i will add a cronjob to restart filterdns every hour.
 -
I have the exact same issue on 2.4.2-RELEASE-p1. I really hope someone finds a fix to this issue.
maybe the cronjob is what i need for now?
-
this is annoying, it happened again this night. yesterday after 11pm no more updates.
for the moment i will add a cronjob to restart filterdns every hour.Can you share your cron job with me? I'm not that familiar with cronjob's and i have the same issue. would like a temp fix for now until they fix the bug.
-
Can you share your cron job with me? I'm not that familiar with cronjob's and i have the same issue. would like a temp fix for now until they fix the bug.
sure….
look at the picture belowContent of cron_filterdns.sh
#!/bin/sh pkill filterdns /usr/local/sbin/filterdns -p /var/run/filterdns.pid -i 240 -c /var/etc/filterdns.conf -d 1
 -
When the problem happens, does /var/run/filterdns.pid contain a valid PID for filterdns? (Check the "ps uxaww" output to find the filterdns pid)
If you do "killall -HUP filterdns" do the entries resolve again, or are they still missing?
The code in place now tries not to restart filterdns unless it absolutely has to, but perhaps there is some issue when it's running for prolonged periods were it gets confused or fails to update when expected.
-
i will disable my cronjob and give you feedback when it happens again @jimp
-
a little update from me:
after the reboot 8 days ago everything still works (with the modification of the aliases). -
and again, no more update after 11pm.
"killall -HUP filterdns" has no effect at all.
-
ok, problem is back on my system :'(
When the problem happens, does /var/run/filterdns.pid contain a valid PID for filterdns? (Check the "ps uxaww" output to find the filterdns pid)
yes, its the pid of the running filterdns-process.
If you do "killall -HUP filterdns" do the entries resolve again, or are they still missing?
it doesnt change anything on my machine.
one thing changed:
the old entries were not deleted this time. but they are not updated.
new entries are not resolved but they are added to the filterdns.conf.also the mentioned cron-job from m0nji doesnt seem to be a good idea, since the "pkill filterdns" doesn't end the filterdns-process (at least not on my pf). that means only more and more instances of filterdns will start.
is there any way to really kill that process so i can start a fresh instance?
-
I have the same problem!
No filterDNS in the system->DNS Resolver logs after a week or some days. -
Somebody with a solution?
-
not really a solution, only a workaround:
run "killall -9 filterdns" in the shell and then "/usr/local/sbin/filterdns -p /var/run/filterdns.pid -i 300 -c /var/etc/filterdns.conf -d 1" (or save and apply an existing alias). you could also put them in a cron as already mentioned.since the error happened to me again, i checked the resolver.log again to see if there is any information what the reason could be. even with debug level 3 there is no clue.
the last working entries are some normal adding and clearing entries and some information about some static entries.
the next time filterdns should run, it starts with a "Received signal Hangup(1)" entry and only one entry gets deleted and the static entries are listed.
after that every time filterdns should run (automatically or after a manual save&apply of an alias), only the hangup-message is in log.ps: seems this thread is about the same problem. maybe both threads should be merged.
-
I can confirm, same issue is happening with me. It seems to be it, it started happening after pfSense upgrade in Sept-Nov 2017. I am using development snapshot from 10th of January, issue still persists.
am using Policy Based Routing (PBR) and heavily rely on a lot of aliases: it took time to realize that tables of IP addresses (referring hostname based aliases) are not updated.
So temporary workaround so far is same, what you have suggested:
killall -9 filterdns
rm /var/pid/filterdns.pid (not sure if it correct path, just writing from my head)and then start filterdns process again (or refresh aliases).
In fact, starting filterdns (with proper arguments) sometimes did not help, I had to kill the process again and refresh (edit-save-apply) one of aliases lists.
-
Do we have any reliable and predictable way to trigger this issue? Any specific alias contents that cause it? Is there a set interval at which the problem occurs? Is there some other event that causes it to fail?
-
I'm not having any issue with filterdns, but I'm using it, it resolves a couple of (very static) URL's to IPv4 and IPv6.
When you guys kill filterdns, restart it like this :
/usr/local/sbin/filterdns -p /var/run/filterdns.pid -i 240 -c /var/etc/filterdns.conf -d 7or even
/usr/local/sbin/filterdns -p /var/run/filterdns.pid -i 240 -c /var/etc/filterdns.conf -d 7 -f"-d 7" will produce massive logging is the DNS log. Something might show up.
"-f" will keep it in the foreground, so keep your console access open for the time being. Ctrl-C will end it.Try also chancing the interval "-i 240" (4 minutes) to "i -600" (every 10 minutes) to give it more time.
Btw : "filterdns" is a pretty simple FreeBSD package (program), you'll find it here : https://github.com/pfsense/FreeBSD-ports/blob/devel/net/filterdns/files/filterdns.c
It doesn't do much, and it depends on one important thing : DNS should be working.
Also, it injects modifications into pf tables.
Knowing that all spawned threads (as many as there are tables) are relaunched every "-i xxx" seconds at the same time, is it possible that "pf " gets "overrun" ? -
Do we have any reliable and predictable way to trigger this issue? Any specific alias contents that cause it? Is there a set interval at which the problem occurs? Is there some other event that causes it to fail?
Nope, no trigger (at least i haven't found one).
Nope, i changed my aliases earlier in this thread.
Nope, no specific interval on my system. Sometimes its some days, sometimes weeks.
Nope, i checked the other logfiles. I found no other action that was between last working and first not working filterdns.I will increase the interval and debuglevel as Gertjan suggests. Maybe then we find some clues.
-
seems the entries in the alias are not the reason.
i put the exact fdqn, ips and networks into aliases with the same name on my pfsense at home (more than one month ago).
i had no problems at home but some here at work in that time. -
Just chiming in that we're experiencing this issue too. Tried the kill and restart in verbose mode, but the logs just contained the "clearing entry x from pf table z on host y" messages, and then nothing further. I've put a cron job in place to do this nightly, as it's effecting our ability for our web apps to send mail via Amazon SES.
For what it's worth, this happens to us about every 2 weeks, it seems, but I've been unable to dig up any correlation to anything.
-
Will the bug finally be resolved with 2.4.4?
The bug report is open for 8 months now. Although wie tried to mitigate the problems when it occured for the first time for us in November, we still had problems every time filterdns stopped.
If you're affected from the bug the problems will in many cases be critical, as either access will be allowed when it should be blocked or if you're using a whitelist approach systems or services will break because of the connection problems.
-
Can anyone affected by this please try increasing their debuglevel for filterdns using this commit in System Patches?
https://github.com/luckman212/pfsense/commit/72834bf677bdbd1cf78f6772b79abe4b3eaa8235After that you can follow the logs via console/ssh
clog -f /var/log/resolver.logRelated redmine: https://redmine.pfsense.org/issues/8758
-
Dear All
i am affected with same problem
it happens every day approx.
i must kill filterdns service and restart to make worked again
i increased the debug level for filterdns
and i attached the resolver log file
best regards,
0_1540362451825_resolver.txt -
Problem persists even in Pfsense 2.4.4
-
What problem ?
Look carefully at the log that @hcww provided. Thousands of line all one the moment (Oct 23 23:15:21) because he was asking to resolve an URL that return many, many (no even more : more then 5000 entries at ones ) IP addresses.
That will bring down a this task for sure. Probably the entire system.One might try to get an hold on every IP address that the big ones** use, but, looking at the log and you'll find out that that is not a good idea. Known subject btw.
** Google, Facebook, Twitter, etc
-
@muhammad-waqas said in Filterdns stops working:
Problem persists even in Pfsense 2.4.4
Luckily it got resolved in 2.4.4p1, so update before you complain.
