Approach to troubleshoot a very slow connection to a single website. - solved

[mervincm]

@ikifar no double NAT, and dedicated hardware
https://www.newegg.ca/gigabyte-ga-c1007un-d-mini-itx/p/N82E16813128598

[ikifar]

@mervincm Ok well I am able to visit the site here at home and I am running pfSense, I assume you don't have any caching so that can't be the issue. Maybe try the file system check to get to this in the pfsense console select the option to reboot (5) then select the option to do a filesystem check which should be F

[johnpoz]

@mervincm said in Approach to troubleshoot a very slow connection to a single website.:

(thus on a public IP address) the problem goes away.

But this public ip address changes right... Do what @NogBadTheBad did and lets see what your browser says about the loading and where the problem is..

[mervincm]

@Pippin thanks for the hint but it didn't make a difference.

[mervincm]

@johnpoz
I happen to have a mac so I pulled up safari - web inspector and I get a the same issue. It records for about 12 seconds and stops thinking the page is loaded, but it's a good minute at least from complete.

[mervincm]

and here is what it looks like from the same system, but connected to LTE

and directly to my ISP

[ikifar]

@mervincm Well do you have anything like squid that could be breaking https

[mervincm]

@ikifar
the only packages I have installed are acme,bandwidthd,openvpn-client-export,RRD_Summary

I might have run snort on this install but that would have been a couple years back.

[ikifar]

@mervincm so snort is definitely not on the system then

[ikifar]

@mervincm does the website work as expected on the stable version of pfSense in your setup?

[mervincm]

@ikifar I will try a fresh install on a spare HDD on the weekend if I can't get this going by then.

[mervincm]

@mervincm

On a spare test system I installed stable version of pfsense, created a fresh xml backup on main system, restored it to the test system, and the issue was gone.

Wondering if it was a stable 2.4 vs 2.5 issue, I then did an in-place update to the test system, taking it to 2.5 dev. The issue was still gone.

I am not sure if it is a hardware issue, or just a currupt install, but the next step will be to blow away my install on the primary system, restore from backup, and see what happens.

[mervincm]

@mervincm
Well it appears to be hardware specific. I reinstalled from scratch today's dev build on the primary system hw and without even restoring my config, the problem is there.

[johnpoz]

Hardware makes no sense to be honest.. More likely you got a different connection from your isp, because when you changed to different system your mac address would be different and you would get a different IP.

If it was hardware - why would it not be on like all sites.. Your just moving packets, pfsense doesn't even know what is the packets. It just moves them.. Pfsense doesn't know what site your talking to..

[mervincm]

@johnpoz None of this is really making any sense to me to be honest. You are correct I am getting a different public ip to one system and thus there will be somewhat different "connection"
I can't imagine it would be significantly different but ...
I suppose I can replace the mac in the working device with the mac from the problem device, get the same ip and see if the problem follows the mac.

[ikifar]

@johnpoz Either that or possibly the reinstall of pfSense

[johnpoz]

If something wrong with pfsense, why is it only presenting itself with this 1 site?

[mervincm]

@johnpoz and I did reinstall it from scratch anyway. Absolutely vanilla install and the issue was there. It isn’t an obvious pfsense issue, I agree. I am left with unlikely scenarios more testing is required, starting with the Mac swap

[ikifar]

@mervincm Did your IP adress change after the reinstall?

[mervincm]

@ikifar I don't think so.

That being said ... I got back to troubleshooting today.

Test system, configured as above (fresh install yesterday of 2.4.4p3 then my config restores, then up to yesterday's daily)
It continues to function as it was yesterday

Primary system, configured as above (fresh install yesterday of yesterday's daily, vanilla config (not even walk through setup wizard yet)
It now works, a direct contrast to yesterday! and I notice my ISP assigned me a new IP (to same physical nic with same non-spoofed mac)

It looks like my ISP is in fact the problem here. and for some reason, they assigned me a new IP and the issue is gone. if they found an issue and fixed it, or if I just got a different IP because of the luck of the draw I have no idea. My ISP is the phone company around here (Telus) and there is zero chance I will be able to talk to someone who has knowledge at this level.

This can be considered closed.