Thank you Steve, against that bug, I have also reduced the firewall maximum entries to 65534. Bogon is also disabled.
Might be the case with my ISP, I will ask in the dedicated ISP forums for advice on monitoring. There are a lof of pfsense users with Virgin Media in the UK. Helps to drop the ISP name in this thread as well, in case anyone else is going through the same pain.