@Nightfrost:
–UPDATE--
So, after some worsening packet loss, and longer downtime periods, I decided to contact Verizon. They are blaming poor cable installations between the ONT and my router. I've already re-terminated one end, but I'm not too convinced that the chord would causes such an issue. If the chord was damaged, i'm pretty sure I'd be experiencing other issues. Also, I decided to pick up an Intel NIC to replace the PoS Realtek one.
Have you tried temporarily replacing the pfsense router with the old verzion router and seeing of you still have latency problems? Could be useful as a way to rule out ISP/ONT/cabling issues.