@pzanga
Just a quick update, if anyone cares. Turns out the issue was a flaky keystone jack. Not sure if it was a bad terminal connection or some dust in the jack, but took off the wall plate, made sure connections were secure, blew out some dust and now its working fine. Also made sure Ethernet cable is not being squeezed and it secure. No problems since.
So, as I said above, always check your equipment.