It's worth checking if there's faulty USB thing plugged in maybe, which pauses POST process (like some USB stick, or keyboard, or mouse, etc.). I'd also unplug IPMI too.
Yeah that's a good idea, boot it up with only the power and VGA plugged into it and see what happens (hopefully would have been suggested via support).