Possible bad PSU.

Other than that, is the power button light doing anything, like blinking amber in a certain sequence?

Smart troubleshooting replacing the CMOS battery, as bad batteries have caused boot loop problems before.

Yes, the power button is blinking amber. The beeps have stopped now but it still will not power on

Blinking amber can mean bad PSU.  Solid amber can mean bad MB.

If you want to try it, there's a BIST Test.  First, with PC off and all external peripherals disconnected, see if your PSU will give the green light when the test button is pushed.  If so, all internal peripherals are good.  This does not necessarily mean the PSU is good.  A bad PSU can still make he fans spin when test button is pushed.

If PSU doesn't give the green light, then it's a matter of disconnecting internal peripherals one by one until it does.  Or the other way - disconnect everything including MB, and reconnect peripherals one by one until no green light with test button pushed.  This lets you know if an internal peripheral is bad.

We can't directly diagnose your PC remotely, but I do think the PSU died.  The way things went is classic of a PSU on it's way out and then it dies.

re:  the power button is blinking amber

failing psu is a good possibility.  also try clear cmos settings by motherboard jumper reset.