Optiplex 3070 shuts down whilst installing graphics drivers

I have an Optiplex 3070 with the i5 9500, 16GB memory, 512GB SSD and 260W PSU.

I decided to install an Nvidia GeForce GT 710 into the system. It boots up fine, but the drivers are obviously not installed when it first boots.

Whenever I attempt to install the drivers, whether it be through device manager, GeForce experience or from manually downloading them online. the PC shuts itself down during installation. I am then unable to post the machine - it restarts for a few seconds then shuts down again. The same will happen if I press the power button.

Removing the card and running off the iGPU causes the PC to boot normally again.

Why is this happening, and how can I prevent it?