With the power adapter disconnected, remove the base cover and disconnect the battery from the mainboard.  Hold the power button for 30 sec.

Reassemble and re-try the install.

@ejn63​ 

I did like you said. After I reconnected the battery, I plugged back the power adapter. Now I get stuck on the Dell secured with Dell SafeBIOS screen. Did I have to press F12?

After powering off I can go to the one time boot settings, but I have still the same issues

What model XPS, and has it passed the diagnostics (F12 at powerup to start those)?

@ejn63​ 

XPS 9520

It passed the diagnostics (both quick and advanced) before I tried to re-install Windows, and now if I try to run the diagnostics again it gets stuck on Dell Secured with Dell SafeBIOS...

Does removing the SSD allow the system to boot proprely into a setup screen?

@ejn63​ 

I will try this. Should I try to boot without the SSD or do I need to put the SSD back after removing it?

It won't boot without the SSD, but it should power up to a setup screen rapidly.  If it does, there are a couple of possibilities -- either the drive (most likely the UEFI partition) is corrupt, or the drive is failing.  

If the system will boot to a setup screen with the drive disconnected, before attempting a reinstall use diskpart (which you can access through the Windows setup routine) to delete all the partitions on the drive before starting the reinstall.

@ejn63​ 

Without the SSD it just shows the Dell logo, nothing else happens. I have put the SSD back, and now I also just get the Dell logo, and F12 or F2 are not doing anything...

Now after a few minutes I can go back to BIOS setup and one time boot settings