“Boot Failure on Device” Error

I’ve been having this for a while now, so basically, I always get this “Boot Failure on Device” when starting up my PC after a reset. I eventually figured out that it was because of my microphone (Hyper X Quadcast S). And when I unplug the usb from the PC, it boots up fine. Any idea on what to do to fix this?