USB Bandwidth Exceeded - Poweredge 1950

I am getting a message saying USB bandwidth exceeded on a poweredge 1950 server. How can I fix this issue? It locks up the server and I have to manually power down the server to fix it. I've tried different USB ports on the server but it shows up eventually on every port. I have a USB switch to view different server screens hooked to 2 servers. I have one monitor hooked to the switch with one USB mouse and one USB keyboard hooked to the switch.