Inspiron 1750 doesn't turn on with battery inserted

So my Inspiron 1750 will only turn on with the battery disconnected.

At first, I thought it was a battery issue so now I have 2 new batteries.

When the laptop is on I'm able to connect the battery and it works no problem but when I shut down the laptop and turn it on again with the battery connected it won't work until I take out the battery.