BIOS beep code and CMOS Battery

When my computer is unplugged for even a short time and I boot it up I get a 5-1-2-3 BIOS beep code. The system starts normally after I remove and re-insert the CMOS battery. Tried a brand new CMOS battery and still the same. Also tried disconnecting all unnecessary hardware and no change.