XPS 730 New Graphics Card

I'm just replacing / upgrading my graphics card, the original is a Nvidia the new one is a PNY with NVidia chipset, I purchased it from Dell as they claim it is XPS 730 compatible.

Without thinking I installed it then, before booting, I suddenly realized that that I still have all the old drivers in place plus the NVidia auto update software.

I assume I need to reinstall the old card, delete the old drivers and anything else connected with NVidia and the old card, because the new card driver disk will not successfully overwrite the old stuff.