Multiple Display Drivers

I have two Latitude D830 laptops.

They are mostly identical, but with two exceptions.
1. One has a but faster processor than the other.
2. One used shared memory for the video (Intel Driver) and the other has an nVidia Quadro video card with respective driver.

I would like to be able to swap the hard disks between the two computer.

My question is, can I install both sets of drivers and assume the respective computer will know what to do?