XPS 8900, need RAM help

I have a Dell 8900, 4 mem slots, dual channel (white / black)

RAM is installed as follows:

Channel A (white) 2 sticks, ddr4, 16G, 2140

Channel B (black) - 2 sticks, ddr4, 4G, 2133

Total ram - 40G

Not gaming.  For photoshop.

Will I get more speed if the 2 sticks of 4G are removed, leaving only the 2 sticks of 16G?

Total ram - 32G