Accidental middle clicks

I have a Dell XPS 13 from 2013.

Perhaps for as long as I've had the laptop I sometimes get accidental middle clicks/middle click emulation. I can tell this is happening because text in my clipboard pastes itself (default behaviour on Ubuntu) at random times.

Can anyone tell me why this is happening and how I can disable it?