Yes, my adapter plug also sparks if I insert it into a live outlet. I tend to plug it into a switched outlet so that I avoid the sparks by switching the power on after it is plugged in.

In theory leaving the adapter turned on 24hrs/day shouldn't cause it problems but I prefer not to do this - I just switch it off at the wall outlet.