I have had success in using cigarette lighter fluid to remove Magic Marker off of plastics without damaging the surface.  As always test it first to be sure.  To avoid over cleaning the area use a Q Tip lightly saturated with the lighter fluid.  The use of stronger solvents such as laquer thinner or finger nail polish remover definately softens plastics and should be avoided.