Internet explorer only keeps that background until you restart your computer. You must save the background while you are on the actual site where you got the picture. Just like saving any other file..  File>Save>My Pictures or any folder that you choose. You may want to name your file so you can find it later. Once the file is saved to your folder navigate to that folder, right click on the picture and Set as background  or wallpaper. Hope this helps.