Do you mean as well as your original file there is a 2nd similar file with ~ in front of the filename?  This is a temp file created by Word when you open a Word document and should have been removed when you close the file or Word.  If you have these temp files remaining on the hard drive when Word isn't running, you can delete them.