Problem editing Hebrew Word documents

When I try to edit a Hebrew Microsoft Word document on the remote computer, I can't type a coma (,) or a stop (.). Instead I get letters from the Hebrew alphabet. Even if I change the keyboard to English, I still get Hebrew letters instead of (,) and (.)