keyboard issues with apostrophe/inverted comma key

I have a new Dell laptop, and am having problems with the apostrophe/inverted comma key. Seems to be set up for wrong language as when hit key nothing happens at first and then when I start typing will get symbols put over letters (e.g. á and ä). Am running Windows 8 and region is set to English (Australia). Is very frustrating, can someone help.