The keyboard has only a single ' key and ". But in printed materials you might have noticed different characters for starting quote and ending quote which appear on left side and right side of a quoted phrase.
Your computer may be set to "intelligently" replace normal single quote with a "left" or right quote.
A quick web search gives me possible answers.