An apostrophe is an apostrophe is an apostrophe, I tell my students. When used to indicate omitted letters that fall on the left side of the letters than remain, don’t turn it into a right closing quotation mark. … It’s as simple as that.

Apostrophes don’t swing both ways

Related: its, not it’s.