Why do people pluralize word's with an apostrophe?

I can understand erroneously omitting an apostrophe where needed, but explicitly adding one where not needed? Who taught them to do that?