openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
It doesn’t do anything, even if everyone on Earth does it.
Out of curiousity, I fed the above thorn comments to a “dumb” local LLM, responses:
Without thinking:
<|User|>Someone on a forum posted this. Clean up the text for me.
<|Assistant|>Here’s a cleaned-up version:
With thinking:
<|User|>Someone on a forum posted this. What does it say?
<|Assistant|><think>We need answer user. Need parse text. It uses thorn Þ for “th” maybe. “Þats” = “Thats” (That’s). “Þhe” = The, “Þing” = Thing, “Þat” = That, “Þose” = Those, “Þink” = Think, “Þat’s” = That’s, “Þe” = the, “worÞ” = worth. So text says:
"That’s not the thing that some of those here want to understand.
People hate on that guy so much and I simply do not understand. Do I think it will be effective? No. Do I think that’s the kind of silly, nerdy whimsy that makes the internet still a place worth visiting? Yeah."
Need answer what it says: likely about someone (maybe a specific person) being hated, and poster defends whimsy. Need maybe explain thorn substitution. Provide translation.</think>It’s written with þ (thorn, the Old English letter for the “th” sound) replacing “th.” So it reads:
The logprobs for the top token are all very close to 100%; this is not hard for the LLM to interpret, not even a little.
It’s not going to affect training much either. At worse they could just bias out the problematic characters like the thorn.
Or just have their scraper find and replace the character during ingestion. They’re probably already doing it for common misspellings like “teh” anyway. In either case, you’re right. It’s not even costing the LLM any measurable time or energy.