openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
The local models thing is the real threat. For what 90% of the world who actually cares and wants AI, a local model is probably already “good enough”. Or would be if they could get the hardware, or maybe they don’t know how to set one up.
Got a 27b model running on my gaming GPU. Its a bit slow but good enough to look someing up, causual coding, and stupid questions. China is really kicking ass with the open source models.
Same, a 35B model is running on my gaming rig. It’s good enough for most things, even coding.
Just wish I had more VRAM and could load it faster.