openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
The kind of specs that would enable local LLM usage were available on laptops since 2020. The floor for acceptable performance for LLMs stopped literally just before 24+gb of VRAM would have become pretty common in consumer applications. The reason this technology isn’t more ubiquitously available is because ‘they’ thought it would be more profitable to hoover up literally every byte of RAM and GPU in the world rather than let the technology continue to naturally evolve to a place where any consumer could have run useful models on their home computers. In other words, your anger is misplaced.
What’s your assumption about where my anger is directed?
Yeah the cross over point right now sis somewhere between qwen3.8 27b and glm 5.2/5.3
Like qwen is so close to being good.
Probably Qwen Flash. Supposedly the 27b is nearly to capacity when it comes to training potential, while the Flash has still quite undercooked. Despite this, Flash is pretty dang good at understanding my goals and implementing my will, most of the time.