openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
Got a 27b model running on my gaming GPU. Its a bit slow but good enough to look someing up, causual coding, and stupid questions. China is really kicking ass with the open source models.
Same, a 35B model is running on my gaming rig. It’s good enough for most things, even coding.
Just wish I had more VRAM and could load it faster.