openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
At what quantisation? You’re most likely better off running 27b dense or 35 moe
3 bit and it performed like Opus 5 according to his tests, though likely not at that level on every task.