openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
Issue is that local AI hog vram, are slow and small models. Or if you don’t have a compatible GPU, it uses the CPU which is even slower.
If AI is the future, I really hope it’s local, but with the equipment people have at home, local AIs are a non-starter.
IMO it’s enough to justify not shipping those AI features at all but I guess that’s where FF execs disagree.
AI inference is doable on home equipment. AI training is less feasible, but nobody builds their whole Debian distro from source either. It’s enough that the source is available and you can rebuild any component if you want ot do so.