openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
How’s the local LLM support on Linux with AMD?
(Yes I could google, but I think people here would give more realistic answers at a more reasonable tech skill level)
llama.cpp (and by extension Ollama) has a Vulkan backend now, which works fine for my usecases on AMD