openmic.social is an uncensored community. You may encounter strong language, controversial opinions, and mature or NSFW material. You must be 18+ to browse. Illegal content is prohibited and removed on sight — please report it. By continuing, you accept that you may see content you personally disagree with.
Can I ask what your setup is?
It’s fucking shit. I went that “building your own router” thing but had no idea how to do it. I had an old Mac Mini lying around and so turned that into my router by flashing OPNsense on it and ran into issue after issue.
Here’s the biggest issue I had that I know some of you were thinking but I wasn’t at the time. OPNsense is built on FreeBSD, which lacks proper support for Apple shit, so the Mac got mad at me every time I tried to flash it. So then I got an idea. Built the router inside a VM in the Mac Mini!
Believe it or not, this actually all went pretty well of getting a vRouter inside of a mac computer and having the Local LLM, I uses Google Gemma tuned to Hermes running Ollama on it, but ran into an issue of the AI agent being painfully, agonizingly slow and revving up my tormented Mac Mini every fucking time I asked it to do anything.
This is because Apple bullshit. I am not qualified enough to answer that, I’m a help desk guy so 50% of the time I talk about IT stuff, I’m confidently bullshitting. Anyways, I got oLMX, gave the local AI agent my API kets to my Mac Mini vRouter, and any time I need anything I can just go into the Mac itself as a computer and talk to it.
I am still trying to find out how to do that thing where you like message the agent through some messaging app as that I have 0 idea how to do. Talking to it through Signal would make my life a lot easier, but sometimes you grow as a person when you reject convenience and make your own life harder.
Hahaha, that sounds like a painful experience, I spent a few years building Apple build systems for mobile games and I hated every minute of it.
Ive heard a few people say “just get a mac mini and run your llm there”, and I immediately nope out.
It sounds like you’re learning shit from it all, even if you’re bullshitting your way through it, some of this random knowledge will help you out later on in life.