All of this can be done on a graphics card from 3 generations ago locally though - it’s like Photoshop you know, people can use Photoshop to make revenge porn but Photoshop isn’t illegal, using it to make revenge porn is illegal.
In the case of HA, the agent is receiving ambiguous natural language requests and converting them into HA MCP calls. I can open the HA app and press buttons, sure, but the agent can reason over time about patterns of water/electricity use, provide natural language feedback, push back on my automation ideas with counterexamples from sensor logs - and all the sensors in the home and on the phones carrying the companion app are rich signal sources for an agent. It unlocks neat tricks like when our babysitter comes over the front door agent can alert her if there’s a water leak and walk her through shutting off the water to the house or locate the backup key for her. It can DM me when someone rings the doorbell and carry on a different conversation with STT depending on if it is a person wearing a uniform or holding a clipboard for example thanks to Frigate and some custom vision ingestion with Qwen 3 VL.
Regarding the torrents, that agent keeps track of my ratios on the private trackers and I can give it natural language feedback about what I did or didn’t like about a show or movie and it will suggest alternatives, find them on a private tracker, download them, unpack them, and ingest them in the library for me, keeps track of the families like and dislikes and suggests media to watch together, watch private trackers for open invites or interview slots and take the knowledge interviews for me on IRC, deduplicate downloads and hunt for releases with minimum quality standards etc. one of my first tasks for it was replacing my music collection that got damaged when my external hard drive got dropped with no backup and I had to get it extracted in a clean room. Lots of rare lifetime accumulated mp3s gone - mostly recovered now. Searching for replacements would have been a long slog so I automated it.
To your point some of these things could be done by deterministic python scripts and in fact the agents write those to save inference costs later and most of this stuff I could do by siting on my computer an clicking on stuff and reading - the point is that the agents constitute a natural language control surface to trigger all of those actions for me automatically so I can just send a couple chats to a discord bot and it will be done a few minutes later. I’m a busy person I dunno if you can relate. Busy career, got a family to support, parenting obligations, no time to hang out playing video games any more sadly. Building stuff takes time and effort and you have to learn and read about how to do it or pay someone else to do it for you so I was stuck on the easy convenience of windows and Netflix and Amazon/kindle etc. Not anymore! It started with having to install docker desktop to get OpenClaw working and then pretty fast I figured out pretty much everything I wanted to do now that was not work related is better done on Linux and better done self hosted. I would never have gotten over that hump without LLMs.
So one thing that’s really helpful to automate is checking all the repos for my self hosted stacks and testing/validating/deploying new versions when they come out. They’re also good at writing helper scripts in Python to automate things deterministically so I don’t have to keep using LLMs for it. There’s an agent that is focused on learning and managing my wife’s school schedule, ingests her grades and syllabi and reviews her homework and makes helpful 10 minute podcasts on concepts she’s struggling with in her engineering program (not notebookLM, a self hosted lookalike), there’s a domestic agent that accepts uploads of grocery receipts and does our meal planning and schedules time for meal prep and chores and divides it up between us and the kids depending on everyone’s calendars, there’s a home media agent that manages qbittorrent and my ratios on private torrent trackers and files new manga or TV shows or movies ebooks audiobooks etc in the right library when new things come out we might like, viewing/reading/watching metadata tells the agent what content is popular to queue up in the next sweep - there’s a home assistant front door agent that can make automations or report sensor state or trigger scenes or entities in the general text channel of our home discord server and can tell me where my phone or keys are thanks to ESPresence being able to use cheap ATOM esp boards throughout the house (tiny little USB powered things with Bluetooth and wifi) to triangulate the location of any watched Bluetooth device or tracker tag in 3 dimensions through floors and walls - what else…there’s a home security red-team agent that looks for security holes in my cloudflare tunnel/kv worker/tailscale/caddy/protonVPN routes and monitors a cyber security RSS feed, I have a job/market research bot that ingests another RSS feed for news relevant to my industry and organization and gives me email and voice briefings on new regulations and corporate leadership signals, stuff like that. What else… there’s a game dev bot where my kids can talk to a discord bot that routes to a game dev agent that has Godot MCP and Unity MCP and renpy MCP and lots of other fun tools like Roblox MCP and Minecraft to make custom games we can deploy on Google cloud for their friends to play (my daughter is really into visual novels for some reason I don’t get it) - all sorts of fun stuff. Discord is kind of the family shared interface and then the privileged control planes are routed to my phone through tailscale and the home media server stacks are exposed through cloudflared.
Yes, with OpenClaw I can expose my agents via discord apps on my home discord server, I like that route because of the rich media and UI options (agents can give me drop down selector lists and approve/reject buttons). I have two 24gb Nvidia cards for local models usually Qwen, Mistral, and nemo based models for different purposes. I can chat with the agents anywhere I’m logged into discord and I expose privileged control surfaces and nodes via tailscale and family/shared endpoints via caddy and cloudflared
You can just turn off a data center. How are you gonna turn off a thousand refrigerators?
Common misconception we actually use all of our brains, people just liked to say we only use 2% of it because they didn’t like to admit they couldn’t figure out what the other 98% did a few decades ago.
Nothing ironic about that. Thanks to OpenClaw and open weights AI models I started self hosting and figuring stuff out that would have made me frustrated and quit years ago. I have home assistant running on bare metal on a mini PC, a NAS with custom bios, migrated everything away from windows, Kavita for ebooks, jellyfin for music and video, nightscout to ingest my wife’s insulin pump data, and some fun custom sidecars that tie together some nifty automations like automatically diarizing and transcribing voice notes of meetings from my phone without having to pay a subscription fee - latest projects have been a local sync point for logseq, kitchenowl, and nextcloud - super productivity android app and caldav and the to-do lists in home assistant. I never would have had the time to figure all this out with my full time job and parenting but I can cut the cord to all my subscription services and I look at things a new way now. I solve my own problems now when before I would just look for a way to buy a solution. I bought bunk beds for the kids but the bottom bunk didn’t come with slats and I couldn’t find the right size so I went to home Depot and built my own with instructions from my ops agent. I had a fun idea to make an e-ink display sign for my office door that shows what town I’m currently in and what my current MS outlook calendar block is and when it’s over. I never played with Arduino before and now I’m hooked. It gets me over that first execution hump. Sure I break stuff and have to figure out how to put it back together again but that’s part of the fun. I finally found a way to learn stuff that works for me, you know, comes naturally. It’s like I’ve been waiting my whole life for this ever since growing up seeing people using computers via natural language in Star Trek. It extends to my work. The data I need is gated behind ticketing systems of business intelligence professionals who don’t have the time or inclination to give me what I need so hey looks like copilot basic is great and m-code, guess I don’t need BI analysts after all. Sucks for them.
Read the article. A MoE model distributed between multiple devices can function just very slowly. It doesn’t need to translate Icelandic poetry just execute narrowly scoped actions it was specifically trained on.
Government administered healthcare has better outcomes and less administrative overhead than privately administered healthcare. Look at privatized firefighters for another example. Government is always on the forefront of messy expensive and complex systems and yes it could be improved but if half of it wasn’t trying to deregulate the other half out of existence we could probably bring some more resources to bear on the problem more efficiently.
The problem is that profit seeking enterprise explicitly doesn’t serve human values and that’s by design.
Also psychiatric commitment isn’t necessarily forever and has a restorative focus.
Just levying fines and imposing jail sentences doesn’t go far enough, it’s a 19th century solution to a 21st century problem.
Corporate personhood and limited liability need to be abolished and private enterprise needs to be re considered from first principles for the modern era.
It corporations are people, there needs to be a death sentence and involuntary psychiatric commitment .
Right and the predecessor to ChatGPT was trained on links from reddit posts pretty wild. I remember having fun making it come up with nonsense prose on my GPU
K2 wasn’t the first.
China had CPM-1 in 2020 that was a 2.6B model.
GPT-Neo (Mar 2021) EleutherAI replicates early GPT
PanGu-α (Apr 2021) Huawei’s 200B model
WuDao 2.0 (May 2021) BAAI’s massive 1.75T sparse MoE model
GPT-J (Jun 2021) EleutherAI release 6B
Meta released OPT in 2022, BLOOM was in 2022, GLM 130B by Tsinghua/Zhipu was in 2022 etc
K2 horizon is very recent, nowhere near the first. Different labs have different computational innovations worth studying. DeepSeek is crazy efficient and doing very novel things. Mistral in France is making very compact local friendly models that are fun and easy to fine tune and merge on consumer hardware.
Sounds like you didn’t make it past the intro
LibreChat already exists and it’s much better
They just busted a senior law enforcement official for this btw we are commenting on a post about an article about it. I doubt they were using a frontier API