
setVeryLoud(true);
He / They
Software Developer
- 0 Posts
- 9 Comments
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•Debian AI policy vote results: LLM usage is neither endorsed nor prohibited. Humans are kept accountable for any code they submit.English1·8 hours ago
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•So Reddit has decided that plain HTML is unsafeEnglish1·8 hours ago
Inertia, just like Facebook.
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•I gave Qwen 3.8 27B a reverse-engineering job I assumed needed a frontier model, and it finished in 30 minutesEnglish11·5 days ago
Higher efficiency = less hardware demand
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•I gave Qwen 3.8 27B a reverse-engineering job I assumed needed a frontier model, and it finished in 30 minutesEnglish1·5 days ago
Local models tend to be more efficient since people will be more likely to run compressed and MoE models.
Also, it’s basically 1 GPU >= 1 request for the most part in data centres, each request is its own LLM. Each time you make a new request after a set timeout, model weights get loaded in VRAM, context gets initialized, the query gets parsed, and it spits out tokens. These frontier models can be 300 GB in size or more, which all needs to be kept in VRAM for best performance, usually distributed across multiple GPUs, and each loaded model can only answer one query at a time.
Compare this to someone like me, trying to cram Qwen 3.6 MoE on the 16 GB RX 6800XT I already have in my own computer, not using up drinking water or prime real estate to cool my PC, powered using hydroelectricity.
It’s so much more eco-friendly and economical, I wish frontier models would just die tbh, or at least only be used for distillation. LLMs offer diminishing returns past a certain point, and you can get 90% of the frontier model with a MoE local model.
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•ArsTechnica: Ads and tracking infiltrated TVs. Now they’re coming for monitors.English26·7 days ago
This isn’t even the case for those LG monitors, they trigger a Windows Update download for malware.
- setVeryLoud(true);@lemmy.catoMildly Infuriating@lemmy.world•This crazy assassin character, who doesn't know what shampoo is, somehow would bother shaving her armpitsEnglish1149·8 days ago
Sexualization of women x sexualization of prepuberty.
It’s pedophilia. You’re welcome.
Edit: Wow the downvotes came quick, please instruct yourselves.
https://ojs.stanford.edu/ojs/index.php/sjfgss/article/download/3103/1654/10396
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•If the markets reject OpenAI and Anthropic, the US should nationalize themEnglish21·11 days ago
Fash take, just kill it. LLMs should belong to the people, just like information should belong to the people.
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•Ubuntu is growing faster on Windows 11 than on native Linux PCs, says CanonicalEnglish17·12 days ago
My work would be impossible without WSL, and yes I am guilty of hiding from the security systems… Because the security systems are so invasive they keep locking files I’m trying to open so IDEs don’t even work properly under Windows.
- setVeryLoud(true);@lemmy.catoTechnology@lemmy.world•Anthropic’s ‘Watermark’ Text Adulteration in Claude Is a Perversion of WritingEnglish51·15 days ago
Yeah that’s called transformation, which is fine. Means a human went over it.