See everyone thinks that five nines is what you should be striving for, but Microsoft has realized that nine fives is much more impressive so they’re working towards that now.

475$ an hour? Fucking hell, for that money I’ll write any report to whitewash you and I won’t make it apparent that I’m using AI to talk about shit I have no idea about, AND I’ll make sure that if I do use AI to write the whole thing then it won’t be traced back to me by my ChatGPT history lmao

I mean, didn’t Gitlab also say they were going all-in on AI?

There’s no major forge you can use for proprietary projects that isn’t shitty.

Well no, you can produce methane from other hydrocarbons. You eat stuff and fart out methane

Dude don’t buy shit that YouTubers get paid to promote, it’s nearly always shit. Sony and Bose make buds that you can expect to remain vendor agnostic for the rest of time unlike Apple, Samsung, et al. I mean yes, Sony makes phones too, but they don’t have a big enough market share to disable support of some features on non-Sony phones down the line…

I suspect Siri would tell you to fuck off, it’s pretty restrictive. Can’t even properly use Siri while driving using Apple Carplay, have to manually touch your phone instead to reply to messages lol

The politicians of those communities have failed their constituents.

When a data center permit is applied for, it should be weighed against the state of the grid. If there’s not enough production, it should not be allowed unless they also build a bunch of electricity production capacity, which needs to come online first.

There are instances where this could actually be a net benefit for the grid. Right now in my country, power prices go negative at peak sunlight hours in the summer because we have nothing to do with all that electricity. If you produce solar, gotta disconnect from the grid at those points. A reliable consumer working 24/7 would help even things out for the consumption side of the grid math.

Not that I want them in my country, we have a very dirty grid (shale plants, yay) and live far enough north that solar only works for about 7-8 months a year. But somewhere more moderate in terms of solar availability, it would be fine. Here we need more consumption in the summer and less in the winter.

Man I want your supplier for batteries and panels tbh.

A single DGX B300 that could run Kimi for a few concurrent users, uses 14 kW. Costs about 500k. Assuming you live far enough from the equator to have seasons, you’ll have about 8 hours of daytime at the worst points of the year (less at my latitude for an example, we get ~6 hour days in the dead of winter, with sun angles below 10 degrees and sunshine available… not every week)

Even in a slightly less extreme location, You’d be looking at roughly a 100 kW array to fill the battery and power that one server reliably like when there’s clouds, about 300 kWh battery capacity to get through long nights. Easily 6 figures total cost, maybe 20-40% of the server itself. This assumes no electricity used for cooling, so it’s very much back of the envelope math, reality could be much worse or a tiny bit better depending on your latitude.

They’re still servers, the focus is on the GPU side though. A single DGX B300 has 8 Blackwell Ultra GPUs and 2 Xeon 6776P CPUs. And networking, RAM, storage. Consumes 14 kilowatts and looks like this

You COULD host a website on one if you wanted to. You’d be stupid to do it, but you could.

Question is, how long are they going to keep making their new models open weight? GPT2 was open too, y’know. Hell, the company that made it is called "Open"AI. Money corrupts.

And how many concurrent users do you get with 8 B300s on the Kimi K3? I’m not 100% sure on the math, but apparently about <= 4 with full context size.

They can make these models open weight because basically nobody’s gonna be able to run them and you can’t just build a brand new model out of it like you can with regular open source software. That 8 nvidia B300 card minimum isn’t enough to run it commercially, it’s good for like a small 10-20 person company of fairly heavy users, or slightly more if not using heavily.

Uh that user was saying that AI would be an improvement over hard keyword filters… and YouTube is an AI company so they should in fact know that

Yes, mark it down as “criminal income” so they don’t ask questions

This is uh…

Yea it’s been exactly about 4 years since I put down my book to go to sleep and never picked it back up. Yes I have ADHD too.

And it was an interesting book! It was a Discworld book and I’ve heard it’s one of the funniest ones.

And China will also have to cut costs when having an aging society really hits them. Rampant capitalism won’t save them there.

lol

Yes, they industrialized. Same thing happened more or less everywhere else, just earlier, because China stayed an agrarian society for longer than many other countries.

The reason other countries can’t say the same though, is that they don’t have 800,000,000 people in the first place. Well India does, but then they’ve also lifted a few hundred million people out of extreme poverty in the last decade or so. We’ll see what the numbers are like for 2015-2055 in… 29 years I guess.

We have working healthcare in most of the west, with fewer billionaires. I’d in fact say much of the west has even better healthcare than China.

The US doesn’t, but then both the US and China are ultracapitalist nightmares.

How exactly are the billionaires good for China’s healthcare?

Well much of the rest of the world has sanctioned Russia for the whole warmongering thing. India prefers war profiteering.

Air cooling is probably not possible at modern data center scale (at least AI data centers, they have ridiculous power density), closed loop cooling very much is, but it takes more power so it’s cheaper to just evaporate a ton of air unfortunately.

Going to need bills like this everywhere, or water prices raised significantly for non-home usage.

As far as I understand, they use air conditioning PLUS water cooling. As in, the water is used to cool the AC condensers. Because even just AC alone isn’t cutting it.

lol