Altman argued that ongoing memory supply chain woes were because selfish individuals wanted to run their AI models locally instead of leaving the remaining AI chips alone for hyperscalers to hoard in data centers.
Selfish? We’re selfish?
Goooo fuck yourself. You’re the problem you fucking cunt, and you know that.
I hate the idea of Sam Altman not being in prison
God that guy needs to be punched in the face.
So we’d own a basic terminal, and pay a subscription for our computing needs.
Gosh, who’d’a thunkit? Never saw that one coming.
why do these so called captains of industry always sound like whiny little bitches? if they’re so smart, come up with a better solution
Somebody kill this cunt on camera and threaten everyone profiting from it that they’re next and man it. People like him deserve to suffer just for our amusement.
That’s the livestream I would actually tune into. Make it a double feature with Trump.
We skip trials when literally everyone already has the evidence.
I would rather Sam Altman gets hit with a car, but here we are.
You can take my ram from my cold dead hands.
Ok Sam, give your computers up first and then we will negotiate.
The problem isn’t the AI, the issue is that the elites are trying to horde it and keep it from us little people. If we are to have agency, having personal ownership over local AI, collectively owned AI, and regulations, are all key to ensuring that democracy and egalitarianism is secure.
The elite will not willingly surrender power, especially there is a void that they can colonize. Ordinary people like us should fill the vacuum, to deny the elite from having total control over AI.
On contrary, we should run all our models locally.
I hate the idea of Sam Altman and I’d like to RAM a data center up his ass
He’d enjoy it.
I for my part have started to be on the lookout for auctioned off cheap PC hardware to build up a spare part depot. I’d rather go back to MS-DOS gaming before I rent a single CPU cycle from these people.
“The entire way people use computing in the whole World should change so that my business model has a small chance of being viable”
– Sam Altman
I mean, he has a point. Hardware is used way more efficiently in the data center, and any sort of deficit is best resolved in a centralized system due to more efficient resource allocation. The same setup could be used like 2 hours a day for your personal needs, or 24 hours a day to serve many people.
THAT SAID, their greed and unsatiable desire to make the number go up by hooking us into subscription economy with ever rising costs is what led us here and it leaves us with little choice but to accept the less efficient way and host these things ourselves.
Remember the times not so long ago when self-hosting was an enthusiast hobby instead of necessity? Barely anyone non-geeky bothered with it, because what existed served people well. Now, having to build our own services remains the only sane choice, and the only way out of the nightmare Sam, among others, has built with his own hands.
Hardware is used way more efficiently in the data center, and any sort of deficit is best resolved in a centralized system due to more efficient resource allocation. The same setup could be used like 2 hours a day for your personal needs, or 24 hours a day to serve many people.
Only for a rather narrow definition of efficiency, though. For raw compute power, yes, but you’d also be adding a whole bunch of overhead from all the network traffic and routing that would be necessary for that sort of thing to work in the first place.
If people used their desktops like in the old days where you’d connect to a mainframe or master computer, you’d end up needing computing hardware on both ends anyway, since the user side would need to be enough to be able to connect and send all the interactions to the master computer. At that point, you could just buff up the client computer, and do all that in the user’s home.
There’s also an argument that some of the basic problems would still apply anyway. A data centre does not fully utilise 100% of its capacity. There’d always be some reserve to have failover if a server dies, or there’s a sudden spike in load, like with a home machine.
It doesn’t fulfill the same user case. One can be used offline, the other cannot. One can be used without a subscription, the other cannot. One needs to be running constantly to meet targets, the other can be run whenever I want. One has that memory being used by very specific services, the other has that memory being used for whatever I want to use it for. Why should we care about an efficiency factor that really only benefits Sam Altman and ignores all other metrics?
If you think he has a point, I think you are being dazzled by the inherent proposition of an implementation in the ideal egalitarian society, which we do not live in nor is he really interested in providing.
The problem is that for less than a year’s subscription I can just buy my own equipment. So yeah it would be more sensible to centralise everything, but as you say the prices are too high.
I keep saying this, AI is not commercially viable yet, it should still be in the lab and they shouldn’t be trying to sell it as a product. Maybe in a few years they’ll be able to distill that down to something that will run on a reasonable amount of hardware and subscription prices can become sensible. There’s no way in hell I’m giving them $200 a month to automate something that I do actually know how to do myself. You can still run out of tokens despite giving them $2,400 a year, so where’s my incentive to not just go and buy a Mac mini?
In theory it can be more efficient but the consumer market never was going to contribute to the scarcity, and the bigger problem is the “must build AI datacenters” by all comers whether or not they actually have a plan to bring up and utilize.
Altman kicked off a corporate hoarding storm by committing half of the world’s DRAM manufacturing supply, then every other corporate had to get in on it.
The result according to a report I read is that over half of the technology delivered to these folks are sitting disused. Because they couldn’t get the right power to the datacenter, or maybe they did get all that lined up but don’t have the business relationship with whomever actually would use the capacity, or they otherwise botched things so their setup is not viable.
The far bigger culprit is the bad datacenter buildout. Vilifying the consumer market is just a better narrative for his agenda.
I might argue with centralized systems being the only ones that allocate resources most efficiently. You can have nearly same efficiency with decentralized models, except they are more complicated to implement, but the diversification is often worth it.
I think you mean effectively not efficiently, the resources use is the same if I local host or use a provider.
The capacity requirement decreases immensely when the setup process isn’t just tap a thing on the app store and then talk to it.
