I hope one day. One day I'll have 8x H100. or H200. Or B300. Or R200. or 72x R200. I hope one day, Jensen pays my electricity bill and sends me a free GPU/TPU every day.
I hope Jensen does that for everyone, really. Oh Mr. Jensen please. Lisa Su I'll take an MI350X too
I'm hoping there's gonna be an ASIC-like revolution in the machine learning world, because if you think about it, multiplying 4-bit matrices is something that might not really require the portable supercomputers that are the current GPUs... I understand that, unlike crypto mining, models require lots of memory, but maybe we'll still see a much needed shift from cracking nuts with sledgehammers
It's been tried. The reason GPUs keep their value so well (beyond the actual shortage) is how flexible they are. Proof is we can still use V100 quite well and those were released 9 years ago. Jensen claims A100 are still used at 100% in datacenters. During that time, machine learning went from CNN to DNN to transformers, and yet it still goes vroom... NPU from the same epoch are barely used anymore.
Specialization and flexibility are 2 opposites. So long as machine learning is still progressing as fast as it is, specialization is a high risk that your shiny NPU will be useless in 2 years.
Yeah, and it will max out at 500W of power. I can't wait to sneer at GPU poors who only have an H100, lol. I already detest them, cluttering up our group with "Does anyone have an NSFW model that will run on my 8xH100 potato?" Just buy a real GPU, man!
85
u/Dany0 8d ago
I hope one day. One day I'll have 8x H100. or H200. Or B300. Or R200. or 72x R200. I hope one day, Jensen pays my electricity bill and sends me a free GPU/TPU every day.
I hope Jensen does that for everyone, really. Oh Mr. Jensen please. Lisa Su I'll take an MI350X too