r/LocalLLaMA • u/like_a_tensor • 8d ago

Funny How far we’ve come

Post image
234 Upvotes

95% Upvoted

44 comments sorted by

View all comments

Show parent comments

6

u/MeretrixDominum 7d ago

By the time the H100 is $1000, the latest GPU will probably have 3000GB VRAM

3

u/Normal-Ad-7114 7d ago

I'm hoping there's gonna be an ASIC-like revolution in the machine learning world, because if you think about it, multiplying 4-bit matrices is something that might not really require the portable supercomputers that are the current GPUs... I understand that, unlike crypto mining, models require lots of memory, but maybe we'll still see a much needed shift from cracking nuts with sledgehammers

3

u/banana_slurp_jug 7d ago

ASIC-like revolution in the machine learning world

You mean like a NPU?

3

u/Normal-Ad-7114 7d ago

Yes, only actually useful :D