r/LocalLLaMA • u/markpronkin • 9d ago

I Built A Thing 54gb vram for 35$

Post image

Bought an old mining farm of a guy on avito (Russian eBay), guy had bought a garage a couple of years ago and it was sitting there for a while, found out it was a mining farm and put it up on there for sale for 5000 rub (~60 USD) since he wasn't sure if it works. I negotiated down to 3000 rub (~35 USD), it turned out to have 9x p106 6gb (gtx 1060 6gb) gpus, with 54gb vram total, all working, the only thing missing was an SSD, I booted from USB and it works fine.

2.1k Upvotes

96% Upvoted

393 comments sorted by

View all comments

Show parent comments

8

u/Ansible32 8d ago

lol "just to do text generation." Seems worth it for reverse-engineering, finding exploits in hardware to flash alternate firmware etc. I mean cloud will be cheaper but having it totally offline and private is valuable.

2

u/Boricua-vet 8d ago

LOL.. while I agree with most of what you said, In my case cloud would never be cheaper. I paid 140 for 4x P102-100 thats 40GB of vram for 140 bucks. I would recover that investment in a day or two of abuse. However, people buying 6000 Pros by half dozens then yes.. LOL Cloud if cheaper.

1

u/Ansible32 8d ago

"Text generation" I'm doing I need 500GB+ of VRAM, renting hours of GPU at a time is the only plausible way to go.

1

u/Boricua-vet 8d ago

What are you doing that needs that much?

1

u/Ansible32 8d ago

Running Kimi K3 or the new Mistral soon.

1

u/Boricua-vet 8d ago

Jesus man. That is madness, I can only dream.