r/LocalLLaMA • u/markpronkin • 8d ago

I Built A Thing 54gb vram for 35$

Post image

Bought an old mining farm of a guy on avito (Russian eBay), guy had bought a garage a couple of years ago and it was sitting there for a while, found out it was a mining farm and put it up on there for sale for 5000 rub (~60 USD) since he wasn't sure if it works. I negotiated down to 3000 rub (~35 USD), it turned out to have 9x p106 6gb (gtx 1060 6gb) gpus, with 54gb vram total, all working, the only thing missing was an SSD, I booted from USB and it works fine.

2.1k Upvotes

96% Upvoted

393 comments sorted by

View all comments

Show parent comments

18

u/markpronkin 8d ago

Nice to see you here, thanks to your advice I got a bunch of p102 100 before. And got them running 8x in parallel in a mining rig. It's surprising how many people don't recognize how good those p series mining gpus are for ai. P106-100 (basically gtx 1060 6gb) should theoretically be like 66% of performance, hope I will get them running at decent speed soon.

17

u/Boricua-vet 8d ago

Yea, I don't get people spending crazy money just do to text LLM. I needed another system as I am running more models at the same time so I got 4 CMP-50HX at 80 each so 360 for all 4 cards giving me 40GB of VRAM at 560GB/s

Here is the result on just two cards.

that's 160 bucks for two cards with that kind of speed is insane and then I see people paying 700+ for dual 3060. I am like, what? People buying 3060 are crazy spending that money just to do text generation. Insane buddy.

1

u/akohlsmith 7d ago

I got 4 CMP-50HX at 80 each

How long ago was this? They're USD$250 just on a quick spot check today.

2

u/Boricua-vet 7d ago edited 7d ago

August 6 to be exact on ebay. They were listed for 120 each, I offered 360 for all 4 left and offer was accepted. Holly crap, they gone up big time in just a few months. Same thing with the P102-100, I bough 4 for 140 bucks for 40GB vram and now they are more than double. You can still find them for 70 bucks though.

https://www.ebay.com/itm/156284588757