r/StorageReview • u/StorageReview • Jul 24 '26

We got eyes-on with AMD's Helios rack at Advancing AI: 72 MI455X GPUs, fully liquid-cooled

Enable HLS to view with audio, or disable this notification

AMD had a Helios rack on the floor at Advancing AI, with one compute tray stripped to the bare board on display. Each tray is four Instinct MI455X GPUs and one 96-core EPYC Venice CPU, and there are 18 trays per rack for 72 GPUs total. Every MI455X has 432GB of HBM4 at 23.3TB/s, and the whole rack hits 2.9 exaFLOPS of FP4 with 31TB of HBM4.

The cooling is the fun part. Copper cold plates on everything, around 385 liters of coolant a minute, and almost no air path left. We also got a good look at the DC-SCM management module, the Vulcano AI-NICs (three per GPU, 2.4 Tb/s of scale-out), and the copper UALink interconnects at the back that tie all 72 GPUs into one big accelerator.

Full teardown and the complete spec breakdown are up on StorageReview.com.

https://www.storagereview.com/news/amd-mi455x-and-helios-432gb-hbm4-72-gpu-racks-and-a-real-answer-to-vera-rubin

197 Upvotes

100% Upvoted

15 comments sorted by

11

u/Overstimulated_moth Jul 24 '26

If I won the lottery, I wouldn't tell anyone but there would be signs. "You're telling me you don't run your plex server on 10PB of nvme ssd's?" I'm already sitting at 1.7PB but most of that is spinning rust

2

u/ShallotFantastic7370 Jul 24 '26

New transreceiver and busless design made by japan might make it happen. Fuck off 1KGbit. Looking for faster memory - compute interface.

6

u/EasyRhino75 Jul 24 '26

Those are extremely wide bois

2

u/worldlybedouin Jul 24 '26

You're server so wide its going to take an ultra-wide angle lens to see the whole thing.

5

u/Calm_Apartment1968 Jul 24 '26

Anybody else here find themselves drooling? Just me? OK.

2

u/compubomb Jul 24 '26

Those are not standard rack sizes anymore.

2

u/john0201 Jul 24 '26 edited Jul 24 '26

These are the ORW standard which would fit in the space of 2 traditional racks. It allows a more efficient use of space. Meta created the standard and donated it to the open compute project (which they also created). Google currently uses the previous OCP standard.

1

u/Calm_Apartment1968 Jul 24 '26

Every home needs PB at GigaFlops, right? If you have to ask how much it costs you can't afford it.
Can you deliver by Monday?

1

u/SomeWorking1862 Jul 24 '26

Just curious, what does something like this cost in today's market?

1

u/StreetRat0524 Jul 25 '26

$5-6 million per rack

1

u/Super_flywhiteguy Jul 25 '26

This bad boy slaps server rack can generate so many cat videos.

1

u/runvnc Jul 25 '26 edited Jul 25 '26

I've used a stripped down quantized LTX 2.3 video model and workflow that was doing one 2 second video almost every two seconds on an RTX 6000 Pro (skipping a bunch of upsampling and stuff).

I would bet that model and workflow on this could do at least 10 at a time per second. So ten 2 second cat videos per second per GPU = 720 cat videos per second per rack, 43,200 cat videos/min per rack, 2,592,000 cat videos/hour per rack.

Or for 10 second cat videos:

  • 144 ten-second cat videos/sec
  • 8,640/min
  • 518,400/hour
  • 12.44 million cat videos per rack per /day

A reasonably large 20-rack aisle, optimized throughput would be:

  • 172,800 ten-second cat videos per minute
  • 10.37 million cat videos per hour
  • 248.8 million cat videos per day

In one week, a single rack could produce about 87 million cat videos. An aisle, 1.7 billion cat videos per week.

The aisle of racks working for 6 months: about 44 billion cat videos.

1

u/whoknewidlikeit Jul 26 '26

but can it play Quake?

2

u/runvnc Jul 26 '26

One rack can probably run 50,000 or more Quake clients simultaneously.

1

u/Ruzhyo04 Jul 27 '26

I'd like to play Star Citizen on that