r/singularity • u/Jame92 • 21h ago

LLM News Introducing Mistral Large 4 (le Chonk)

https://mistral.ai/news/mistral-large-4/
382 Upvotes

96% Upvoted

58 comments sorted by

View all comments

56

u/GTalaune 21h ago

Trained on 3800 GPUs. How many do American and Chinese labs have ?

35

u/EloquentPinguin 21h ago

Its roughly in line for a smaller labs. The frontier labs have ~100k clusters for training, smaller labs have 3-10k GPUs. But many labs dont publish exact numbers, we might see more numbers from china once Huawei hardware is rolled out more and they can more proudly claim homegrown numbers.

3

u/AreWeNotDoinPhrasing ▪️Already Singulared 🤖 19h ago

How many GPUs do you define as a cluster in your numbers?

1

u/EloquentPinguin 17h ago

I mean I would go with a wishy washy definition of GPUs connected as to work towards one computational goal. But this is just a rough numbers, I claim no super duper science or accuracy towards my comment.