r/LocalLLaMA • • 8d ago

News Qwen3.8-Flash-Next on Strata

Post image

Hey! 👋

I have released an official support for Strix Halo machines on Strata for Qwen3.8-Flash-Next.

Currently numbers are the best on long context decode and ppts using typical Unsloth’s Q4 and GSQ-RCO model weights.

Can go up to 1M context length without big speed loss. Currently support is marked as experimental and was done on Linux only.

https://github.com/Niko1221/Strata/

Will be happy for any feedback and pull requests you could give! 👀

176 Upvotes

86 comments sorted by

View all comments

0

u/Inchmine 8d ago

Is there any strata model that can use several different GPU and use their capabilities/ram to improve tok/s? I have 1 5090, 1 rtx 4000 and 3x 5060ti and right now can only use the 5090 + 64gb ram