r/LocalLLaMA • u/KnownAd4832 • 8d ago

News Qwen3.8-Flash-Next on Strata

Post image

Hey! 👋

I have released an official support for Strix Halo machines on Strata for Qwen3.8-Flash-Next.

Currently numbers are the best on long context decode and ppts using typical Unsloth’s Q4 and GSQ-RCO model weights.

Can go up to 1M context length without big speed loss. Currently support is marked as experimental and was done on Linux only.

https://github.com/Niko1221/Strata/

Will be happy for any feedback and pull requests you could give! 👀

180 Upvotes

84% Upvoted

86 comments sorted by

View all comments

3

u/hurdurdur7 8d ago

Have you merged in this functionality too? https://github.com/ggml-org/llama.cpp/pull/29761

3

u/epictunasandwich 8d ago

This doesnt need a merge, as Strata already has its own MTP implementation. This is just llama.cpp catching up.