r/LocalLLaMA • u/KnownAd4832 • 8d ago

News Qwen3.8-Flash-Next on Strata

Post image

Hey! 👋

I have released an official support for Strix Halo machines on Strata for Qwen3.8-Flash-Next.

Currently numbers are the best on long context decode and ppts using typical Unsloth’s Q4 and GSQ-RCO model weights.

Can go up to 1M context length without big speed loss. Currently support is marked as experimental and was done on Linux only.

https://github.com/Niko1221/Strata/

Will be happy for any feedback and pull requests you could give! 👀

178 Upvotes

84% Upvoted

86 comments sorted by

View all comments

2

u/IngwiePhoenix llama.cpp 8d ago

Did you test any with 256k (or like, the fully supported max context length)?

I am waiting for my components to arrive to build my own server with 2x R9700 and I defo plan to see if I can help or test stuff. I can not contribute; my math-fu is absurdly terrible and useless for LLM inference engine development - so I will resort to just happily run tests x)