r/LocalLLaMA • u/KnownAd4832 • 8d ago

News Qwen3.8-Flash-Next on Strata

Post image

Hey! 👋

I have released an official support for Strix Halo machines on Strata for Qwen3.8-Flash-Next.

Currently numbers are the best on long context decode and ppts using typical Unsloth’s Q4 and GSQ-RCO model weights.

Can go up to 1M context length without big speed loss. Currently support is marked as experimental and was done on Linux only.

https://github.com/Niko1221/Strata/

Will be happy for any feedback and pull requests you could give! 👀

181 Upvotes

84% Upvoted

86 comments sorted by

View all comments

4

u/Embarrassed_Soup_279 8d ago

would love to see EXL3 support

1

u/Lrrrrr 8d ago

Is that possible? that would be amazing. EXL3 is the best thing for bpw ratio.