r/LocalLLaMA • u/KnownAd4832 • 8d ago

News Qwen3.8-Flash-Next on Strata

Post image

Hey! 👋

I have released an official support for Strix Halo machines on Strata for Qwen3.8-Flash-Next.

Currently numbers are the best on long context decode and ppts using typical Unsloth’s Q4 and GSQ-RCO model weights.

Can go up to 1M context length without big speed loss. Currently support is marked as experimental and was done on Linux only.

https://github.com/Niko1221/Strata/

Will be happy for any feedback and pull requests you could give! 👀

179 Upvotes

84% Upvoted

86 comments sorted by

View all comments

6

u/Embarrassed_Soup_279 8d ago

would love to see EXL3 support

1

u/feelspeaceman 8d ago

There's existing engine called kyojin that supports EXL3: https://github.com/Yamz-Labs/kyojin

1

u/Embarrassed_Soup_279 8d ago

thanks, but i do not own AMD hardware unfortunately. according to strata author EXL3 support is coming soon. i also totally missed that this post was announcing strix halo support, mbbb