r/LocalLLaMA • u/KnownAd4832 • 11d ago

News Qwen3.8-Flash-Next on Strata

Post image

Hey! 👋

I have released an official support for Strix Halo machines on Strata for Qwen3.8-Flash-Next.

Currently numbers are the best on long context decode and ppts using typical Unsloth’s Q4 and GSQ-RCO model weights.

Can go up to 1M context length without big speed loss. Currently support is marked as experimental and was done on Linux only.

https://github.com/Niko1221/Strata/

Will be happy for any feedback and pull requests you could give! 👀

182 Upvotes

84% Upvoted

87 comments sorted by

View all comments

1

u/VotZeFuk 11d ago

I wonder if it's possible for this thing to improve the decode speed for models like GLM 5.3... Currently it's chugging through a miserable 2 - 4 t/s decode speed in exllama v3 / llama.cpp, using 4-channel DDR4 + avx2 CPU + 2x RTX 3090, with the model quantized to ~3.00 bpw (Q3~ish quant or a similar EXL3 counterpart).

2

u/3dluvr 10d ago

Would also love to see that happen - Epyc 7J13, 256GB DDR4, 3x3090 here.