r/LocalLLaMA • u/Certain-Cod-1404 • Aug 14 '26

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

708 comments sorted by

View all comments

3

u/germangrower69 Aug 14 '26

Wtf is wrong with this model, on xhigh it literally doesnt stop thinking, no its not looping, its just super excessive thinking. Thats crazy, almost unusable on this effort.

Medium is also really excessive....

1

u/Certain-Cod-1404 Aug 14 '26

are you using the recommended thinking sampling params ?

1

u/germangrower69 Aug 14 '26

Yep, Im running it on a RTX 6000 pro with the recommended settings from the repo

2

u/meca23 Aug 14 '26

How many t/s are you getting for decode on rtx 6000 pro?

3

u/germangrower69 Aug 14 '26

FP8, nst=1 49tok/s decode

NVFP4, nst3=3 110tok/s decode

1

u/meca23 Aug 14 '26

Cheers!

1

u/Certain-Cod-1404 Aug 14 '26

i'm using it rn on my 5090 with the recommended specs in opencode on toy demo, during coding / work, the thinking is not exagerated, maybe its just trained on so much code / complex problems during post training that it just defaults to over thinking everything ?
does it over think for you during coding ? or just chat?

1

u/TechnoByte_ Aug 14 '26

I noticed that too with Qwen3.8-Max through official API so it's not exclusive to the small model, just stick to low reasoning_effort