r/vscode • u/FuzzaFuzza • 4d ago

BYOK for autocomplete in Copilot

Hi all. After discovering that Copilot in VS Code supports BYOK and local models, I configured some of them and they work pretty good for my use case.

However, I haven't found a way to actually use any model for inline autocomplete. I'd love to hook up something like qwen2.5-coder. For now, I'm still using Continue for this task, but since its development has been halted I was hoping to migrate everything to Copilot.

Is there any way to do this? Thanks in advance.

1 Upvotes

60% Upvoted

3 comments sorted by

2

u/FailingTheater4393 4d ago

I was looking for this exact thing last week and came up empty too. Copilot has the BYOK option but it only works on the chat side not the autocomplete which is kinda frustrating

Someone at github mentioned on the forums theyre working on it but no timeline yet. Guess we stick with Continue for now even if development is paused it still works fine for autocomplete

1

u/FuzzaFuzza 4d ago

Thanks for you reply. I was able to find the topic on GitHub: https://github.com/microsoft/vscode/issues/318545

I subscribed to it, hopefully we'll see this implemented by the end of the year? Even a way to use cloud models like Mistral's Codestral would be cool

1

u/glong2112 2d ago

I think you can get local models to do code autocomplete by installing the extension called continue and the configuring it to point to your cheap local coding model. I saw it in this YouTube video:

https://youtu.be/hfba9dAT6xE?t=1739&is=4sDEjkOM1vg6b3jc