feature: support for FIM tokens
Feature request
Support for FIM tokens. Here is an example of FIM tokens used in Codegemma: https://github.com/huggingface/blog/blob/main/codegemma.md#prompt-format
Ideally, the FIM tokens should be configurable since different LLMs use different FIM tokens.
Motivation
Currently, avante.nvim does not seem to support FIM tokens, which makes it impossible (in my experience) to use Ollama for auto_suggestions_provider. Adding FIM token support will make it possible.
https://github.com/meeehdi-dev/bropilot.nvim is an example of a plugin that implements FIM support.
Other
No response
Thank you for sharing, I will look into it.
+1 for this one. Same prompt format is used for Qwen 2.5 Coder as well
On the other hand, it might be more reasonable to use minuet for auto-suggestions, as it is much more feature-complete
https://github.com/milanglacier/minuet-ai.nvim
+1 for this one, github copilot has limited. and i test auto-suggestions-provider of avante.nvim and not good just like copilot. and i hope can use deepseek or other providers supported FIM.
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
This feature is still needed
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
This is still needed.
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
still relevant
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
still relevant
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
This issue was closed because it has been stalled for 5 days with no activity.