avante.nvim icon indicating copy to clipboard operation
avante.nvim copied to clipboard

feature: support for FIM tokens

Open famiu opened this issue 1 year ago • 6 comments

Feature request

Support for FIM tokens. Here is an example of FIM tokens used in Codegemma: https://github.com/huggingface/blog/blob/main/codegemma.md#prompt-format

Ideally, the FIM tokens should be configurable since different LLMs use different FIM tokens.

Motivation

Currently, avante.nvim does not seem to support FIM tokens, which makes it impossible (in my experience) to use Ollama for auto_suggestions_provider. Adding FIM token support will make it possible.

https://github.com/meeehdi-dev/bropilot.nvim is an example of a plugin that implements FIM support.

Other

No response

famiu avatar Oct 22 '24 15:10 famiu

‌‌‌‌‌‌‌Thank you for sharing, I will look into it.

yetone avatar Oct 22 '24 17:10 yetone

+1 for this one. Same prompt format is used for Qwen 2.5 Coder as well

marchellodev avatar Jan 12 '25 19:01 marchellodev

On the other hand, it might be more reasonable to use minuet for auto-suggestions, as it is much more feature-complete

https://github.com/milanglacier/minuet-ai.nvim

marchellodev avatar Jan 12 '25 20:01 marchellodev

+1 for this one, github copilot has limited. and i test auto-suggestions-provider of avante.nvim and not good just like copilot. and i hope can use deepseek or other providers supported FIM.

hawkinchina avatar Feb 21 '25 03:02 hawkinchina

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Apr 13 '25 02:04 github-actions[bot]

This feature is still needed

famiu avatar Apr 13 '25 13:04 famiu

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Jun 27 '25 02:06 github-actions[bot]

This is still needed.

famiu avatar Jun 27 '25 09:06 famiu

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Aug 27 '25 02:08 github-actions[bot]

still relevant

famiu avatar Aug 29 '25 13:08 famiu

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Sep 29 '25 02:09 github-actions[bot]

still relevant

famiu avatar Sep 29 '25 06:09 famiu

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] avatar Oct 30 '25 02:10 github-actions[bot]

This issue was closed because it has been stalled for 5 days with no activity.

github-actions[bot] avatar Nov 06 '25 02:11 github-actions[bot]