can we load model on demand as Ollama did

[liaoweiguo]

Self Checks

• [X] I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find any relevant information that meets my needs. English 中文 日本語 Portuguese (Brazil)
• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell us your story.

deploy a service in office for reading my clipboard, but when I don't use it, I want it to automatically unload, maybe 10 minutes

2. What is your suggested solution?

load model on demand as Ollama

3. Additional context or comments

No response

4. Can you help us with this feature?

• [X] I am interested in contributing to this feature.

[liaoweiguo]

ollama.chat has a parameter keep_alive

[None1024Outlook]

ollama.chat has a parameter keep_alive

Models should not be supported for use on ollama

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity.

[github-actions[bot]]

This issue was closed because it has been inactive for 14 days since being marked as stale.