microsoft
OLLAMA models support? v1.1.0
Which local model supports running UFO with ollama? I have tried with the latest models, but not a single one worked. python -m ufo --task ollama1
Welcome to use UFO🛸, A UI-focused Agent for Windows OS Interaction.
| | | || | / _
| | | || | | | | |
| || || | | || |
_/ |_| __/
Please enter your request to be completed🛸: open word, bold word breakup Round 1, Step 1, HostAgent: Analyzing the user intent and decomposing the request... Observations👀: None Thoughts💡: None Plans📚: (1) None (2) Next Selected application📲: [The required application needs to be opened.] Messages to AppAgent📩: Status📊: None Comment💬: None Creating an experience indexer... Warning: Failed to load experience indexer from vectordb/experience/experience_db. Creating an demonstration indexer... Warning: Failed to load demonstration indexer from vectordb/demonstration/demonstration_db. Please enter your new request. Enter 'N' for exit.
@saibalz2ai @showkeyjar it is supported, please check this document: https://microsoft.github.io/UFO/supported_models/ollama/
Yes I know about this. But which model is supposed to support? I have tested lama3.2 vision model but it doesn't work.
Thanks Saibal
Get Outlook for Androidhttps://aka.ms/AAb9ysg
From: vyokky @.> Sent: Saturday, November 23, 2024 6:32:13 PM To: microsoft/UFO @.> Cc: saibal dasgupta @.>; Mention @.> Subject: Re: [microsoft/UFO] OLLAMA models support? v1.1.0 (Issue #135)
@saibalz2aihttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_saibalz2ai&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=NITpa31f4CkJ1pTsjfgGGW_p8OOnhi6LM8-_YwhCnV8&e= @showkeyjarhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_showkeyjar&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=PegNbTIpDMqpiF7G9xdQR0lkkEyhLu5aqYAi5OQSz6A&e= it is supported, please check this document: https://microsoft.github.io/UFO/supported_models/ollama/https://urldefense.proofpoint.com/v2/url?u=https-3A__microsoft.github.io_UFO_supported-5Fmodels_ollama_&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=-eQWIfmODOidLonvBpi3O651776UzsnLCnoxUMqPq9s&e=
— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2495472672&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=Xdrr4e9EOZ4jgl1eYhfoqRLn72iA5LHwrnDwQ0nlAOE&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCD5OM3XZAFXO7SMK2D2CB4FLAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOJVGQ3TENRXGI&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=rJyN_doPWxAAvVnnBlQvfRs_1pYE6D8UYysd-R-FID9nLB_GPDIYjmelBKhuVc6V&s=WLp8a0cnoQ6vZCZqA1hHzD8om55LLpizEmtGd4W3qgw&e=. You are receiving this because you were mentioned.Message ID: @.***>
修改了 API_TYPE: "Ollama" ；API_BASE: "http://localhost:11434"；API_MODEL: "llava-llama3"，出现了Creating an experience indexer... Warning: Failed to load experience indexer from vectordb/experience/experience_db. Creating an demonstration indexer... Warning: Failed to load demonstration indexer from vectordb/demonstration/demonstration_db.如何解决？
修改了 API_TYPE: "Ollama" ；API_BASE: "http://localhost:11434"；API_MODEL: "llava-llama3"，出现了Creating an experience indexer... Warning: Failed to load experience indexer from vectordb/experience/experience_db. Creating an demonstration indexer... Warning: Failed to load demonstration indexer from vectordb/demonstration/demonstration_db.如何解决？
@linmiao5 This is only a warning, which will affect the main workflow. Do you encounter other issues?
@linmiao5 At the beginning, llava:7b was used to have a taste on UFO, but due to its own context length limitation, it needs to satisfy the input restriction of llava itself by removing example and other prompts. It is recommended to choose a model that supports a long context to have a try, of course GPT is for sure the best choice.
I always get the connection timeout error when using a localhosted ollama model.
Check ollama access through curl command from the machine you are trying to connect. You will get curl command example from ollama page.
Get Outlook for Androidhttps://aka.ms/AAb9ysg
From: icebilly @.> Sent: Thursday, February 6, 2025 2:28:36 PM To: microsoft/UFO @.> Cc: saibal dasgupta @.>; Mention @.> Subject: Re: [microsoft/UFO] OLLAMA models support? v1.1.0 (Issue #135)
I always get the connection timeout error when using a localhosted ollama model.
— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2639201638&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=GjXkt4Jli7tm_GFsYMZKXT_IGZTUTMitCdj7AgOG7Jj8tGGXa-SVYUtqsbLuEgz4&s=cK8kFrC78KVzg9cHuzCE0FZtNaNecCL1SLV3106pfP4&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCAL5XN6ZGGXYO5U7LL2OMP3ZAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMZZGIYDCNRTHA&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=GjXkt4Jli7tm_GFsYMZKXT_IGZTUTMitCdj7AgOG7Jj8tGGXa-SVYUtqsbLuEgz4&s=2cBA2gHj4-aHHhafoGP0eTaA8Z8OCIs9E3vnWN5a1Co&e=. You are receiving this because you were mentioned.Message ID: @.***>
Check ollama access through curl command from the machine you are trying to connect. You will get curl command example from ollama page.
Get Outlook for Androidhttps://aka.ms/AAb9ysg …
I extend the timeout to 3 mins, the timeout issue gone, but still have the issue you mentioned in the first post.
That doesn't matter with timeout. Host timeout means ollama is not reachable with the given ip:port. I have provided you the example location. Try that. Reg. Deepseek I am not sure ufo supporting this model or not. 1st you resolved the timeout issue.
On 07-Feb-2025 6:48 am, icebilly @.***> wrote:
I use deepseek-r1:14b served with ollama by the way.
— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2641595385&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=B1wYuU2dPv-yfWLlg2cnJ98oWT2uOtZcHxCBQO9EG4qcna_cE7HVOT_pJ0dYOxfC&s=F3ptmuiMwB7NniPVJKJgTA14ov3vB347eShMqKWtHnA&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCDPFOI4Z6QYM57WMQ32OQCWRAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBRGU4TKMZYGU&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=B1wYuU2dPv-yfWLlg2cnJ98oWT2uOtZcHxCBQO9EG4qcna_cE7HVOT_pJ0dYOxfC&s=YtwUmbSl6DfgjUjXgggJZu5Jp5rvloEvnZHVSzkjG5Q&e=. You are receiving this because you were mentioned.Message ID: @.***>
That doesn't matter with timeout. Host timeout means ollama is not reachable with the given ip:port. I have provided you the example location. Try that. Reg. Deepseek I am not sure ufo supporting this model or not. 1st you resolved the timeout issue.
On 07-Feb-2025 6:48 am, icebilly @.***> wrote:
I use deepseek-r1:14b served with ollama by the way.
— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2641595385&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=B1wYuU2dPv-yfWLlg2cnJ98oWT2uOtZcHxCBQO9EG4qcna_cE7HVOT_pJ0dYOxfC&s=F3ptmuiMwB7NniPVJKJgTA14ov3vB347eShMqKWtHnA&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCDPFOI4Z6QYM57WMQ32OQCWRAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBRGU4TKMZYGU&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=B1wYuU2dPv-yfWLlg2cnJ98oWT2uOtZcHxCBQO9EG4qcna_cE7HVOT_pJ0dYOxfC&s=YtwUmbSl6DfgjUjXgggJZu5Jp5rvloEvnZHVSzkjG5Q&e=. You are receiving this because you were mentioned.Message ID: @.***>
the curl command seems ok, below is what I get when using deepseek-r1:14b as the host agent and app agent.
Yes ollama is okay. This what i wrote you. Not sure who can help. I am getting this from all the ollama models.
On 07-Feb-2025 4:05 pm, icebilly @.***> wrote:
That doesn't matter with timeout. Host timeout means ollama is not reachable with the given ip:port. I have provided you the example location. Try that. Reg. Deepseek I am not sure ufo supporting this model or not. 1st you resolved the timeout issue.
On 07-Feb-2025 6:48 am, icebilly @.***> wrote:
I use deepseek-r1:14b served with ollama by the way.
— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2641595385&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=B1wYuU2dPv-yfWLlg2cnJ98oWT2uOtZcHxCBQO9EG4qcna_cE7HVOT_pJ0dYOxfC&s=F3ptmuiMwB7NniPVJKJgTA14ov3vB347eShMqKWtHnA&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCDPFOI4Z6QYM57WMQ32OQCWRAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBRGU4TKMZYGU&d=DwMCaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=B1wYuU2dPv-yfWLlg2cnJ98oWT2uOtZcHxCBQO9EG4qcna_cE7HVOT_pJ0dYOxfC&s=YtwUmbSl6DfgjUjXgggJZu5Jp5rvloEvnZHVSzkjG5Q&e=. You are receiving this because you were mentioned.Message ID: @.***>
the curl command seems ok, below is what I get when using deepseek-r1:14b as the host agent and app agent.
— Reply to this email directly, view it on GitHubhttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_microsoft_UFO_issues_135-23issuecomment-2D2642543959&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=Zs9XSxWZRi2gkeGHmFneBLN9SP96TvNKOBm7jYpFyfm-3hYiJydLzWy1JQP1bILg&s=otM9Du1pAAxcSbtzq3z2C5PNmZJM3o_J-mFVny2wp_Y&e=, or unsubscribehttps://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AZGVKCD4C7MMZI5VFWTWKSL2OSD5DAVCNFSM6AAAAABRDVBHKCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBSGU2DGOJVHE&d=DwMFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=8kZK3igKo8ofL0_RJ4VxHNDpyW3p9Ly_jyMqmaBoeHY&m=Zs9XSxWZRi2gkeGHmFneBLN9SP96TvNKOBm7jYpFyfm-3hYiJydLzWy1JQP1bILg&s=26ZbTARLBgalpnBLrpAxdxUxEmXj3FfEHYALzLOjsrQ&e=. You are receiving this because you were mentioned.Message ID: @.***>
Is there anyone run success by DeepSeek with Ollama? I suppose DeepSeek is not supported yet.
