AppFlowy icon indicating copy to clipboard operation
AppFlowy copied to clipboard
Published 2 weeks ago • verified publisher icon AppFlowy-IO

[FR] ollama

Open annieappflowy opened this issue 2 years ago • 10 comments

Description

Could we add the feature of supporting ollama in Appflowy ? It has an API and could be a self-hosted and open source alternative to the OpenAI API

Impact

an API and could be a self-hosted and open source alternative to the OpenAI API

Additional Context

No response

annieappflowy avatar Dec 17 '23 16:12 annieappflowy

Well I would use it exactly like the OpenAI Writer feature. Instead of sending query to Chatgpt url it's send to your ollama API url. There could be an option in settings or while prompting to select which of your installed model to select. Now ollama even supports multimodal models so we could even select in the editor a specific picture and ask to write a description about it (aka using llava). There is so much more possible like having a chatbot on the side, ingest documents and write a summary...

Clovis-krz avatar Dec 17 '23 16:12 Clovis-krz

👋 new to contributing here, can I pick this feature up? @annieappflowy

paulonasc avatar Feb 19 '24 02:02 paulonasc

@paulonasc , thanks for offering the help. Since it's very complex and critical, this task will be handled by the appflowy team. We encourage you to look for alternative issues that may interest you.

annieappflowy avatar Feb 19 '24 19:02 annieappflowy

Is this still in the pipeline ? Should be really easy to implement right ?

bprolifcdev avatar May 20 '24 16:05 bprolifcdev

I saw in the docker-compose.yml you can specify your own API URL, not sure if anyone's tried that yet

Snuupy avatar May 20 '24 17:05 Snuupy

@Snuupy could you point me to where you see it? I'm not seeing it here https://github.com/AppFlowy-IO/AppFlowy/blob/main/frontend/scripts/docker-buildfiles/docker-compose.yml

oc013 avatar Jun 02 '24 10:06 oc013

found it @oc013

https://github.com/AppFlowy-IO/AppFlowy-Cloud/blob/main/docker-compose.yml#L116

Snuupy avatar Jun 02 '24 23:06 Snuupy

Thank you @Snuupy I will need to try to understand what that repo for, I thought everything was here. (I just found AppFlowy yesterday looking for something that integrates with Ollama :smile: )

https://github.com/AppFlowy-IO/AppFlowy-Cloud/pull/512

oc013 avatar Jun 02 '24 23:06 oc013

@Snuupy - have you tried this feature? are you running a self hosted cloud instance?

themantalope avatar Sep 09 '24 00:09 themantalope

@Snuupy - have you tried this feature? are you running a self hosted cloud instance?

@themantalope no, not yet. I paused on continuing to test appflowy back when you could not view/edit databases on mobile but it looks like that was just recently merged. I also don't like the AI paywall so I'm hesitant to sink more time into this.

Snuupy avatar Sep 09 '24 07:09 Snuupy

Any news on prioritizing this @annieappflowy ? Someone offered to help with it and you stated "it's very complex and critical, this task will be handled by the appflowy team" so I'm guessing that people expected the team to pick it up instead of trying it out

oc013 avatar Nov 08 '24 03:11 oc013

@oc013 , We didn’t have the time to do it. If you’ve checked our recent release notes, there aren’t any AI-related features... This is the current status from our side regarding this request: image

The next to-do for the self-hosting solution is to support self-hosting our web app. #5920

annieappflowy avatar Nov 08 '24 04:11 annieappflowy

I have added a reply in https://github.com/AppFlowy-IO/AppFlowy-Cloud/issues/943 which provides more information on this.

khorshuheng avatar Nov 08 '24 04:11 khorshuheng

Supported in the upcoming release (v0.8.7) https://appflowy.com/guide/appflowy-local-ai-ollama

annieappflowy avatar Mar 17 '25 06:03 annieappflowy