crewAI icon indicating copy to clipboard operation
crewAI copied to clipboard

Possible to add RAG and small GUI?

Open fxtoofaan opened this issue 1 year ago • 19 comments

Would love to see some kind of RAG and UI implemented. Thank you

fxtoofaan avatar Dec 27 '23 22:12 fxtoofaan

RAG will be awesome

hugofreire avatar Dec 28 '23 22:12 hugofreire

local RAG and local ollama llm model(s) example code please :)

fxtoofaan avatar Dec 29 '23 00:12 fxtoofaan

Nice, okay I hear you, I'll look into a specific simple RAG default tool maybe and add more ollama examples

joaomdmoura avatar Jan 02 '24 02:01 joaomdmoura

Thanks, @joaomdmoura , I noticed you implemented RAG in the financial analyst example.

https://youtu.be/e0Uj4yWdaAg

okoliechykwuka avatar Jan 03 '24 00:01 okoliechykwuka

@joaomdmoura Thank you for working on adding RAG, this will be huge. The ability for CrewAI to read through a whole folder of documents, pdfs (potentially spreadsheets, ebooks, datasets) as its research source, in place of DuckDuckGoSearch using the internet for research. This would allow people to point the agent towards larger bodies of documents, knowledge, pdfs and ebooks, to help agents tap into local sources for research and responses. This could be incredibly powerful :)

Support for API Embedding to VectorDBs (ChromaDB or Pinecone) using Gemini/ChatGPT API and Local Embedding (Like Instructor-XL) would be great. Although API is likely the preferred option for ease of scalability and speed.

mindwellsolutions avatar Jan 12 '24 04:01 mindwellsolutions

+1

I would really, really like to be able to a) give agents bodies of specific knowledge via RAG

And b) also give them examples of their expected output as docs they can reference.

Maybe (b) can be achieved in prompt, but this would be clunky I feel. Or (b) maybe if we're using ChatGPT4.x, we can feed it a document and hope it understands the format enough to mimic on output.

But definitely (a) giving them specific knowledge would be the next logical step to empowering the agents to do different jobs?

ewebgh33 avatar Jan 20 '24 08:01 ewebgh33

This is getting prioritized to be worked on next

joaomdmoura avatar Jan 21 '24 03:01 joaomdmoura

Excellent news! Very excited.

I think this would really supercharge crewAI and give it the best of both worlds that Autogen (agents) and taskweaver (code-first) have. One of the main things I would love to try is mixing general knowledge with coding ability, and with Autogen/Taskweaver I feel you get one or the other - not both!

ewebgh33 avatar Jan 21 '24 04:01 ewebgh33

Would this help with implementing RAG: https://github.com/KillianLucas/aifs

WismutHansen avatar Jan 29 '24 08:01 WismutHansen

excited

scaruslooner avatar Feb 03 '24 00:02 scaruslooner

AI File System can be used as a tool for crewAI that would unlock RAG-pipelines for local search (file or folder search)

slavakurilyak avatar Feb 04 '24 09:02 slavakurilyak

RAG is now part of the crewai-tools library

slavakurilyak avatar Feb 21 '24 02:02 slavakurilyak

Excited to see the new UI

slavakurilyak avatar Mar 02 '24 13:03 slavakurilyak

bump!!!

bhargav-11 avatar Mar 22 '24 11:03 bhargav-11

don't waste time on a UI. it's orthogonal to the purpose of this library.

airtonix avatar Apr 03 '24 22:04 airtonix

Yup UI us coming, we kept on pushing it to build the backbones of the lib but we will also need it ourselves, so expected it sooner than later

joaomdmoura avatar Apr 03 '24 22:04 joaomdmoura

https://github.com/joaomdmoura/crewAI/issues/18#issuecomment-1955750679 About RAG ^

joaomdmoura avatar Apr 03 '24 22:04 joaomdmoura

Dear @joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up!

magedhelmy1 avatar Apr 30 '24 21:04 magedhelmy1

UI is in the works and scheduled to drop in the next 30d :) Rag is now supported over tools :D

João Moura @joaomdmoura http://twitter.com/joaomdmoura

Em ter., 30 de abr. de 2024 às 18:19, Maged Helmy @.***> escreveu:

Dear @joaomdmoura https://github.com/joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up!

— Reply to this email directly, view it on GitHub https://github.com/joaomdmoura/crewAI/issues/18#issuecomment-2087360532, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFC3N6JZQS4MDOVERYFNS3ZAADGXAVCNFSM6AAAAABBE2PH6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBXGM3DANJTGI . You are receiving this because you were mentioned.Message ID: @.***>

joaomdmoura avatar Apr 30 '24 23:04 joaomdmoura

A lot of people have been drawn to autogen because it's much more comfortable to work with a GUI , rather than code. I see a lot of abandoned attempts and "coming soon", but based on this thread alone it does not seem like it is a priority, please help us understand where it fits into the roadmap. Thank you!

shawnholt avatar Jun 02 '24 01:06 shawnholt

UI is in the works and scheduled to drop in the next 30d :) Rag is now supported over tools :D -- João Moura @joaomdmoura http://twitter.com/joaomdmoura Em ter., 30 de abr. de 2024 às 18:19, Maged Helmy @.> escreveu: Dear @joaomdmoura https://github.com/joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up! — Reply to this email directly, view it on GitHub <#18 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFC3N6JZQS4MDOVERYFNS3ZAADGXAVCNFSM6AAAAABBE2PH6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBXGM3DANJTGI . You are receiving this because you were mentioned.Message ID: @.>

Any update on the UI? Can't wait to get hands-on

YohanReddy avatar Jun 10 '24 14:06 YohanReddy

Is there any news or an ETA from UI?

cbarkinozer avatar Jul 08 '24 13:07 cbarkinozer