GenAIExamples
GenAIExamples copied to clipboard
opea-project
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
I completed all the steps in deploying DocSum in our EC2 instance but when I placed a text, it did not give me a summary. I used both svelt based...
The tables on the main page of this repo are confusing. Do I read that ChatQnA is tested and validated on LangChain and LlamaIndex? Is each combination tested with different...
Create a Haystack version of OPEA samples. More details at https://github.com/deepset-ai/haystack/issues/8147
1. When I test LLM backend service: ``` curl http://${host_ip}:9009/generate \ -X POST \ -d '{"inputs":"What is Deep Learning?","parameters":{"max_new_tokens":17, "do_sample": true}}' \ -H 'Content-Type: application/json' ``` In the first startup,...
Many of the `Dockerfile`s install Vim and/or Mesa OpenGL/X packages: ``` $ git grep -l -B1 -e mesa-glx -e '\bvim\b' AudioQnA/langchain/docker/Dockerfile ChatQnA/deprecated/langchain/docker/Dockerfile ChatQnA/docker/Dockerfile CodeGen/deprecated/codegen/Dockerfile CodeGen/docker/Dockerfile CodeTrans/deprecated/langchain/docker/Dockerfile CodeTrans/docker/Dockerfile DocSum/deprecated/langchain/docker/Dockerfile DocSum/docker/Dockerfile Translation/langchain/docker/Dockerfile...
A lot of customers use managed Vector database service. The current examples demonstrate a Vector database as a bundled microservice. To address the SaaS customers, there is a need to...
Using the v0.8 version of [ChatQnA example](https://github.com/opea-project/GenAIExamples/blob/v0.8/ChatQnA/docker/gaudi/compose.yaml), the tgi service fails with heath test. Environment: - OS: ubuntu 22.04 - Docker ce: 27.0.3 - Gaudi sw driver: 1.16.1-c48c5b4 Steps to...
One of OPEA goals is to empower developers to tackle GenAI on their laptops and/or single node settings. The genAI examples run on docker single node instances and for production...
Error Message: When launching vllm service in comps/llms/text-generation/vllm the following error message appears: `api_server.py: error: unrecognized arguments: /bin/bash -c cd / && export VLLM_CPU_KVCACHE_SPACE=40 && python3 -m vllm.entrypoints.openai.api_server --model --host...
Security guidelines would suggest running the containers without root privilege. However, both opea/chatqna-ui and opea/chatqna-conversation-ui requires root privilege to run. It brings potential risk to the system when the UI...
Metadata
Owner
Metadata
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.