[Feature] Intel Tiber AI Cloud - Terraform - ChatQnA single node using docker compose

[lucasmelogithub]

Priority

Undecided

OS type

Ubuntu

Hardware type

Xeon-EMR

Running nodes

Single Node

Description

Develop Intel Optimized Cloud Module for Terraform and Ansible to automate the deployment.

[lucasmelogithub]

Please assign to @lucasmelogithub

[lucasmelogithub]

Rohit Kulkarni from Intel AI Cloud is finishing development on this. I sent him the issue link.

[Rohit-Intel-Cloud]

Team my observations are as below:

• Deployment of VMs in Intel Cloud is working
• All docker containers for ChatQnA are getting deployed
• UI is up and running
• But when I am trying to use the application, it does not seem to respond to input prompts
• Please see attached image which is for codegen app but I see the same issue with ChatQnA app

[yinghu5]

Hi @lucasmelogithub @Rohit-Intel-Cloud thank you a lot for addressing the problem. So the issue is the ChatQnA UI don't response the input prompt, maybe related ITAC's env (network, security, etc)

I add @louie-tsai @alexsin368 into the loop, they should run the OPEA on ITAC sucessfully. Remind: the ITAC guide:https://opea-project.github.io/latest/getting-started/README.html

Hi Louie, Alex, please help the issue here. thank you!

[alexsin368]

@lucasmelogithub take a look at the Getting Started Guide's ITAC tab that @yinghu5 mentioned. To address the UI issue, you'll either have to port forward port 80 or create a load balancer on ITAC to expose port 80. Reach out to me if you have questions.

[lucasmelogithub]

@Rohit-Intel-Cloud Any updates? @yinghu5 can we please assign this to @Rohit-Intel-Cloud instead?

[yinghu5]

Hi @Rohit-Intel-Cloud ,
thank you for take care of the issue, is there any progress on Intel Tiber AI cloud? [remind]