[Bug]CodeGen sample giving ClientConnectorError in Docker logs

[arun-gupta]

Priority

Undecided

OS type

Ubuntu

Hardware type

Xeon-SPR

Installation method

• [X] Pull docker images from hub.docker.com
• [ ] Build docker images from source

Deploy method

• [X] Docker compose
• [ ] Docker
• [ ] Kubernetes
• [ ] Helm

Running nodes

Single Node

What's the version?

latest

Description

Trying to run CodeGen example following the instructions at https://github.com/opea-project/GenAIExamples/tree/main/CodeGen. This is on a Ubuntu VM running on AWS and using Docker Compose.

Reproduce steps

https://gist.github.com/arun-gupta/5f02b5a57030ba8f975a4c328178ffe8

Raw log

Here is the log of containers starting:


[+] Running 5/5
 ✔ Network ubuntu_default                 Created                                                                                                                         0.1s 
 ✔ Container tgi-service                  Started                                                                                                                         0.3s 
 ✔ Container llm-tgi-server               Started                                                                                                                         0.4s 
 ✔ Container codegen-xeon-backend-server  Started                                                                                                                         0.5s 
 ✔ Container codegen-xeon-ui-server       Started                                                                                                                         0.7s 
ubuntu@ip-172-31-50-223:~$ sudo docker container ls
CONTAINER ID   IMAGE                    COMMAND                  CREATED          STATUS          PORTS                                       NAMES
cf6b5b1e3093   opea/codegen-ui:latest   "docker-entrypoint.s…"   11 seconds ago   Up 10 seconds   0.0.0.0:5173->5173/tcp, :::5173->5173/tcp   codegen-xeon-ui-server
f254ea57134f   opea/codegen:latest      "python codegen.py"      11 seconds ago   Up 10 seconds   0.0.0.0:7778->7778/tcp, :::7778->7778/tcp   codegen-xeon-backend-server
214a9a1db4b1   opea/llm-tgi:latest      "bash entrypoint.sh"     11 seconds ago   Up 11 seconds   0.0.0.0:9000->9000/tcp, :::9000->9000/tcp   llm-tgi-server

sudo docker logs llm-tgi-server gives the following:

        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/.local/lib/python3.11/site-packages/aiohttp/connector.py", line 564, in connect
    proto = await self._create_connection(req, traces, timeout)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/.local/lib/python3.11/site-packages/aiohttp/connector.py", line 975, in _create_connection
    _, proto = await self._create_direct_connection(req, traces, timeout)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/.local/lib/python3.11/site-packages/aiohttp/connector.py", line 1350, in _create_direct_connection
    raise last_exc
  File "/home/user/.local/lib/python3.11/site-packages/aiohttp/connector.py", line 1319, in _create_direct_connection
    transp, proto = await self._wrap_create_connection(
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/.local/lib/python3.11/site-packages/aiohttp/connector.py", line 1088, in _wrap_create_connection
    raise client_error(req.connection_key, exc) from exc
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host 172.31.50.223:8028 ssl:default [Connect call failed ('172.31.50.223', 8028)]