本地部署可以但在GKE上部署无法访问

[zhh210]

很奇怪，在自己的macbook上部署之后(docker)访问http://localhost:8080/v1/models是有返回结果的：

{"data":[{"created":1677610602,"id":"gpt-3.5-turbo","object":"model","owned_by":"openai","parent":null,"permission":[{"allow_create_engine":false,"allow_fine_tuning":false,"allow_logprobs":true,"allow_sampling":true,"allow_search_indices":false,"allow_view":true,"created":1677610602,"group":null,"id":"modelperm-89d710796dca","is_blocking":false,"object":"model_permission","organization":"*"}],"root":"gpt-3.5-turbo"},{"created":1677610602,"id":"gpt-4","object":"model","owned_by":"openai","parent":null,"permission":[{"allow_create_engine":false,"allow_fine_tuning":false,"allow_logprobs":true,"allow_sampling":true,"allow_search_indices":false,"allow_view":true,"created":1677610602,"group":null,"id":"modelperm-7cda54b44081","is_blocking":false,"object":"model_permission","organization":"*"}],"root":"gpt-4"}],"object":"list"}

然而同样的docker image在GCP (GKE)上部署并expose 8080之后访问http://xx.xxx.xxx.xxxx:8080/v1/models则是

This site can’t be reached xx.xxx.xxx.xxxx refused to connect.
Try:

Checking the connection
[Checking the proxy and the firewall](chrome-error://chromewebdata/#buttons)
ERR_CONNECTION_REFUSED

登进GKE pod之后显示部署应该是成功了的：

/app # ls
copilot-gpt4-service
/app # ./copilot-gpt4-service 
Cache enabled: true, Cache path: db/cache.sqlite3, Logging: true, LOG_LEVEL: info, Debug: false
Starting server on http://localhost:8080

 非常重要：请不要将此服务公开，仅供个人使用，否则账户或 Copilot 将被封禁。
 Very important: please do not make this service public, for personal use only, otherwise the account or Copilot will be banned.
 非常に重要：このサービスを公開しないでください、個人使用のみにしてください。そうしないと、アカウントまたは Copilot が禁止されます。

/app # netstat -lnt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       
tcp        0      0 127.0.0.1:8080          0.0.0.0:*               LISTEN