continue icon indicating copy to clipboard operation
continue copied to clipboard

Cannot start server, no existing method works. Proxy cannot be set.

Open Feiyang opened this issue 1 year ago • 2 comments

Before submitting your bug report

Relevant environment info

- OS: MacOS Intel
- Continue: Continue server version 0.0.350

Description

I am using a proxy to connect to Github, Azure, OpenAI, etc. Therefore, when starting the Continue server, it first hangs at "Downloading MeiliSearch with curl...". My first attempt is to manually start the server in my terminal where the environment variable includes http_proxy. Next, when using the extension, it still cannot send requests to Azure OpenAI. I have seen error messages like Proxy keys should use proper URL forms rather than plain scheme strings. Instead of "https", use "https://". For most of the times, it just hangs forever. As for the trouble shooting guide, nothing works for me.

To reproduce

No response

Log output

No response

Feiyang avatar Dec 10 '23 11:12 Feiyang

@Feiyang Apologies for the slow response here. We've been working on big changes that I think will pretty directly address this issue. As of the most recent pre-release extension versions (0.7.x) Continue no longer requires a separate Python server or Meilisearch. This should solve at least the first of your problems here.

As for the proxy, I expect there might be 1-2 back and forths to get this working, but we have a new proxyServerUrl in VS Code settings that you can use and all requests will be sent through that. This is also only in the newer versions.

sestinj avatar Dec 16 '23 00:12 sestinj

@Feiyang Apologies for the slow response here. We've been working on big changes that I think will pretty directly address this issue. As of the most recent pre-release extension versions (0.7.x) Continue no longer requires a separate Python server or Meilisearch. This should solve at least the first of your problems here.

As for the proxy, I expect there might be 1-2 back and forths to get this working, but we have a new proxyServerUrl in VS Code settings that you can use and all requests will be sent through that. This is also only in the newer versions.

Thanks for your reply. I am so glad to hear that there will be new versions. Here is my development environment, and I wish to see that the new version will work.

  • Client OS: Mac OS
  • Remote SSH Server OS: Ubuntu
  • Model deployment: On some other server where the remote SSH server can connect to. For example, if I deploy a model on the same remote SSH server, the vscode-server should send requests to http://localhost:port directly. If I want to switch to using Azure OpenAI API, I should use an HTTP proxy on the server, by setting some environment variable like http_proxy or https_proxy.

Feiyang avatar Dec 16 '23 12:12 Feiyang