dify icon indicating copy to clipboard operation
dify copied to clipboard
Published 3 days ago • verified publisher icon langgenius

v1.0.0: 404 Error in Conversation Creation GET Request Hinders Normal Chat

Open opsvr202 opened this issue 10 months ago • 2 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

v1.0.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

The version of Dify I deployed is v1.0.0, deployed via Docker in a pure intranet environment without internet connectivity. For model inference, I use Xinference, and the models include deepseek - r1 - ditill - qwen, bge - large - zh, and beg - reranker - base. When creating a new session, I found that there are errors in GET requests in dify - api, and the error messages are as follows. When sending conversation messages, there are errors related to requests to openapublic.blob.core.windows.net

When rolled back to version v0.15.3, it functions normally.

✔️ Expected Behavior

In version v1.0.0, it can be normally connected to Xinference to achieve normal conversations.

❌ Actual Behavior

It cannot be used normally. There is a 404 error in the dify - api when creating a conversation. The conversation cannot respond normally, and the error message is as follows.

ERROR LOG:
## Error content in the dify-api when creating a conversation process is as follows: 
2025-02-27 19:40:23.100 INFO [Thread-72 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:23] "OPTIONS /api/site HTTP/1.1" 200 
2025-02-27 19:40:23.102 INFO [Thread-73 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:23] "OPTIONS /api/parameters HTTP/1.1" 200 
2025-02-27 19:40:23.113 INFO [Thread-74 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:23] "GET /api/site HTTP/1.1" 404 
2025-02-27 19:40:23.115 INFO [Thread-75 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:23] "GET /api/parameters HTTP/1.1" 404 
2025-02-27 19:40:28.102 INFO [Thread-76 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "OPTIONS /api/conversations?limit=100&pinned=true HTTP/1.1" 200 
2025-02-27 19:40:28.104 INFO [Thread-77 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "OPTIONS /api/conversations?limit=100&pinned=false HTTP/1.1" 200 
2025-02-27 19:40:28.105 INFO [Thread-78 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "GET /api/conversations?limit=100&pinned=true HTTP/1.1" 404 
2025-02-27 19:40:28.125 INFO [Thread-79 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "OPTIONS /api/meta HTTP/1.1" 200 
2025-02-27 19:40:28.128 INFO [Thread-80 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "GET /api/conversations?limit=100&pinned=false HTTP/1.1" 404 
2025-02-27 19:40:28.128 INFO [Thread-81 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "GET /api/meta HTTP/1.1" 404 
2025-02-27 19:40:28.128 INFO [Thread-81 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:40:28] "GET /api/meta HTTP/1.1" 404 

## The error content of the dify-api during the conversation process is as follows: 
2025-02-27 19:41:15.046 INFO [Thread-82 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:15] "OPTIONS /console/api1/installed-apps/679f2ble-df2a-4fe8-ad6f-e4aa9c053271/chat-messages HTTP/1.1" 200 
2025-02-27 19:41:15.088 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - Starting new HTTP connection (1): plugin_daemon:5002 
2025-02-27 19:41:15.089 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - http://plugin_daemon:5002 "GET /plugin/6e269332-9839-4cb6-b021-7fc8605b67a/models?page=1&page_size=256 HTTP/1.1" 200 None 
2025-02-27 19:41:15.125 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - Starting new HTTP connection (1): plugin_daemon:5002 
2025-02-27 19:41:15.130 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - http://plugin_daemon:5002 "POST /plugin/6e269332-9839-4cb6-b021-7fc8605b67a/dispatch/model/schema HTTP/1.1" 200 None 
2025-02-27 19:41:15.136 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - Starting new HTTP connection (1): plugin_daemon:5002 
2025-02-27 19:41:15.140 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - http://plugin_daemon:5002 "POST /plugin/6e269332-9839-4cb6-b021-7fc8605b67a/dispatch/model/schema HTTP/1.1" 200 None 
2025-02-27 19:41:15.154 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - Starting new HTTP connection (1): plugin_daemon:5002 
2025-02-27 19:41:15.157 DEBUG [Thread-83 (process_request_thread)] [connectionpool.py:544] - http://plugin_daemon:5002 "POST /plugin/6e269332-9839-4cb6-b021-7fc8605b67a/generate_worker HTTP/1.1" 404 
2025-02-27 19:41:15.224 ERROR [Thread-85 (generate_worker)] [app_generator.py:243] - Unknown Error when generating 
Traceback (most recent call last):
  File "/app/api/core/app/apps/chat/app_generator.py", line 223, in _generate_worker
    runner.run()
  File "/app/api/core/app/apps/chat/runner.py", line 58, in run
    self.get_pre_calculate_rest_tokens()
  File "/app/api/core/app/apps/base_app.py", line 86, in get_pre_calculate_rest_tokens
    prompt_tokens = model_instance.get_llm_num_tokens(prompt_messages)
  File "/app/api/core/model_manager.py", line 195, in get_llm_num_tokens
    self._round_robin_invoke(
  File "/app/api/core/model_manager.py", line 370, in _round_robin_invoke
    return function(*args, **kwargs)
  File "/app/api/core/runtime/model_providers/__base/large_language_model.py", line 299, in get_num_tokens
    return self.model_manager.get_llm_num_tokens( 
  File "/app/api/core/plugin/manager/model.py", line 231, in get_llm_num_tokens
    for resp in response:
  File "/app/api/core/plugin/manager/base.py", line 189, in _request_with_plugin_daemon_response_stream
    self.handle_plugin_daemon_error(error.error_type, error.message)
  File "/app/api/core/plugin/manager/base.py", line 221, in _handle_plugin_daemon_error
    raise PluginInvokeError(description=message)
core.plugin.manager.Err.PluginInvokeError: PluginInvokeError: {"args":{},"error_type":"ConnectionError","message":"HTTPSConnectionPool(host='openapublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt - 2/encodings/main/vocab.bpe (Caused by NameResolutionError(\"[Errno - 2] Name or service not known\",))"}
2025-02-27 19:41:15.227 DEBUG [Thread-83 (process_request_thread)] [based_generate_task_pipeline.py:45] - error: PluginInvokeError: {"args":{},"error_type":"ConnectionError", "message":"HTTPSConnectionPool(host='openapublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt - 2/encodings/main/vocab.bpe (Caused by NameResolutionError(\"[Errno - 2] Name or service not known\",))"}
2025-02-27 19:41:15.237 ERROR [Thread-83 (process_request_thread)] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"ConnectionError","message": "HTTPSConnectionPool(host='openapublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt - 2/encodings/main/vocab.bpe (Caused by NameResolutionError(\"[Errno - 2] Name or service not known\",))"}
2025-02-27 19:41:15.237 INFO [Thread-83 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:15] "POST /console/api1/installed - apps/6f9f2ble - dfa2 - 4fe8 - ad6f - e4aa9c053271/chat - messages HTTP/1.1" 200 
2025-02-27 19:41:15.245 INFO [Thread-86 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:15] "OPTIONS /console/api1/installed - apps/6f9f2ble - dfa2 - 4fe8 - ad6f - e4aa9c053271/conversations?limit=100&pinned=false HTTP/1.1" 200 
2025-02-27 19:41:15.265 INFO [Thread-87 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:15] "GET /console/api1/installed - apps/6f9f2ble - dfa2 - 4fe8 - ad6f - e4aa9c053271/conversations?limit=100&pinned=false HTTP/1.1" 200 
2025-02-27 19:41:20.533 INFO [Thread-89 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:20] "OPTIONS /api/parameters HTTP/1.1" 200 
2025-02-27 19:41:20.535 INFO [Thread-90 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:20] "OPTIONS /api/site HTTP/1.1" 200 
2025-02-27 19:41:20.539 INFO [Thread-91 (process_request_thread)] [internal.py:97] - 172.20.0.10 - [27/Feb/2025 11:41:20] "OPTIONS /api/conversations?limit=100&pinned=false HTTP/1.1" 200

opsvr202 avatar Feb 27 '25 12:02 opsvr202

I found a similar unsolved discussion regarding a "dify-web:1.0.0 not found" issue, which might be related to the versioning or deployment problems you're experiencing [1].

The 404 errors you're encountering in Dify v1.0.0 when creating conversations could be due to changes in API endpoints or configurations that are not compatible with a pure intranet environment. The error logs indicate that the system is trying to access external resources, such as openapublic.blob.core.windows.net, which is not possible without internet connectivity.

To address this, you might need to:

  1. Verify if there are any configuration settings in Dify v1.0.0 that require internet access and adjust them for a local setup.
  2. Check if there are any new dependencies or changes in API endpoints from v0.15.3 to v1.0.0 that could affect your setup.
  3. Consider using local resources or mock services to replace external dependencies that are not accessible in your environment.

If rolling back to v0.15.3 resolves the issue, it suggests that the problem is specific to changes introduced in v1.0.0. You may want to compare the configurations and dependencies between these versions to identify the exact cause.

To continue talking to Dosu, mention @dosu.

Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

dosubot[bot] avatar Feb 27 '25 12:02 dosubot[bot]

We haven't released the 1.0.0 yet.

crazywoola avatar Feb 27 '25 12:02 crazywoola