InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

[Bug] I encountered this problem when deploying flask service. I set the parameters CUDA_VISIBLE_DEVICES=3 when I started the service

Open nixsui opened this issue 6 months ago • 0 comments

Checklist

  • [X] 1. I have searched related issues but cannot get the expected help.
  • [X] 2. The bug has not been fixed in the latest version.
  • [X] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

an illegal memory access was encountered CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1. Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

code: page_recognize_service = PageRecognizeService( model_path=app.config['PPT_PAGE_RECOGNIZE_MODEL_PATH'], device_type=app.config['DEVICE_TYPE'], )

page_content_extract_service = PageContentExtractService( model_path=app.config['PPT_PAGE_CONTENT_EXTRACT_MODEL_PATH'], device_type=app.config['DEVICE_TYPE'], )

class XXXAPI: def init(self): pass

Environment

pytorch2.0.1-cu11.7

Error traceback

No response

nixsui avatar Aug 15 '24 11:08 nixsui