Dev Goel

NameError: name 'InputRecorder' is not defined

2

NameError: name 'InputRecorder' is not defined getting this error while create int4 and int4-gptq model

torch.distributed.elastic.multiprocessing.api

6

Traceback (most recent call last): File "/root/anaconda3/envs/opensora/bin/torchrun", line 8, in sys.exit(main()) File "/root/anaconda3/envs/opensora/lib/python3.10/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 347, in wrapper return f(*args, **kwargs) File "/root/anaconda3/envs/opensora/lib/python3.10/site-packages/torch/distributed/run.py", line 812, in main run(args) File "/root/anaconda3/envs/opensora/lib/python3.10/site-packages/torch/distributed/run.py", line...

Triton Inference Server Stops Processing Requests under High Traffic, GPU Utilization Stuck at 100%

3

Bug Description: When the Triton Inference Server experiences high traffic, it appears to freeze and stops processing incoming requests. During this time, the GPU utilization reaches 100% and stays stuck...

### System Info - H200 GPU ### Who can help? _No response_ ### Information - [ ] The official example scripts - [ ] My own modified scripts ### Tasks...