kaustubhrm comments

Repositories
Issues
Comments

Results 2 comments of


                                            kaustubhrm

[Bug]: Custom Model not supported in Group Chat with Speaker Prompt

any fixes on this issue yet?

AttributeError: 'NoneType' object has no attribute 'replace'

@almersawi You can continue by disabling PYTORCH_TUNABLEOP feature while starting up. its starting up the server still without warmup. `run docker run --device /dev/kfd --device /dev/dri -e PYTORCH_TUNABLEOP_ENABLED=0 ghcr.io/huggingface/text-generation-inference:2.2.0-rocm --model-id...