UncleFB
UncleFB
### Is this your first time submitting a feature request? - [X] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations) - [X] I have searched the existing issues, and...
### Is this your first time submitting a feature request? - [X] I have read the [expectations for open source contributors](https://docs.getdbt.com/docs/contributing/oss-expectations) - [X] I have searched the existing issues, and...
``` import mii mii_configs = {"tensor_parallel": 2, "dtype": "fp16", "skip_model_check": True} mii.deploy(task="text-generation", model="/home/chenweisheng/final_models/model-selection-merged/vicuna_13b", deployment_name="vicuna_13b_deployment", mii_config=mii_configs) ``` I tried this , but it didn't work. Just can see output :[2023-09-15 09:02:17,889]...