VamsiYK

Results 2 issues of VamsiYK

Please fix hf demo for inference. Thanks.

unable to run this on cuda 12 , it requires 10.2 , how to run in cuda 12 ?