luoruijie

lac = LAC(mode='lac') File "D:\project\sentence.mining.model\auto.summarization\venv\lib\site-packages\LAC\lac.py", line 65, in __init__ model = LacModel(model_path, mode, use_cuda) File "D:\project\sentence.mining.model\auto.summarization\venv\lib\site-packages\LAC\models.py", line 233, in __init__ super(LacModel, self).__init__(model_path, mode, use_cuda) File "D:\project\sentence.mining.model\auto.summarization\venv\lib\site-packages\LAC\models.py", line 66, in __init__...

adalomo is not a valid OptimizerNames

2

### System Info torch==2.3.0+cu121 transformers==4.41.2 trl==0.9.4 ### Who can help? @ArthurZucker @muellerzr @SunMarc ### Information - [X] The official example scripts - [ ] My own modified scripts ### Tasks...

how to use fp8 for inference on h20?

7

I have a problem, that is, the model I am currently deploying is: neuralmagic/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic. The graphics card is h20. I would like to ask how to infer the fp8 capability...