andxalex

Warning on loading quantized model

1

Hello, I'm running base mistral and using bnb to quantize as below: ```python from optimum_benchmark.backends.pytorch.config import PyTorchConfig from optimum_benchmark.benchmarks.inference.config import InferenceConfig from optimum_benchmark.experiment import ExperimentConfig, launch from optimum_benchmark.launchers.process.config import ProcessConfig...