Caogod

Does anybody find outputs difference between vllm inference and AutoClass inference for WizardCoder?

1

I use the same instruction to inference with wizardcoder-python-7B, I found that the result vllm output is different from transformers. instruction: """data = [('Name', 'Age', 'Income'), ('Alice', 53, 2189140), ('Bob',...