uniflow-llm-based-pdf-extraction-text-cleaning-data-clustering icon indicating copy to clipboard operation
uniflow-llm-based-pdf-extraction-text-cleaning-data-clustering copied to clipboard

Published 20 hours ago • verified publisher icon CambioML

Define the number of Questions-Answers pairs and q4 or q8 quantization

Open Chasapas opened this issue 1 year ago • 0 comments

🚀 The feature, motivation and pitch

Is it possible to Define the number of Questions-Answers pairs? Also is there an option to load the models in q4 or q8 quantization?

Alternatives

none

Additional context

No response

Chasapas avatar Jul 31 '24 16:07 Chasapas