Llama-2-Open-Source-LLM-CPU-Inference icon indicating copy to clipboard operation
Llama-2-Open-Source-LLM-CPU-Inference copied to clipboard

config customization

Open AleksandrTulenkov opened this issue 2 years ago • 0 comments

Hi! Thanks - awesome job.

I have a question - why changing config (bigger chunks, vector counts) lead to broken output? For example: VECTOR_COUNT: 3 CHUNK_SIZE: 600 CHUNK_OVERLAP: 50 Gives me non logic output

AleksandrTulenkov avatar Aug 31 '23 15:08 AleksandrTulenkov