AlexPerkin comments

Results 5 comments of


                                            AlexPerkin

Installing LLAMA CUDA libraries and Python bindings ERROR

Maybe this will help `https://github.com/zylon-ai/private-gpt/issues/1584`

Please add Llama3 Prompt support thanks

It may be necessary to change the tokenizer according to [Proper tokenizer.model is absent ](https://huggingface.co/meta-llama/Meta-Llama-3-8B/discussions/12)

Change chunking/splitting method from SentenceWindowNodeParser to SentenceSplitter or SemanticSplitterNodeParser

Try for example `node_parser = SentenceWindowNodeParser.from_defaults(window_size=20)`

Custom LangChain prompt via `config.retriever.custom_prompt`

Could you please provide an example chatdocs.yml for a custom LangChain prompt. Thank you in advance

Custom LangChain prompt via `config.retriever.custom_prompt`

For my part, I would like to offer a prompt designed for Llama 2, which significantly improves the quality of answers: ```shell retriever: custom_prompt: "[INST] Use the following pieces of...