No citations

[alexanderchang1]

Hi,

I managed to get a local llama version working, but I noticed it's not giving any citations in my test case (this only has 30-40 papers for now before I scale up). Is there a specific flag somewhere that has to be included to get the citations? It also weirdly truncated the answer. This is with llama-2-7B.

from paperqa import Docs, OpenAILLMModel, print_callback, LlamaEmbeddingModel, SentenceTransformerEmbeddingModel
from openai import AsyncOpenAI

client = AsyncOpenAI(
    base_url="http://10.201.2.222:8010/v1",
    api_key = "sk-no-key-required"
)
docs = Docs(client=client,            
            embedding="llama",
            llm_result_callback=print_callback,
            llm_model=OpenAILLMModel(config=dict(model="my-llama.cpp-llm", temperature=0.1, max_tokens=512)))

Question: What is the role of structural variations in cancer?



Structural variations play a role in cancer by altering gene expression and regulating cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Additionally, structural variations can lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and metabolism. Structural variations can also lead to changes in gene expression by altering chromatin structure and regulating transcription factor activity. Structural variations can also lead to changes in cellular processes such as cell cycle progression, apoptosis, and met