[BUG]: llama_get_logits_ith(353) returned null

[emulk]

Description

When i try to use the Q&A features, KernelMemory.cs -> await AnswerQuestion(memory, question1);

i have the following exception LLama.Exceptions.GetLogitsInvalidIndexException: 'llama_get_logits_ith(355) returned null'

Reproduction Steps

Run the example Q&A

Environment & Configuration

• Operating system: Windows 10
• .NET runtime version: .net 8
• LLamaSharp version:
• CUDA version (if you are using cuda backend):
• CPU & GPU device:

Known Workarounds

No response

[martindevans]

Some investigation was done into this problem over in #891. It seems like Embeddings=true cannot be set during text generation (see this comment).

[emulk]

not working in my case, i have another error, on SafeLLamaContextHandle.cs System.AccessViolationException: 'Attempted to read or write protected memory. This is often an indication that other memory is corrupt.'

[github-actions[bot]]

This issue has been automatically marked as stale due to inactivity. If no further activity occurs, it will be closed in 7 days.