a single document was longer than the context. should not happen as we split documents

[STOI123]

What happened?

Error Statement

No response

Smart Second Brain Version

0.6.0

Debug Info

[PAPA] Retrieved Docs (1000) [AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, AY, …] [0 … 99] [100 … 199]

PAPA] Running RAG... Input: {isRAG: true, userQuery: '我有在哪里描述了我个人的生活细节吗', chatHistory: 'Assistant: Hello, I am your assistant. How can I h…ts by length in post processing!,). Please retry.', lang: 'en'} chatHistory : "Assistant: Hello, I am your assistant. How can I help you?\nUser: 我有在哪里描述了我个人的生活细节吗\nAssistant: Failed to run Smart Second Brain (Error: ,Error: A single document was longer than the context length. Should not happen as we split documents by length in post processing!,). Please retry.\nUser: 我有在哪里描述了我个人的生活细节吗\n\n\nAssistant: Failed to run Smart Second Brain (Error: ,Error: A single document was longer than the context length. Should not happen as we split documents by length in post processing!,). Please retry." isRAG : true lang : "en" userQuery : "我有在哪里描述了我个人的生活细节吗" [[Prototype]] : Object

[jkunczik]

I get the same error. However, I do only see it as a notification in obsidian, not in the console (although the debugging console is enabled)

Obsidian Log:

[PAPA] Running RAG... Input: {isRAG: true, userQuery: 'Gib mir eine Zusammenfassung über meine Aufgaben.', chatHistory: 'Assistant: Hallo, ich bin dein Assistent. Ich gebe…wenn ich nicht sicher über einen Sachverhalt bin.', lang: 'de'}chatHistory: "Assistant: Hallo, ich bin dein Assistent. Ich gebe kurze und prägnante Antworten und suche dir die relevanten Informationen heraus. Dabei gebe ich dir immer Quellen an und sage, wenn ich nicht sicher über einen Sachverhalt bin."isRAG: truelang: "de"userQuery: "Gib mir eine Zusammenfassung zum Dedalus Architektur-Review"[[Prototype]]: Object

ollama log:

Apr 22 14:21:51 llm ollama[5355]: {"function":"process_single_task","level":"INFO","line":1506,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":16,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"log_server_request","level":"INFO","line":2734,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":41390,"status":200,"tid":"140625005064192","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"process_single_task","level":"INFO","line":1506,"msg":"slot data","n_idle_slots":1,"n_processing_slots":0,"task_id":17,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"log_server_request","level":"INFO","line":2734,"method":"GET","msg":"request","params":{},"path":"/health","remote_addr":"127.0.0.1","remote_port":41390,"status":200,"tid":"140625005064192","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"launch_slot_with_data","level":"INFO","line":830,"msg":"slot is processing task","slot_id":0,"task_id":18,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"update_slots","level":"INFO","line":1836,"msg":"kv cache rm [p0, end)","p0":0,"slot_id":0,"task_id":18,"tid":"140626095165440","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[5355]: {"function":"update_slots","level":"INFO","line":1640,"msg":"slot released","n_cache_tokens":21,"n_ctx":2048,"n_past":21,"n_system_tokens":0,"slot_id":0,"task_id":18,"tid":"140626095165440","timestamp":1713788511,"truncated":false}
Apr 22 14:21:51 llm ollama[5355]: {"function":"log_server_request","level":"INFO","line":2734,"method":"POST","msg":"request","params":{},"path":"/embedding","remote_addr":"127.0.0.1","remote_port":41390,"status":200,"tid":"140625005064192","timestamp":1713788511}
Apr 22 14:21:51 llm ollama[2108]: [GIN] 2024/04/22 - 14:21:51 | 200 |  105.618767ms |   XXX.XXX.100.67 | POST     "/api/embeddings"

[richardstevenhack]

I get the same error.