Dao Trung Thanh

Setup chunk_size_limit

1

How to setup a chunk_size_limit when I devided text in chunks to embed in Vector Database # max LLM token input size max_input_size = 500 # set number of output...

All these structures were converted into Level 2 (##)

2

I converted a PDF file which is a book. The book has a structure with Sections (level 1), Chapters (level 2), and Headings (level 3), but by using Marker, all...

Fail to index

12

``` Traceback (most recent call last): File "/app/danswer/background/indexing/run_indexing.py", line 208, in _run_indexing new_docs, total_batch_chunks = indexing_pipeline( ^^^^^^^^^^^^^^^^^^ File "/app/danswer/utils/timing.py", line 31, in wrapped_func result = func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/danswer/indexing/indexing_pipeline.py",...