manticoresearch icon indicating copy to clipboard operation
manticoresearch copied to clipboard

WARNING: wordlist size mismatch (size=18, checkpoints=0)

Open klirichek opened this issue 2 months ago • 3 comments

Bug Description:

It looks like we have wrong processing of an empty dictionary loading/writing

CREATE TABLE x ( id bigint, tag bigint );
insert into x values (1,1),(2,2),(3,3);
flush ramchunk x;
insert into x values (4,1),(5,2),(6,3);
flush ramchunk x;

Notice: table contains no ft.

Bug 1. .spi file (when flushing to disk chunk) has size 1. That is wrong, since it should include 'dict-header' Bug 2. (unrelated) total_bytes in .meta is 0. Looks strange.

optimize table x option cutoff=1;
  • .spi file after merging 2 chunks has right size 18.

Bug 3. WARNING: wordlist size mismatch (size=18, checkpoints=0)

UPD: 913b35a3 is relevant (seems need to revert it, then fix the warning)

Manticore Search Version:

checked on b24a9089

Operating System Version:

not depends from system

Have you tried the latest development version?

  • [X] Yes

Internal Checklist:

To be completed by the assignee. Check off tasks that have been completed or are not applicable.

  • [x] Task estimated
  • [x] Specification created, reviewed, and approved
  • [x] Implementation completed
  • [ ] Tests developed
  • [x] Documentation updated
  • [x] Documentation proofread
  • [ ] Changelog updated

klirichek avatar May 01 '24 07:05 klirichek

UPD: https://github.com/manticoresoftware/manticoresearch/commit/913b35a323095f227d87fc32fcd12e749ccb5b2a is relevant (seems need to revert it, then fix the warning)

I can reproduce the warning WARNING: wordlist size mismatch (size=18, checkpoints=0) in the latest dev, but not in 6.2.12.

sanikolaev avatar May 09 '24 11:05 sanikolaev

@PavelShilin89 pls proceed with CLT tests

sanikolaev avatar May 16 '24 09:05 sanikolaev

Please, try to use latest CLT version from the master.

donhardman avatar May 16 '24 09:05 donhardman