llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

scripts : support arbitrary input file formats in compare-llama-bench.py

Open CISC opened this issue 6 months ago • 3 comments

Refactored git/file handling into specialized classes to support arbitrary input file support.

For now it will fall back to JSONL if sqlite fails, but there is also support for (multiple) JSON and CSV files (see FIXME for the latter though).

CISC avatar May 11 '25 14:05 CISC

I think we should not have two parallel implementations for fetching data; either sqlite data should be using the generic implementation or JSON/JSONL data should be used to fill an SQL database. My personal preference would be SQL but I am willing to compromise depending on what other maintainers prefer.

Hm, ok, so an in-memory database then?

CISC avatar May 11 '25 17:05 CISC

Yes.

JohannesGaessler avatar May 11 '25 18:05 JohannesGaessler

Ok, done.

CISC avatar May 11 '25 19:05 CISC