ggml-org
scripts : exit compare-llama-bench.py gracefully when there's nothing to compare
I stumbled upon this accidentally while testing JSONL (coming soon). I had used two different paths to the same model in consequent tests, causing get_rows not to be able to join the two results.
I wonder though, sometimes you want to compare apples to oranges (like two different models, or at the very least various settings), so it might make sense to broaden the options for comparison in the future?
The script could definitely use more work in general; I wrote the script for myself according to my own needs and while I did contribute it upstream the needs of other users were a secondary concern for me. I think that for people not working on the code the comparisons between commits are maybe not as interesting. So I agree that more options for what to compare would be useful to have.
