guozhong wang

Results 13 issues of guozhong wang

llm_bench
do_not_merge
WIP

1. tools/llm_bench supports multiple images for benchmarking of vlm models. 2. samples/cpp/visual_language_chat supports multiple images for benchmarking of vlm models. 3. samples/cpp/text_generation supports to read prompt from file.

category: llm_bench
category: cmake / build
category: LLM samples
category: VLM samples

category: continuous batching
category: cmake / build