HPT
HPT copied to clipboard
HPT - Open Multimodal LLMs from HyperGAI
Using command line to inference a same image with multiple questions maybe not convenient. If there is a webui that maybe more easier. I make a simple gradio webui demo...
Hi, thank you for this work. How to quantize it to use int8? Any comments are appreciated.
Hi, great work! You can create a PR to [VLMEvalKit](https://github.com/open-compass/VLMEvalKit) to support the HPT model, and we will help review and merge!
(HPT) D:\HPT>python demo/demo.py --image_path demo/einstein.jpg --text 'Question: What is unusual about this image?\nAnswer:' --model hpt-air-demo usage: demo.py [-h] --image_path IMAGE_PATH [IMAGE_PATH ...] --text TEXT --model MODEL [--nproc NPROC] [--verbose] demo.py:...
Will opensource the HPT Pro?
Congrats on the release! Where can I find more info about this Hformer? The blog post does not give many details.
PS E:\HyperGAI\hpt> python demo/demo.py --image_path demo/einstein.jpg --text 'What is unusual about this image?' --model hpt-edge-1-5 Matplotlib is building the font cache; this may take a moment. `flash-attention` package not found,...