rungpt
rungpt copied to clipboard
jina-ai
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
I installed `pip install open_gpt_torch` today. The `opengpt serve stabilityai/stablelm-tuned-alpha-3b --precision fp16 --device_map balanced` command fails because `open_gpt/resources/flow.yml.jinja2` cannot be found. I think it might be missing from the `pip`...
The `open-flagminto-v2` has just been released: https://laion.ai/blog/open-flamingo-v2/ We need to adopt it in opengpt for better compatible with huggingface.
We already implemented passing `past_key_values` to `step_generate()` to enable cache in LLM. `generate()` also support this but should have a different method to implement this since `generate()` will truncate the...
As title, lavis just released a new vision-language instruction-tuning framework using BLIP-2 models, achieving state-of-the-art zero-shot generalization performance on a wide range of vision-language tasks. https://github.com/salesforce/LAVIS/tree/main/projects/instructblip
As title, add mini-gpt4 model [support](https://github.com/Vision-CAIR/MiniGPT-4) - [x] vicuna model support