OpenAdapt
OpenAdapt copied to clipboard
Implement NanoLLaVA completion adapter
Feature request
We would like to implement a local multimodal completion adapter via https://huggingface.co/qnguyen3/nanoLLaVA
Related:
- https://github.com/OpenAdaptAI/OpenAdapt/issues/622
- https://github.com/dusty-nv/NanoLLM/issues/2
Motivation
Reduce latency, support offline mode