text-generator.io
text-generator.io copied to clipboard
Replace moondream/smol with Gemma multimodal model
Summary
- switch default model paths to Google Gemma
- lazily import torch in link_enricher and use Gemma pipeline for captions
- update example script to use Gemma
- add Gemma multimodal tests and remove old moondream test
- fix inference_server indentation
- skip tests that require unavailable deps
Testing
make test
https://chatgpt.com/codex/tasks/task_e_686c955c50f08333943f0c8d2b633afe