mixtral-offloading icon indicating copy to clipboard operation
mixtral-offloading copied to clipboard

Published 20 hours ago • verified publisher icon dvmazur

CLI interface added

Open NJannasch opened this issue 1 year ago • 3 comments

This PR adds a small CLI interface to the repository which makes local usage easy.

NJannasch avatar Jan 02 '24 13:01 NJannasch

Hey, @NJannasch! Thanks for the PR and sorry for the long reply. We would like to make sure the script works before merging it. Could you maybe make a Colab notebook that runs the script?

dvmazur avatar Jan 11 '24 13:01 dvmazur

Hi @dvmazur, You can just checkout the branch, install dependencies and then call python3 cli.py as described in my README update.

An example Colab is available here (with some interestingly long responses lol): https://colab.research.google.com/drive/1Dkh0WNJAZD73Q4l4R0Y0T699mnAn6M5f?usp=sharing

NJannasch avatar Jan 11 '24 16:01 NJannasch

I tried it out. This script works. Please merge if possible.

Z-KN avatar Apr 24 '24 05:04 Z-KN