exo icon indicating copy to clipboard operation
exo copied to clipboard

How to add more models to exo?

Open mkamranr opened this issue 2 months ago • 1 comments

As of now there are only 22 models getting listed to be downloaded. How can we add more models?

Another question is that where the models are getting downloaded?

mkamranr avatar Dec 31 '25 05:12 mkamranr

Adding following to main/src/exo/shared/models/model_cards.py file will help inserting more models?

"deepseek-v3.2-8bit": ModelCard( short_id="deepseek-v3.2-8bit", model_id=ModelId("mlx-community/DeepSeek-V3.2-8bit"), name="DeepSeek V3.2 (8-bit)", description="""DeepSeek V3.2 is a large language model trained on the DeepSeek V3.2 dataset.""", tags=[], metadata=ModelMetadata( model_id=ModelId("mlx-community/DeepSeek-V3.2-8bit"), pretty_name="DeepSeek V3.2 (8-bit)", storage_size=Memory.from_gb(756), n_layers=61, hidden_size=7168, supports_tensor=True, ), ),

mkamranr avatar Dec 31 '25 06:12 mkamranr

Duplicate of https://github.com/exo-explore/exo/issues/1011 It's being worked on in https://github.com/exo-explore/exo/pull/937

AlexCheema avatar Dec 31 '25 15:12 AlexCheema