exo icon indicating copy to clipboard operation
exo copied to clipboard
Published 1 month ago • verified publisher icon exo-explore

Removing download task for Shard(model_id='mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated', start_layer=0, end_layer=31, n_layers=32):

Open csmVIc opened this issue 1 year ago • 2 comments

As shown in the picture，Removing download task for Shard，its loading progress is always 0 Snipaste_2024-09-25_15-09-01

csmVIc avatar Sep 25 '24 07:09 csmVIc

me too

Admpeace avatar Oct 11 '24 16:10 Admpeace

This will be fixed with #139 with the torch inference engine

AlexCheema avatar Oct 12 '24 00:10 AlexCheema