exo icon indicating copy to clipboard operation
exo copied to clipboard

Huggingface Inference Engine Added

Open Dead-Bytes opened this issue 9 months ago • 1 comments

  • Tested with smolLM llama model, i am able to process any given model layer by layer
  • Currently testing with the predefined inference engine tests
  • Solving #357

Dead-Bytes avatar Mar 09 '25 06:03 Dead-Bytes

Currently adding gguf filename option too

Dead-Bytes avatar Mar 10 '25 06:03 Dead-Bytes