iris_android icon indicating copy to clipboard operation
iris_android copied to clipboard

Importing Custom Model

Open SatoX69 opened this issue 1 year ago • 1 comments

Hey, Could you add some sort of option for importing external GGUF models? Like I have a llama 3.2 gguf file downloaded but I have no idea how to import it, I tried placing the llama model as the stableLm model mentioned in the app on the files directory in the data storage, It didn't work. Also maybe remove the initial "Download" option since people may import it or add an option to directory download the model from Huggingface.

SatoX69 avatar Oct 13 '24 05:10 SatoX69

Updates

  • Latest master finally has built-in chat handing
  • In process of integrating model management

Discussion

  • Ability to load on-device gguf is feature we plan to add later ( this app currently doesn't require storage permissions)
  • We are adding the ability to parse huggingface file url to handle custom models

Kid-Kisuke avatar Dec 09 '24 16:12 Kid-Kisuke