jan icon indicating copy to clipboard operation
jan copied to clipboard

feat: Jan can load large model with multiple gguf files

Open hahuyhoang411 opened this issue 1 month ago • 1 comments

Problem Jan is only support 1 gguf model file at a time

Success Criteria We can help users to merge gguf files into 1 and load the model for them

Additional context Approach https://www.reddit.com/r/LocalLLaMA/comments/1cf6n18/how_to_use_merge_70b_split_model_ggufpart1of2/

hahuyhoang411 avatar May 14 '24 03:05 hahuyhoang411