add upload for models

[iHaagcom]

Can you please provide an example of how to load a .bin model please?

[Cellenseres]

I'd like to know how to add my LLama and Alpaca Models as well. One of these is located at Z:\AI\dalai\alpaca\models\30B\ggml-model-q4_0.bin for example Would be cool to know how o at local Models

[iHaagcom]

Even .pt models, there isn't much instruction for these either.

[iHaagcom]

Just tried openplayground run -m "e:\Machine Learning\ggml-alpaca-7b-native-q4.bin"

Machine Learning\gpt4all-lora-quantized.bin" Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code return codecs.charmap_decode(input,self.errors,decoding_table)[0] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ MemoryError

[AlexanderLourenco]

We will add examples in the next couple of days :) Unfortunately, you won't be able to load .pt files directly. Instead, you'd have to create a WebSocket server wrapper so that the UI can communicate with external models

[iHaagcom]

We will add examples in the next couple of days :)

Unfortunately, you won't be able to load .pt files directly. Instead, you'd have to create a WebSocket server wrapper so that the UI can communicate with external models

What about .bin models?

[mmyjona]

We will add examples in the next couple of days :)

Unfortunately, you won't be able to load .pt files directly. Instead, you'd have to create a WebSocket server wrapper so that the UI can communicate with external models

What about .bin models?

check my pr

[iHaagcom]

Awesome looking forward to it.