bug: Unable to detect manually imported Model

[dan-menlo]

Describe the bug

To Reproduce Steps to reproduce the behavior:

• JasonB from Discord is unable to get Jan to detect manually imported model (from creating folder and pasting GGUF file in)

Expected behavior A clear and concise description of what you expected to happen.

Screenshots

Desktop (please complete the following information):

• OS: [e.g. iOS]
• Browser [e.g. chrome, safari]
• Version [e.g. 22]

Additional context

• [ ] Dan's note: Need to have better documentation than the Quickstart
• [ ] Dan's note: Need to have very clear instructions for how to "manually import" a Model to Jan

[dan-menlo]

Fix from @louis-jan:

Add:

"state": "ready",
"engine": "nitro"

[dan-menlo]

On second thoughts, I'm re-opening this as I think this is a logic error. We should be scanning the /models directory and indicating state: ready if there is a valid GGUF or .bin file.

We should not need the user to manually update the model.json for a state variable.

[ddh0]

I'm having a similar issue. I'm following the guide and I'm unable to get my model to show up in Jan, either on the models page or on the Hub. And now when I open the hub the app crashes 😅

I'm trying to add my own model, orcamaid-v2-13b from TheBloke's GGUF release. I've attached the model.json, a screenshot of the ./jan folder, and a screenshot of the ./orcamaid-v2-13b folder.

(edit: this is the model I'm trying to add)

my model.json

Let me know if there's anything I can do.

[louis-jan]

Here is the corrected version @ddh0. The "state" should only have one value model.json

[louis-jan]

Should be addressed by this #1028

[freelerobot]

fixed