Add ollama

[boxabirds]

Very popular local LLM inference server.

[osanseviero]

Thanks for the PR! Unfortunately, I don't think this would work as ollama re-hosts the models themselves. E.g. an example url generated by your PR is https://ollama.com/library/meta-llama/Meta-Llama-3-8B which is a 404 on ollama

[boxabirds]

Right so the deeplink doesn’t work but the other fields should be ok.

On Mon, 20 May 2024 at 15:10, Omar Sanseviero @.***> wrote:

Thanks for the PR! Unfortunately, I don't think this would work as ollama re-hosts the models themselves. E.g. an example url generated by your PR is https://ollama.com/library/meta-llama/Meta-Llama-3-8B which is a 404 on ollama

— Reply to this email directly, view it on GitHub https://github.com/huggingface/huggingface.js/pull/687#issuecomment-2120541560, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABD62IWWTG5TSHKJPWNAFTZDH735AVCNFSM6AAAAABH7VXB2OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRQGU2DCNJWGA . You are receiving this because you authored the thread.Message ID: @.***>

[osanseviero]

The only goal of this button is to work with deeplinks. The button serves no other purpose

[julien-c]

i thinik we could revive this PR but switch to a copy-pasteable command (like llama.cpp) rather than a deeplink

[julien-c]

@boxabirds ok for you if @mishig25 from our team takes over your PR and completes it?

[mishig25]

Ready to be reviewed

Order of operations

• [x] merge https://github.com/huggingface/huggingface.js/pull/967 & deploy @hf.js/gguf
• [x] merge https://github.com/huggingface/huggingface.js/pull/687 (this PR) & deploy @hf.js/tasks
• [x] merge moon

[mishig25]

@coyotte508 could you help me with correctly importing hfjs/gguf inside hfjs/tasks? I did https://github.com/huggingface/huggingface.js/pull/687/commits/acae2361b16331952db23ed6134904dd10b87aa1 & https://github.com/huggingface/huggingface.js/pull/687/commits/b34e76b6d36bb1af9dfafcbea128110298972a59 with command

cd packages/tasks
pnpm add @huggingface/gguf@workspace:^

However, the tests are failing & huggingface/gguf is not visible inside huggingface/tasks

[coyotte508]

@coyotte508 could you help me with correctly importing hfjs/gguf inside hfjs/tasks? I did acae236 & b34e76b with command

cd packages/tasks
pnpm add @huggingface/gguf@workspace:^

However, the tests are failing & huggingface/gguf is not visible inside huggingface/tasks

you can add "prepare": "pnpm run build", in gguf/package.json in the "scripts"

(but not thrilled to add a dep to @huggingface/tasks)

Also https://github.com/huggingface/huggingface.js/issues/887 woudl have fixed it maybe (no need for "prepare" anymore)

[julien-c]

(but not thrilled to add a dep to @huggingface/tasks)

im guessing we could merge tasks and gguf...