llama icon indicating copy to clipboard operation
llama copied to clipboard

13B Int8 huggingface space

Open deep-diver opened this issue 2 years ago • 9 comments

Not sure how long I can keep this running

https://huggingface.co/spaces/chansung/LLaMA-13B

deep-diver avatar Mar 06 '23 16:03 deep-diver

doesn't even work

Titaniumtown avatar Mar 06 '23 19:03 Titaniumtown

"Space not ready. Reason: Error, exitCode: 1, message: None"

elephantpanda avatar Mar 07 '23 04:03 elephantpanda

Damn. I got there within the same hour you announced it here, and it did actually work. It was already a little busy, but not too bad. Sucks it's down now, but GG getting something up and running for it so quickly.

Daviljoe193 avatar Mar 07 '23 05:03 Daviljoe193

check https://github.com/juncongmoo/pyllama if you want to run it locally in a single GPU

juncongmoo avatar Mar 07 '23 08:03 juncongmoo

sorry about this guys. I was granted free GPU for 7B and 13B by HuggingFace team, but that was withdrawn today

deep-diver avatar Mar 07 '23 14:03 deep-diver

Looks like it is not allowed to deploy LLaMA in any kind of form

https://huggingface.co/spaces/chansung/LLaMA-7B/discussions/5

deep-diver avatar Mar 07 '23 15:03 deep-diver

Looks like it is not allowed to deploy LLaMA in any kind of form

https://huggingface.co/spaces/chansung/LLaMA-7B/discussions/5

That's unfortunate since weights are not copyrightable. Pity Huggingface 🤗 capitulated. Guess they just want to stay on the good side of Meta.

And it is a cheek to even try to copyright them as they are made with crowd-sourced content such as Wikipedia.

It would be like me printing out articles from Wikipedia in a book and sticking a copyright notice on the cover 😂 Ridiculous.

elephantpanda avatar Mar 07 '23 23:03 elephantpanda

Yeah

But I didnt expose the hard link of the weights. So it looks like the weights should be used soley for personal purpose

deep-diver avatar Mar 07 '23 23:03 deep-diver

It's just Meta trying to stay out of the papers in case it outputs something offensive. It's nothing to do with legality. It's just Meta's PR team at work I expect.

elephantpanda avatar Mar 07 '23 23:03 elephantpanda