trace.moe icon indicating copy to clipboard operation
trace.moe copied to clipboard

Can it be run on Hugging Face (huggingface.co)? If so, how?

Open My12123 opened this issue 2 years ago • 3 comments

Hugging Face supports the following environments: 2023-01-21_18-24-16 Can it be run on Hugging Face (huggingface.co)? If so, how?

My12123 avatar Jan 21 '23 15:01 My12123

2023-01-21_18-25-36

My12123 avatar Jan 21 '23 15:01 My12123

The current system requires 128GB RAM and ~200GB nvme SSD storage to run. I don't know if it's possbile to run on hugging face.

soruly avatar Jan 22 '23 02:01 soruly

2023-01-21_18-25-36

I checked Huggingface's documentation. They just support running a single docker container now.

If you are familiar with docker-compose, you can use this optimized search engine to try, https://github.com/shotit/shotit/blob/main/docker-compose.yml.

It instead uses a vector database under the hood to provide blazing-fast search functionality. Deployed at a 4V32G Ubuntu machine, it can search 70 million vectors 3700+ episodes in seconds, with long-term RAM of about 20G.

v0.9.3 is working, yet not much documentation is provided at the moment. Sorry.

The procedure is similar to what soruly have described at README here. docker-compose up -d and place /anlist/epsode.mp4 files to volumes/shotit-incoming

git clone https://github.com/shotit/shotit.git

image

Leslie-Wong-H avatar Apr 30 '23 23:04 Leslie-Wong-H

Let's get back to this when hugging face supports docker-compose

soruly avatar Mar 09 '24 17:03 soruly