Pierric Cistac

Currently it's not a priority in our pipeline, but we'll welcome any external contribution :)

Unfortunately, the [Tokenizers](https://github.com/huggingface/tokenizers) library used internally for tokenization doesn't provide bindings for the browser but only for Nodejs (see https://github.com/huggingface/tokenizers/issues/63), so you can't use this library with webpack (I suppose...

To clarify a bit all the different numbers: - A file must be uploaded through LFS if: - It's a binary file and its size is > 1MB - It's...

> also, is [this table](https://huggingface.co/docs/hub/api#endpoints-table) supposed to be exhaustive ? do we have an internal endpoints table ? I don't think it is - the internal endpoint table is https://github.com/huggingface/moon-landing/blob/main/server/server.ts...

I pushed a little update in the readme to document the new flag, I hope it's ok :)

There was a very early effort by @mfuntowicz on https://github.com/huggingface/tokenizers/tree/java-binding using Kotlin, maybe it can be a good starting point (or feel free to start from scratch again if you...