Mishig
Mishig
Closes https://github.com/huggingface/tokenizers/issues/873 by implementing `preprocessor::Sequence` [as suggested](https://github.com/huggingface/tokenizers/issues/873#issuecomment-1139511282) by @SaulLu, > Let me just re-share here a design idea that we had - I think - also discussed offline a long...
closes https://github.com/huggingface/tokenizers/issues/933 # Parallelize Unigram Trainer After following @Narsil suggestions, this PR is based on #921 by implementing [MaybeParallelSlice](https://github.com/huggingface/tokenizers/blob/7c78bec52c12aa86b5246a5e73c32d3c3a3e6c78/tokenizers/src/utils/parallelism.rs#L179) ### Here is the benchmark info: > how many cores? [rayon::current_num_threads](https://docs.rs/rayon/latest/rayon/fn.current_num_threads.html)...
### TLDR: implement PDF-chat feature [Update 1 here](https://github.com/huggingface/chat-ui/pull/641#issuecomment-1888851568) Closes #609 When user uploads a PDF: 1. Parse the PDF text, create embeddings, save embeddings in [files bucket](https://github.com/huggingface/chat-ui/blob/chatPDF/src/lib/server/database.ts#L35-L36) (that is also...
Closes #362
See details [here](https://github.com/huggingface/chat-ui/pull/781#discussion_r1478650312) > btw here is another thing to fix with params: (when I change page it should not retain external params)https://huggingface.co/chat/assistants?utm_source=bensbites&utm_medium=referral&utm_campaign=daily-digest-going-out-with-ai&p=1
### Have a tab/picker between "community" or "my" assistants Scenario 1: I'm not logged in Scenario 2: I'm logged in as "mishig" & I go to "?assistants" Scenario 3: I'm...
Companion pr to https://github.com/huggingface/doc-builder/pull/379 Please feel free to merge it yourself
## Tracking progress for publishing the course to [hf.co/learn](https://huggingface.co/learn) - [x] make necessary doc-builder changes https://github.com/huggingface/doc-builder/pull/490 https://github.com/huggingface/doc-builder/pull/491 https://github.com/huggingface/doc-builder/pull/492 - [ ] Publish course to hf.co/learn: - [x] https://github.com/huggingface/diffusion-models-class/pull/76 - [...
Once the course is published to hf.co/learn, bring the french notebooks back from https://github.com/huggingface/diffusion-models-class/pull/76 deletion