Vedant Roy
Vedant Roy
Happy to remove the line. Is this affecting code?
Done.
Hey! This makes a lot of sense. will look into this.
I think that's a good idea! Doing extra checks is preferable to letting things work by accident :relaxed: I would try submitting a PR for this, but unfortunately I'm a...
> Please see https://snarky.ca/why-you-should-use-python-m-pip/ I'm inside of a virtual environment, but I will try regardless
Got it, and thanks for the fast response! 4 follow-ups (the first one is the most important): 1. Have you released the JSONL for the full set of 230M clips?...
Hey, did you ever manage to make this work?
The error goes away if I use: ``` env FLASHINFER_GROUP_SIZES=8 pip install -e . ```
I need this. This feature can help me avoid transactions. E.g, sometimes you need to delete 3 items and call a function on the id of each of the 3...
I ask, because I see that when using asyncio to generate 100 parallel requests, I see the following output a lot: ``` new fill batch. #seq: 1. #cached_token: 330. #new_token:...