Chayenne
哈哈哈，你好，我是清华大学计算机系的 20 级本科生，看到你的博客感觉蛮有意思。我也做过一个类似的项目，感觉蛮好玩的： https://github.com/zhaochenyang20/IAI_2022/tree/main/homework/input-method
In the `project.toml`, we do not require a specific version of `openai` and `litellm`. If a user directly runs `pip install .`, then the newest version of `openai` may not...
I encountered a strange bug of `tiktoken`. Basically, we need to change our `count_tokens_from_string` function: ``` def count_tokens_from_string(string: str, encoding_name: str = "cl100k_base") -> int: """Handle count the tokens in...
https://github.com/neulab/prompt2model/pull/335#issuecomment-1711578817 Another thing is that I am not sure that all the API-based models use tiktoken to compute input tokens. Thus, the num of input tokens may slightly differ between...
https://github.com/neulab/prompt2model/pull/335#discussion_r1319296255 https://github.com/neulab/prompt2model/pull/335#discussion_r1319799726 We need to add a more dedicate cache system.
Our current trainer does not support [MPS](https://huggingface.co/docs/accelerate/usage_guides/mps) training.
Token indices sequence length is longer than the specified maximum sequence length for this model (973 > 512). Running this sequence through the model will result in indexing errors
@Eren Chenyang Zhao 赵晨阳, of course, you can use `on_epoch_end`, but I had a few concerns at that time. (1) What should I do if I want the `eval_strategy` to...
### Checklist - [X] 1. I have searched related issues but cannot get the expected help. - [X] 2. The bug has not been fixed in the latest version. -...
### Checklist - [x] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. - [x]...