Catherine Lee

icon indicating a website link https://www.linkedin.com/in/~catherine/ icon indicating an email [email protected]

icon location San Francisco, CA icon location Current MLE at Lamini AI. Formly Google, Snap ML, Adobe ML, Amazon

Results 2 issues of Catherine Lee

[V1][core] Support allowed_token_ids in V1 sampler

2 comment

Introduce allowed_token_id support in v1 Sampler. Tested with: pytest tests/v1/sample/test_sampler.py -k "test_sampler_allowed_token_ids" Fixes #13058

v1

Loading Dataset returns error from huggingface

running this: ``` from datasets import load_dataset dataset = load_dataset("alexshengzhili/mllm-dpo",split='train[0:1]',trust_remote_code=True) ``` returns this error: ArrowInvalid Traceback (most recent call last) /usr/local/lib/python3.10/dist-packages/datasets/packaged_modules/json/json.py in _generate_tables(self, files) 121 try: --> 122 pa_table =...