Dan Saattrup Nielsen
Dan Saattrup Nielsen
The `benchmark_dataset` is missing unit tests. There is currently a placeholder test script in `tests/test_benchmark_dataset.py`.
### Your current environment ```text PyTorch version: 2.1.2+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A OS: Ubuntu 20.04.6 LTS (x86_64) GCC...
(I noticed recently that you changed the language filtering GET parameter from `filter` to `language`, but unfortunately my problem still persists) If I [search for Danish models](https://huggingface.co/models?language=da) then models like...
### Fixed - Now recognises the metadata for the new GPT-4o models correctly. Currently there is a version clash between `vllm` and `tiktoken`, meaning that one needs to manually upgrade...