Leandro von Werra

Maybe this helps? https://stackoverflow.com/questions/59690698/modulenotfounderror-no-module-named-lzma-when-building-python-using-pyenv-on

Not yet. There is an issue with the sync mechanism between the hub and the library which is why we had to roll back #169. Merging it will break pre...

Closing this for now, let me know if you are still facing the issue with `0.3.0`

We tried to make dicts for most metric, but it's possible we missed those. Yes, feel free to open a PR, but we should also check that some of the...

Thanks for the discussion here. Indeed, it can depend a lot on the hyperparameters as well as the task. Great you found that increasing the BS works. I think this...

Yes, usually list of tensors are converted to histograms automatically (see rewards or ratios). Not sure what happened there but if you want to take a look that would be...

When you use `evaluate` the model remains local - you don't need to upload it! Most modules just take the predictions that you can generate wherever you like!

does the following work? ```python perplexity.compute(predictions=texts, model_id='PATH_TO_MY_MODEL') ```

Closing for now since there is not a lot of activity right now. Feel free to reopen :)

Thanks for the PR! I don't quite follow why the tokenizer id would be different from the model id in that case?