Patrick von Platen

> @patrickvonplaten > > > The other solution of providing a path-like object derived from the bytes stocked in the .array file is not nearly as user-friendly, but better than...

Thanks for your comments here @albertz - cool to get your input! Answering a bit here between the lines: > I understand the argument that it is bad to have...

> In https://github.com/huggingface/datasets/pull/4184#issuecomment-1105191639, you said/proposed that this map is not needed anymore and save_to_disk could do it automatically (maybe via some option)? Yes! Should be super easy now see discussion...

@DCNemesis, sorry which problem exactly is occuring again? Also cc @lhoestq @polinaeterna here

Related: https://github.com/huggingface/datasets/issues/4889

Sorry to have taken forever on this issue! I looked into it and I think, I understand the problem now more or less. As I understood it, the assumption that...

Are you running the model in full or half-precision? Maybe related: https://github.com/huggingface/transformers/pull/17437

Yeah having thought a bit more about this I think that it's probably not the reason given the finding of https://github.com/huggingface/transformers/issues/17653

Should be fixed now: https://github.com/huggingface/transformers/releases/tag/v4.20.1

> We want to keep encouraging people to use pure git to interact with the hub. However, there are things we can do to make their lives easier: > >...