Malte Isberner
Results
11
comments of
Malte Isberner
So, for me changing to `bfloat16` did not fix the issue. I didn't try removing `do_sample=True`, but working with batches of size 1 was the thing that reliably made the...