red thing

@tlkh please check the above linked PR, it solves this

@tlkh Please review

I would be interested in helping as well.

Having this issue: ❯ distrobox create --image fedora Image fedora not found. Do you want to pull the image now? [Y/n]: Resolved "fedora" as an alias (/etc/containers/registries.conf.d/000-shortnames.conf) Trying to pull...

> I think the problem relies on how distrobox mounts some of its own stuff into the container, so probably one needs to copy distrobox also in the container for...

Yeah, I get it returning its own input many times. No real answers.

So from reading those issues, it doesn't quantize properly to either fp16 or int8, but supposedly works fine as bf16 or fp32. Also, it looks like this is the actual...

Here are more details: https://github.com/huggingface/transformers/issues/20287#issuecomment-1342219429

@guillaumekln This appears to be the necessary patch: https://github.com/larsmennen/transformers/commit/f90b269505a02d5476661ad77cb426e44e7561d3

https://github.com/huggingface/transformers/blame/main/src/transformers/models/t5/modeling_t5.py#L315 However it looks like the patch has already been upstream for a while. Any ideas?