blt wip
WIP of blt integration.
current state:
- refactored to run on CPU! 🤗
- not restyled to transformers yet
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
Thank you @Cyrilvallez for your throrough feedback! 🤗 Applied most of the feedback with some comments for remaining points! Mainly:
- using new outputs
- merged mllama to update modular from
- renaming and reorganizing (ie. renamed BLT -> Blt, re-ordered, etc)
applied 2nd round of feedback! in particular the mask creation is cleaned up!
run-slow: blt
This comment contains run-slow, running the specified jobs:
models: ['models/blt'] quantizations: [] ...
Oh also, just noticed the slow tests I triggered all fail with the same error! We need to fix it! 🤗 And you need to fix the small conflict as well 👌
run-slow: blt
This comment contains run-slow, running the specified jobs:
models: ['models/blt'] quantizations: [] ...
Thanks @Cyrilvallez for (all) the detailed rounds of feedback!! 🤗 all slow passed I believe just an unrelated test failing from main but I will do another detailed pass
[For maintainers] Suggested jobs to run (before merge)
run-slow: auto, blt