transformers icon indicating copy to clipboard operation
transformers copied to clipboard

Add ColPali to πŸ€— transformers

Open tonywu71 opened this issue 1 year ago β€’ 0 comments

What does this PR do?

Add ColPali support in πŸ€— transformers.

Who can review?

@yonigozlan πŸ˜‰

Additional details

Progress checklist

TODO

  • [x] (Optional) Understood the model’s theoretical aspects
  • [x] Prepared πŸ€— Transformers dev environment
  • [x] Set up debugging environment of the original repository
  • [x] Created script that successfully runs the forward() pass using the original repository and checkpoint
  • [x] Successfully added the model skeleton to πŸ€— Transformers
  • [x] Successfully converted original checkpoint to πŸ€— Transformers checkpoint
  • [x] Successfully ran forward() pass in πŸ€— Transformers that gives identical output to original checkpoint
  • [ ] Finished model tests in πŸ€— Transformers
  • [x] Successfully added tokenizer in πŸ€— Transformers
  • [ ] Run end-to-end integration tests
  • [ ] Finished docs
  • [ ] Uploaded model weights to the Hub
  • [ ] Submitted the pull request
  • [ ] (Optional) Added a demo notebook

tonywu71 avatar Sep 26 '24 18:09 tonywu71