exo
exo copied to clipboard
Get rid of transformers dependency
- It's only used for tokenizers (processor for llava VLM)
- The tokenizers code is fuzzy and bloated as a result of this hard to understand AutoTokenizer
- Should be fairly easy to replace with our own minimal implementation