AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

Published 20 hours ago • verified publisher icon casper-hansen

Support Kosmos-2

Open z3ugma opened this issue 2 years ago • 1 comments

https://huggingface.co/microsoft/kosmos-2-patch14-224

Used in the following fashion with AutoModelForVision2Seq

    from transformers import AutoModelForVision2Seq, AutoProcessor

    model = AutoModelForVision2Seq.from_pretrained("microsoft/kosmos-2-patch14-224")
    processor = AutoProcessor.from_pretrained("microsoft/kosmos-2-patch14-224")

z3ugma avatar Nov 25 '23 07:11 z3ugma

This is a vision model and it would be nice to integrate with LLaVa and others. Open to PRs that helps integrate it!

casper-hansen avatar Nov 27 '23 22:11 casper-hansen