Add another MLP head in vision transformer

[Atul997]

How can I add/extend MLP head in same model for detection? Let's say head is detecting objects A,B,C in a image and we want to train by adding or extend MLP/classification head to detect objects D, E, F in same image without combining both the classes.

Any help would be appreciated?

[lucidrains]

@Atul997 this is a nice scheme https://github.com/lucidrains/vit-pytorch#learnable-memory-vit

[Atul997]

@lucidrains Thanks . How the data will look like in terms of json file such as two different json or single json containing annotation for both the different head classes?