Great work,How to fintune

[zhangbaijin]

Thanks for your contribution, it is a great work, how to fintune my dataset? like mural dataset, can you give the command or script?

[PhyscalX]

Hi, @zhangbaijin

To train TAP models, you should implement the following components:

• tokenize_anything/config/... (YAML Configuration System)
• tokenize_anything/data/... (data loader, transforms)
• tokenize_anything/engine/train_engine.py (train loop, optimizer, LR scheduler, mixed precision and DDP wrapper)
• tokenize_anything/models/<my_model>.py (custom TAP builder, losses/targets getter and forward impl. for training)
• scripts/train.py (argument parser, DDP initialization and dispatcher for your train engine)

You can follow detectron2 to complete the above components. Currently, we have no plan to release the full code.