How to create a new dataset

[jdyjjj]

This is a very perfect job. I want to apply this work to human tracking, but the effect is not very ideal, and there may be situations where tracking points disappear. Therefore, I want to create my own video as a dataset for training. I would like to inquire about how to create a new dataset (do you have any reference documents or similar)? Thanks a lot!

[cdoersch]

Our code comment here should be fairly comprehensive to explain the format that our training and eval scripts assume. I suspect the best approach will be to write a new data loader which mixes Kubric data with your own data.

Annotating your own dataset is challenging, and we are unfortunately unable to release our track assist code, as it relies on a non-trivial amount of internal google infrastructure. However, we are working on releasing a more limited colab demo that may help you with annotation, at least for relatively small videos. Our TAP-Vid paper has details on how our track assist works, and we found it was quite important to make point tracking results stable.

Let me know if that answered your question.

[jdyjjj]

Thanks a lot. I'll study it again.

[cdoersch]

This seems resolved, so I'm closing.