MaskControl

MaskControl copied to clipboard

Question about the input of ctrlnet

3

Hi, dear author Thanks for your excellent work! When I read the code, I noticed that the input of ctrlnet(self.seqTransEncoder_control) and backbone(self.seqTransEncoder) is same. https://github.com/exitudio/MaskControl/blob/d3ef3580057fb5fcf22fd7c7484ef8bad69478df/models/mask_transformer/control_transformer.py#L335C1-L350C85 It's not same as the...

Heibaiii

How to make the controlled motion to be shorter?

4

Thanks for the great work! By default the control motion length is 196. I tried to edit it to shorter but there will be an error in https://github.com/exitudio/MaskControl/blob/b530ecb58fb64222630023801a42f77e30177b18/models/mask_transformer/control_transformer.py#L478 ``` ctrlNet_cond...

DocterStrawberry

Could you please provide the complete training commands?

1

Hello! Thank you for open-sourcing the excellent MaskControl project. The code structure is very clear and has benefited me a lot. When trying to reproduce the project results, I noticed...

Pipi7878

How can I reproduce the zero-shot objective control example shown in the paper

2

Could you provide the specific code for the zero-shot control case in which the figure bent down to avoid the cylinder? I wasn’t able to reproduce it. Thanks!

zhangdude

Hi @exitudio 🤗 I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to...

NielsRogge

When will release codebase?

1

Really great work! Especially the comparison results for Multiple Joints/Pelvis only, quite impressive! When will release the codebase? I can't wait!

sylcito

When will the code be open?

1

Good job ! thank you very much for your work，hope the code will be open as soon as possible.

hengyuan-zhang-0