pytti-core

pytti-core copied to clipboard

add "warmup steps" option

1

work around for #114 . Can prob incorporate the `pre_animation_steps` parameter. just output files generated during the warmup period with some suffix that specifies that they're the warmup, and start...

dmarx

the way I understand it, disco supports multi-clip by picking a different perceptor from its active pool each step, so instead of throwing them all at the step, you just...

dmarx

can we add detail to the scene by applying a semantic consistency loss to the depth maps?

1

or maybe alternating steps between adjusting the pixels and adjusting the depth warp?

dmarx

In multi-gpu setting, use GPU with highest available VRAM by default

9

dmarx

Explore potential for using a single model for both motion estimation and frame interpolation

1

I.e. can we get a flow field from FiLM?

dmarx

add optional warmup phase to pre-download models

1

could also do this like nltk and add some sort of internal download capability attached to a queryable catalog of available models

dmarx

dmarx

adding unit tests to better understand image_model internals. ultimate goal here is to implement a new image_model class for guided diffusion, although might add DIP first since that will probably...

dmarx

Replace image model .input_axes / .output_axes with TorchTyping annotations

1

https://github.com/patrick-kidger/torchtyping

dmarx

Use einops

1

dmarx