SV4D: Custom Video with more than 21 Frames

[Vinayak-VG]

SV4D: I have a video with around 50 frames. Is there anyway I can run SV4D on all the 50 frames at once? or do I need to run in batches?

[Provemj]

same

[zhongjianlittlejiang]

me too.

[ymxie97]

I responded to Vinayak via email, but I’m sharing the reply here for everyone’s reference:
You can still use mixed sampling to generate 50 frames. Here’s an example:

1. Interleaved Sampling: Progressively generate anchor frames indexed as follows:
   [0, 4, 8, 12, 16, 20], [20, 24, 28, 32, 36, 40], [36, 40, 44, 48, 52]
   For each sub-list, generation can be conditioned on the first frame of that list (e.g., 0, 20, 36). To maintain the mixed sampling pattern, you’ll need to pad an additional three frames (50, 51, 52) with the last frame (49).

2. Dense Sampling: Use dense sampling to generate all intermediate frames.

[yuhaoliu7456]

I responded to Vinayak via email, but I’m sharing the reply here for everyone’s reference: You can still use mixed sampling to generate 50 frames. Here’s an example:

1. Interleaved Sampling: Progressively generate anchor frames indexed as follows: [0, 4, 8, 12, 16, 20], [20, 24, 28, 32, 36, 40], [36, 40, 44, 48, 52] For each sub-list, generation can be conditioned on the first frame of that list (e.g., 0, 20, 36). To maintain the mixed sampling pattern, you’ll need to pad an additional three frames (50, 51, 52) with the last frame (49).
2. Dense Sampling: Use dense sampling to generate all intermediate frames.

I found that the dense sampling will cause blur and details lost.