Scaffold-GS icon indicating copy to clipboard operation
Scaffold-GS copied to clipboard

Question about grid_scaling

Open MuQoe opened this issue 1 year ago • 3 comments

upon this code section

` # post-process cov scaling = scaling_repeat[:,3:] * torch.sigmoid(scale_rot[:,:3]) # * (1+torch.sigmoid(repeat_dist)) rot = pc.rotation_activation(scale_rot[:,3:7])

# post-process offsets to get centers for gaussians
offsets = offsets * scaling_repeat[:,:3]
xyz = repeat_anchor + offsets

`

What does this stands for scaling_repeat[:,3:], i have found that this is from grid_scaling initialize by

scales = torch.log(torch.sqrt(dist2))[...,None].repeat(1, 6) Could you explain the role of each dimension in scaling_repeat, especially in the context of the slicing [:,3:] and [:,:3]?

Thanks

MuQoe avatar Jun 03 '24 13:06 MuQoe

The [:,:3] controls the step size of offset. The [:,3:] serves as the base scale for neural gaussian's shape, which means the cov MLP learn a residual scales.

inspirelt avatar Jun 04 '24 13:06 inspirelt

Therefore, the learnable scaling l takes charge of both scales and positions of 10 neural Gaussians. If the shape of anchors is [N,3], then the shape of scaling is [N,6]. Is my understanding correct? Just want to make sure.

renaissanceee avatar Sep 16 '24 14:09 renaissanceee

3 of 6 is for scaling the offsets

cskrren avatar Sep 25 '24 14:09 cskrren