About encoder

[Mr-ind1fferent]

Amazing work!

Wondering how to use vggt pertrained encoder?

thanks!

[jytime]

Hi you can simply use the pretrained encoder following the steps in the readme, e.g.:

from vggt.utils.pose_enc import pose_encoding_to_extri_intri
from vggt.utils.geometry import unproject_depth_map_to_point_map

with torch.no_grad():
    with torch.cuda.amp.autocast(dtype=dtype):
        images = images[None]  # add batch dimension
        aggregated_tokens_list, ps_idx = model.aggregator(images)