Using known quantities

[reynoldscem-oculo]

Hi, I'm curious about whether known intrinsics or rig structure can be conditioned on or otherwise introduced into the pipeline, or whether all quantities must be inferred / considered independently?

Thanks!

[rajatmodi62]

you can check mapanything paper https://github.com/facebookresearch/map-anything

it takes intrinsics, etc as input condition also

[jytime]

Hi yes, you can simply finetune the model by using an additional mlp to project the the known intrinsics to a latent vector, and then inject this latent vector to the attention blocks.