swamidass

In my read through, seems that it may be fairly straightforward to implement DINO v1, by creating a modified version of DINOLoss. I know there is a DINOv2 nearing completion....

It seems that the following code should be approximately correct for SimDINO. Adapted from https://github.com/RobinWu218/SimDINO/blob/main/simdino/main_dino.py ```python class MCRLoss(nn.Module): def __init__(self, ncrops, reduce_cov=0, expa_type=0, eps=0.5, coeff=1.0): super().__init__() self.ncrops = ncrops self.eps...

I found that there is a way to do this with einx using "add_at". But to correctly implement logmax, we also need the equivalent of "max_at" or "min_at". Can this...

Interesting paper.

This is a breaking change for setups that use Scratch to communicate between templates. For communication between output-formats, it is necessary for Scratch to persist between output formats. There is...