info-nce-pytorch

info-nce-pytorch copied to clipboard

Minimizing this loss function will minimize or maximize mutual information?

3

I'm confused about this. NCEloss can determine the lower bound of mutual information. In this implementation, should NCEloss be minimized in order to increase mutual information?

geolvr

multiple positive sampels per query

1

Hi, Thanks very much for your work. I wonder how should I modify your loss to adapting to the case of multiple positive samples per query. For example, query.shape =...

YiJun-Yang

I have a quick question. My data is (data1, data2, label), where the label indicates if the pair of data points represent the same thing. 0 being not the same...

irowberryFS

How to use InfoNCE for prototypes with shape [b, num_cls, num_tokens, dim]?

1

Hi, I’m working with a set of prototypes that have the shape [b, num_cls, num_tokens, dim]. My goal is to use InfoNCE loss to maximize inter-class differences. I have the...

zzzyzh