MatchZoo-py icon indicating copy to clipboard operation
MatchZoo-py copied to clipboard

Add on-the-fly sampling

Open lebionick opened this issue 4 years ago • 2 comments

As far as I understand, right now text pairs are picked directly using Datapack samples. However it is almost impossible to mine "hard" negative samples before training. Just adding into class 0/ rank 0.0 random pairs which are not corresponding is very wasteful and inefficient.

lebionick avatar Mar 16 '20 14:03 lebionick

Hi @lebionick , do you mean the sampling strategy should be dynamically adjusted according to the performance after each epoch?

faneshion avatar Sep 20 '20 07:09 faneshion

@faneshion exactly

lebionick avatar Sep 20 '20 12:09 lebionick