OpenNMT-py
OpenNMT-py copied to clipboard
Example-based Reweighting
Is there a way to reweight individual examples (sentence pairs) by some value? E.g. scale the loss for a given example by 0.5 (arbitrary scalars).
the operation of reweighting is quite straight forward, the question is more what you want to reweight and based on what criterion. maybe the best is to have a look at #1438 which was never merged but very interesting.
@siddk let us know if you have some interesting results with #1438! There are some conflicts with current master because it was done a while ago but we might fix them and merge if it appears useful.