continual-learning-baselines icon indicating copy to clipboard operation
continual-learning-baselines copied to clipboard

Reproduce Generative Replay results

Open travela opened this issue 1 year ago • 4 comments

The target results depend on the generator that is being used (as well as other factors, such as how much replay data is generated and whether the replay data is class-balanced or not).

This paper lists the various results for different generative models.

travela avatar Sep 08 '22 08:09 travela

Hi @travela, what do you mean exactly? Are you referring to the results of a strategy present in this repository?

AndreaCossu avatar Sep 08 '22 08:09 AndreaCossu

Hi @AndreaCossu, I simply want to add the reproducibility tests for the generative replay strategy. The strategy already exists in Avalanche but not in this repo. I'm running the test locally right now and will push it in a few minutes.

travela avatar Sep 08 '22 08:09 travela

I see, thank you! I think the best way to do it is to choose a reference paper and implement that exact experimental setup. If the results match then it is fine and we can merge it.

AndreaCossu avatar Sep 08 '22 08:09 AndreaCossu

@AndreaCossu I reproduced the results of the reference paper that I linked. Only for one type of generative model, namely a VAE. Maybe you can have a look and see if you want to merge it. :)

travela avatar Sep 08 '22 12:09 travela