DeepCTR icon indicating copy to clipboard operation
DeepCTR copied to clipboard

What about adding a Benchmark

Open iFe1er opened this issue 7 years ago • 3 comments

What about adding a performance benchmark (by AUC and logloss) over datasets such as Criteo?

iFe1er avatar Apr 01 '19 10:04 iFe1er

@shenweichen

iFe1er avatar Apr 13 '19 15:04 iFe1er

@iFe1er That's a good idea,but the hyperparameters of each model are not easy to determine because it is difficult to determine a consistent setting. And it is too cumbersome to find the optimal parameters by parameter tuning. Do you have any good solution?

shenweichen avatar Apr 14 '19 15:04 shenweichen

@shenweichen I would recommend simply adding testing them with default hyper-parameter. Control the variable such as learning rate and batch size, then compare those algorithm on the same test set. That should be helpful enough and an easy way to do.

iFe1er avatar Apr 18 '19 08:04 iFe1er