xlearn icon indicating copy to clipboard operation
xlearn copied to clipboard

log_loss is nan when using fm model

Open sjoke opened this issue 4 years ago • 3 comments

// train_x shape: (51960, 7193), train_y shape: (51960,) // test_x shape: (22269, 7193), test_y shape: (22269,) xdm_train = xl.DMatrix(train_x.toarray(), train_y)
xdm_test = xl.DMatrix(test_x.toarray(), test_y) fm_model = xl.create_fm()
fm_model.setTrain(xdm_train) fm_model.setValidate(xdm_test) xparams = { 'task': 'binary', 'metric': 'auc', 'lr': 0.02, 'lambda': 0.0002, 'epoch': 5, # 'opt': 'FTRL', 'nthread': 1 } fm_model.fit(xparams, 'xmodel.out')

result: [------------] Epoch Train log_loss Test log_loss Test AUC Time cost (sec) [ 10% ] 1 nan nan 0.500000 11.07 [ 20% ] 2 nan nan 0.500000 11.18 [ 30% ] 3 nan nan 0.500000 11.50 [ 40% ] 4 nan nan 0.500000 10.99 [ 50% ] 5 nan nan 0.500000 10.72 [ 60% ] 6 nan nan 0.500000 11.90 [ 70% ] 7 nan nan 0.500000 11.87 [ 80% ] 8 nan nan 0.500000 11.12 [ 90% ] 9 nan nan 0.500000 11.02 [ 100% ] 10 nan nan 0.500000 11.16

when using linear model, the result is fine. so what's the problem? wish your help, :)

sjoke avatar Jan 17 '20 03:01 sjoke

reduce lr, maybe learning rate is too high

naihaishy avatar Jan 20 '20 09:01 naihaishy

Maybe your train data has a zero row.

Murray132 avatar May 26 '20 06:05 Murray132

Have you slove the problem? I had the same problem. Can you help me? thanks.

kyle-pjk avatar Jun 29 '21 15:06 kyle-pjk