Why HugeCTR doesn't support FTRL optimizer which is widely used at recommender system?

[AtekiRyu]

Why HugeCTR doesn't support FTRL optimizer which is widely used at recommender system? Is there some design limitation that makes FTRL is hard to implement at HugeCTR?

[snowmanwwg]

Thank you for the feedback. We are actively evaluating about this to add to our roadmap, and will keep you posted.

[wenjing-nv]

Hi @AtekiRyu , I'm glad to let you know that we just supported FTRL optimizer and here is how to use it.

optimizer = hugectr.CreateOptimizer(
    optimizer_type=hugectr.Optimizer_t.Ftrl,
    update_type=hugectr.Update_t.Global,
    beta = 0.0f,
    lambda1=0.0f,
    lambda2=0.0f,
)

You can find it in the latest released container nvcr.io/nvidia/merlin/merlin-hugectr:22.12 If any problem when you run the Ftrl optimizer, let me know. Thank you!

[wenjing-nv]

Hi @AtekiRyu , I'm glad to let you know that we just supported FTRL optimizer and here is how to use it.

optimizer = hugectr.CreateOptimizer(
    optimizer_type=hugectr.Optimizer_t.Ftrl,
    update_type=hugectr.Update_t.Global,
    beta = 0.0f,
    lambda1=0.0f,
    lambda2=0.0f,
)

You can find it in the latest released container nvcr.io/nvidia/merlin/merlin-hugectr:22.12 Feel free to comment when you run into problems. Thank you

[bashimao]

Closing this for now. @AtekiRyu Please don't hesitate to reopen this ticket if you have trouble using or face performance issues with the FTRL or any other optimizer.