How to do Hyperparameter Optimization using OpenNMT.
Hi,
I want to know whether there are built-in methods in OpenNMT to optimize hyperparameters. Unfortunately, I didn't find any. Ex: Grid search, Random Search.
Indeed there are none. As most of the tasks performed with OpenNMT are quite compute intensive, you probably would not want to perform such extensive searches anyway. There might be some new methods that would be more optimized and might be worth a look though. Feel free to PR if you want to implement something in that matter.
Hi @francoishernandez thank you for the reply. I would like to know how you tune your deep learning models when using OpenNMT. Do you tune manually or is there any other method?
@thilakshiK have you found a solution? For me, it looks like we need to do a manual hyperparameter search with a limited number of combinations. I would be interested to know what option you chose eventually.
@francoishernandez, what do you recommend?