Missed file 'get_wandb_new'

[clabra]

Discussed in https://github.com/pykt-team/pykt-toolkit/discussions/104

^{Originally posted by clabra May 7, 2023} Hi, In the quick start document it is said in the Tuning Protocol section that:

We use the Bayes search method to find the best hyperparameter, it is expensive to run all the hyperparameter combinations. Hence, you can run the get_wandb_new file to check whether to stop the searching. We default to stop the searching if the number of the tuned hyperparameter combinations in each data fold is larger than 300 and there is no AUC improvement on the testing data in the last 100 rounds (output "end!").

But there is not get_wandb_new file in the git repo.

I think quick_start.md might need an update.

Thanks

[sonyawong]

Discussed in #104

Originally posted by clabra May 7, 2023 Hi, In the quick start document it is said in the Tuning Protocol section that:

We use the Bayes search method to find the best hyperparameter, it is expensive to run all the hyperparameter combinations. Hence, you can run the get_wandb_new file to check whether to stop the searching. We default to stop the searching if the number of the tuned hyperparameter combinations in each data fold is larger than 300 and there is no AUC improvement on the testing data in the last 100 rounds (output "end!").

But there is any get_wandb_new file in the git repo.

I think quick_start.md might need an update.

Thanks

Hi, thank you for your suggestions. Actually, we have simplified the parameter tunning steps, and the relevant instructions will be updated as soon as possible. Thanks!

[clabra]

I look forward to your update. Thanks and congrats for the project.

[sonyawong]

I look forward to your update. Thanks and congrats for the project.

hi, we have revised the parameter tunning steps as seen in the document https://pykt-toolkit.readthedocs.io/en/latest/quick_start.html. If you have any other questions, please feel free to contact us. Thank you again for your interest in our work.