jsonargparse
jsonargparse copied to clipboard
The hyperparameters from `Wandb` sweep are not being recognized by `jsonargparser`
🐛 Bug report
To reproduce
You need a wandb account.
Clone my toy repo and then follow the official wandb sweep instructions like the following.
wandb sweep sweeps/swp_nc.yaml # to intialize sweep and get `entity/project/sweep_ID`
wandb agent entity/project/sweep_ID --count 2 # count is the number of hyperparameter tuning trials
Then you can see something like
This image shows the terminal output from the first sweep experiment. Note the hyperparameter values in the red rectangles. We can see that
jsonargparser
is not affected by the hyperparameter values (i.e., mu=5, sigma=2) chosen by wandb sweep . Instead, it still uses the default values (i.e., mu=0, sigma=1). This means that adjusting hyperparameters with wandb sweep is not compatible with jsonargparser
.
Expected behavior
The args parsed by jsonargparser
can be changed by wandb sweep.
Environment
- jsonargparse version (e.g., 4.8.0):
4.27.2
- Python version (e.g., 3.10):
3.10
- How jsonargparse was installed (e.g.
pip install jsonargparse[all]
):pip install jsonargparse[all]
- OS (e.g., Linux):
Ubuntu22.04
- Wandb version:
0.16