2D-VQ-AE-2

2D-VQ-AE-2 copied to clipboard

Figure out where the NaNs in autoencoder training are coming from:

1

Source: `2021-11-01/12-14-29/0/lightning_logs/version_8317429 ` 

robogast

Problem: - pl.seed_everything only seeds numpy.random, the new numpy.default_rng() is not seeded. - This leads to un-seeded crops, which are not desirable from a reproducibility perspective Solution: - Use pytorch.random

robogast

Find out how to add pruner through hydra config

1

Pruners are not currently supported through the hydra optuna sweeper plugin: https://github.com/facebookresearch/hydra/issues/1710 . Adding the pruner to the sweeper ourselves might be doable, as it seems like a single argument...

robogast

- Nested sampling is supported in optuna: https://optuna.readthedocs.io/en/stable/tutorial/10_key_features/002_configurations.html - Nested sampling is not supported in hydra - Ideally we would like categorical choices to be config options, i.e. set choices...

robogast