Optimus

Optimus copied to clipboard

Bumps [scipy](https://github.com/scipy/scipy) from 1.3.1 to 1.10.0. Release notes Sourced from scipy's releases. SciPy 1.10.0 Release Notes SciPy 1.10.0 is the culmination of 6 months of hard work. It contains many...

dependabot[bot]

Dear Researcher: I trained an AE on Flick30k dataset, I found that the reconstruction BLEU score is about 35 on validation set. I think the reconstruction ability of AE is...

ChawDoe

Seems like checkpoints for {beta=0, beta=0.5} latent size=32 are the same checkpoints

1

For the following two checkpoints listed in [optimus_finetune_language_models.md](https://github.com/ChunyuanLI/Optimus/blob/master/doc/optimus_finetune_language_models.md): > beta=0, latent size = 32 https://chunylcus.blob.core.windows.net/machines/msrdl/optimus/output/pretrain/philly_rr3_vc4_g8_base_vae_wikipedia_pretraining_beta_schedule_beta0.0_d1.0_ro0.5_ra0.25_32_v2/checkpoint-508523.zip > beta=0.5, latent size = 32 https://chunylcus.blob.core.windows.net/machines/msrdl/optimus/output/pretrain/philly_rr3_vc4_g8_base_vae_wikipedia_pretraining_beta_schedule_beta0.5_d1.0_ro0.5_ra0.25_32_v2/checkpoint-508523.zip Their sums of all parameters are the same....

yiminzme