TransNASBench icon indicating copy to clipboard operation
TransNASBench copied to clipboard

Generating Architectures and Train

Open VascoLopes opened this issue 3 years ago • 3 comments

Hi,

Thanks for your work on the benchmark. Truly needed! I have some questions/problems:

  • In generating architectures from the configs and training them, the data is not provided, and several files are missing, such as: "tb101/code/experiments/final5k/train_filenames_final5k.json'"
  • On VEGA, it says: Raw images and labels should be downloaded from this [link](). train/val/test split is located in configs/dataset_split/final5k/ But all these files are not provided.

Can you please upload them? This is important to run experiments with performance estimation mechanisms that require training architectures.

Best, Vasco

VascoLopes avatar Jun 20 '22 16:06 VascoLopes

Hi, Thanks for your work on the Trans-NAS-benchmark 101 We also have the same problem with the dataset on VEGA, it seems that all data are missing.

Best, DSY

Dsyforever avatar Jan 16 '23 10:01 Dsyforever

Hi, Thanks for your work on the benchmark which is really helpful.

However, when we try to download the data on VEGA , 'Raw images and labels should be downloaded from this link. train/val/test split is located in configs/dataset_split/final5k/' is shown to us, which means the data are probably missing. Can you please upload them?

Best, LZH

scutRttrr avatar Jan 16 '23 10:01 scutRttrr

Hi, Thanks for your work on the benchmark. But I am faced with the same problem as Vasco that the dataset is missing Can you please upload the dataset? Without them, it's impossible to run experiments with performance estimation mechanisms.

Best, ES

eastsinger avatar Jan 16 '23 10:01 eastsinger