vcs icon indicating copy to clipboard operation
vcs copied to clipboard

vcs.download_sample_data_files() keeps on downloading th_yr.nc

Open jypeter opened this issue 5 years ago • 4 comments

@doutriaux1 I wonder if there is a problem with a) vcs.download_sample_data_files() or with b) th_yr.nc

When I execute a) in a CDAT version where it has already been executed, it apparently sees that the files are already here, except for b) that it downloads 3 times. Same thing if I re-execute a)

-rw-r--r-- 1 jypeter lsce   332776 Mar 12 14:44 th_yr.nc

(cdatm18_py2) jypeter@obelix2 - ...jypeter - 61 >python -c 'import vcs; vcs.download_sample_data_files(); print "\nFinished downloading sample data to", vcs.sample_data'
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc

Finished downloading sample data to /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data

(cdatm18_py2) jypeter@obelix2 - ...jypeter - 62 >ls -ltr /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data | tail
-rw-r--r-- 1 jypeter lsce     3216 Mar  7 16:27 tas_gavg_rnl_ecm.nc
-rw-r--r-- 1 jypeter lsce   510144 Mar  7 16:27 tas_ecm_1979.nc
-rw-r--r-- 1 jypeter lsce   128360 Mar  7 16:27 tas_cru_1979.nc
-rw-r--r-- 1 jypeter lsce  2107996 Mar  7 16:27 psl_6h.nc
-rw-r--r-- 1 jypeter lsce   366116 Mar  7 16:27 ts_da.nc
-rw-r--r-- 1 jypeter lsce  2678584 Mar  7 16:27 tas_mo.nc
-rw-r--r-- 1 jypeter lsce   159468 Mar  7 16:27 tas_mo_clim.nc
-rw-r--r-- 1 jypeter lsce  6280312 Mar  7 16:27 tas_6h.nc
-rw-r--r-- 1 jypeter lsce 34487602 Mar  7 16:27 geos5-sample.nc
-rw-r--r-- 1 jypeter lsce   332776 Mar 12 14:46 th_yr.nc

(cdatm18_py2) jypeter@obelix2 - ...jypeter - 63 >python -c 'import vcs; vcs.download_sample_data_files(); print "\nFinished downloading sample data to", vcs.sample_data'
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc
Downloading: 'th_yr.nc' from 'https://cdat.llnl.gov/cdat/sample_data/' in: /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data/th_yr.nc

Finished downloading sample data to /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data

(cdatm18_py2) jypeter@obelix2 - ...jypeter - 64 >ls -ltr /home/share/unix_files/cdat/miniconda3/envs/cdatm18_py2/share/cdat/sample_data | tail
-rw-r--r-- 1 jypeter lsce     3216 Mar  7 16:27 tas_gavg_rnl_ecm.nc
-rw-r--r-- 1 jypeter lsce   510144 Mar  7 16:27 tas_ecm_1979.nc
-rw-r--r-- 1 jypeter lsce   128360 Mar  7 16:27 tas_cru_1979.nc
-rw-r--r-- 1 jypeter lsce  2107996 Mar  7 16:27 psl_6h.nc
-rw-r--r-- 1 jypeter lsce   366116 Mar  7 16:27 ts_da.nc
-rw-r--r-- 1 jypeter lsce  2678584 Mar  7 16:27 tas_mo.nc
-rw-r--r-- 1 jypeter lsce   159468 Mar  7 16:27 tas_mo_clim.nc
-rw-r--r-- 1 jypeter lsce  6280312 Mar  7 16:27 tas_6h.nc
-rw-r--r-- 1 jypeter lsce 34487602 Mar  7 16:27 geos5-sample.nc
-rw-r--r-- 1 jypeter lsce   332776 Mar 12 14:56 th_yr.nc

jypeter avatar Mar 12 '19 13:03 jypeter