asdfree
asdfree copied to clipboard
Published
20 hours ago •
ajdamico
ajdamico
Problem in downloading NYCHVS data for 2014, 2017
Hi,
I am trying to download the entire NYCHVS dataset from 2002 - 2017. The datasets for the years prior to 2014 were downloaded without problems, but I am receiving the following errors for 2014 and 2017:
[[1]]
lodown("nychvs", output_dir = file.path("/Users/whlu/Documents/Terra Nova/UChicago/Summer 2020",
"NYCHVS"))
[[2]]
withCallingHandlers(catalog <- load_fun(data_name = data_name,
catalog, ...), error = function(e) {
print(sessionInfo())
if (grepl("cannot allocate vector of size", e))
message(memory_note)
else if (grepl("parameter must be specified", e))
message(parameter_note)
else if (grepl("to install", e))
message(installation_note)
else {
message(unknown_error_note)
print(sys.calls())
}
})
[[3]]
load_fun(data_name = data_name, catalog, ...)
[[4]]
read_SAScii(tf, cleaned.sas.script, beginline = catalog[i, "beginline"])
[[5]]
suppressWarnings(sasc <- SAScii::parse.SAScii(tf, beginline = beginline,
lrecl = lrecl))
[[6]]
withCallingHandlers(expr, warning = function(w) invokeRestart("muffleWarning"))
[[7]]
SAScii::parse.SAScii(tf, beginline = beginline, lrecl = lrecl)
[[8]]
SAS.uncomment(SASinput, "*", ";")
[[9]]
sub(substr(SASinput[i], slash_asterisk[1], asterisk_slash[1] +
1), "", SASinput[i], fixed = T)
[[10]]
.handleSimpleError(function (e)
{
print(sessionInfo())
if (grepl("cannot allocate vector of size", e))
message(memory_note)
else if (grepl("parameter must be specified", e))
message(parameter_note)
else if (grepl("to install", e))
message(installation_note)
else {
message(unknown_error_note)
print(sys.calls())
}
}, "zero-length pattern", quote(sub(substr(SASinput[i], slash_asterisk[1],
asterisk_slash[1] + 1), "", SASinput[i], fixed = T)))
[[11]]
h(simpleError(msg, call))
Error in sub(substr(SASinput[i], slash_asterisk[1], asterisk_slash[1] + :
zero-length pattern
In addition: Warning messages:
1: In readLines(z) :
incomplete final line found on '/Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_02_per_load.sas'
2: Duplicated column names deduplicated: 'RACE' => 'RACE_1' [65]
3: In readLines(z) :
incomplete final line found on '/Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_05_per_load.sas'
4: In readLines(z) :
incomplete final line found on '/Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_08_per_load.sas'
5: In readLines(z) :
incomplete final line found on '/Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_11_pers_load.sas'
type year full_url
1 occ 2002 https://www2.census.gov/programs-surveys/nychvs/datasets/2002/microdata/lng08_occ02_rev.dat
2 vac 2002 https://www2.census.gov/programs-surveys/nychvs/datasets/2002/microdata/lng08_vac02_web.dat
3 per 2002 https://www2.census.gov/programs-surveys/nychvs/datasets/2002/microdata/lng08_per02_rev.dat
4 ni 2002 https://www2.census.gov/programs-surveys/nychvs/datasets/2002/microdata/lng08_ni02_web.dat
5 occ 2005 https://www2.census.gov/programs-surveys/nychvs/datasets/2005/microdata/lng08_occ05_rev.dat
6 vac 2005 https://www2.census.gov/programs-surveys/nychvs/datasets/2005/microdata/lng08_vac05_web.dat
7 per 2005 https://www2.census.gov/programs-surveys/nychvs/datasets/2005/microdata/lng08_per05_rev.dat
8 ni 2005 https://www2.census.gov/programs-surveys/nychvs/datasets/2005/microdata/lng08_ni05_web.dat
9 occ 2008 https://www2.census.gov/programs-surveys/nychvs/datasets/2008/microdata/lng08_occ08_rev.dat
10 vac 2008 https://www2.census.gov/programs-surveys/nychvs/datasets/2008/microdata/lng08_vac08_web.dat
11 per 2008 https://www2.census.gov/programs-surveys/nychvs/datasets/2008/microdata/lng08_per08_rev.dat
12 ni 2008 https://www2.census.gov/programs-surveys/nychvs/datasets/2008/microdata/lng08_ni08_web.dat
13 occ 2011 https://www2.census.gov/programs-surveys/nychvs/datasets/2011/microdata/uf_11_repwgt_occ_web.txt
14 vac 2011 https://www2.census.gov/programs-surveys/nychvs/datasets/2011/microdata/uf_11_repwgt_vac_web.txt
15 pers 2011 https://www2.census.gov/programs-surveys/nychvs/datasets/2011/microdata/uf_11_repwgt_pers_web.txt
16 occ 2014 https://www2.census.gov/programs-surveys/nychvs/datasets/2014/microdata/uf_14_repwgt_occ_web.txt
17 vac 2014 https://www2.census.gov/programs-surveys/nychvs/datasets/2014/microdata/uf_14_repwgt_vac_web.txt
18 pers 2014 https://www2.census.gov/programs-surveys/nychvs/datasets/2014/microdata/uf_14_repwgt_pers_web.txt
19 occ 2017 https://www2.census.gov/programs-surveys/nychvs/datasets/2017/microdata/uf_17_occ_web_b.txt
20 vac 2017 https://www2.census.gov/programs-surveys/nychvs/datasets/2017/microdata/uf_17_vac_web_b.txt
21 pers 2017 https://www2.census.gov/programs-surveys/nychvs/datasets/2017/microdata/uf_17_pers_web_b.txt
sas_ri
1 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_02_occ_load.sas
2 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_02_vac_load.sas
3 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_02_per_load.sas
4 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_02_ni_load.sas
5 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_05_occ_load.sas
6 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_05_vac_load.sas
7 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_05_per_load.sas
8 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_05_ni_load.sas
9 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_08_occ_load.sas
10 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_08_vac_load.sas
11 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_08_per_load.sas
12 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_08_ni_load.sas
13 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_11_occ_load.sas
14 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_11_vac_load.sas
15 /Library/Frameworks/R.framework/Versions/3.5/Resources/library/lodown/extdata/nychvs/furman/hvs_11_pers_load.sas
16 https://www2.census.gov/programs-surveys/nychvs/datasets/2014/microdata/sas_import_program.txt
17 https://www2.census.gov/programs-surveys/nychvs/datasets/2014/microdata/sas_import_program.txt
18 https://www2.census.gov/programs-surveys/nychvs/datasets/2014/microdata/sas_import_program.txt
19 https://www2.census.gov/programs-surveys/nychvs/datasets/2017/microdata/sas_import_program_17.txt
20 https://www2.census.gov/programs-surveys/nychvs/datasets/2017/microdata/sas_import_program_17.txt
21 https://www2.census.gov/programs-surveys/nychvs/datasets/2017/microdata/sas_import_program_17.txt
beginline output_filename case_count
1 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2002/occ.rds 15894
2 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2002/vac.rds 1263
3 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2002/per.rds 38950
4 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2002/ni.rds 783
5 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2005/occ.rds 15547
6 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2005/vac.rds 1287
7 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2005/per.rds 37740
8 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2005/ni.rds 1325
9 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2008/occ.rds 17955
10 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2008/vac.rds 1471
11 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2008/per.rds 43132
12 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2008/ni.rds 1005
13 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2011/occ.rds 16358
14 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2011/vac.rds 1569
15 1 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2011/pers.rds 40230
16 9 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2014/occ.rds NA
17 561 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2014/vac.rds NA
18 413 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2014/pers.rds NA
19 9 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2017/occ.rds NA
20 561 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2017/vac.rds NA
21 413 /Users/whlu/Documents/Terra Nova/UChicago/Summer 2020/NYCHVS/2017/pers.rds NA
My session info is as follows:
R version 3.5.2 (2018-12-20)
Platform: x86_64-apple-darwin15.6.0 (64-bit)
Running under: macOS 10.15.7
Matrix products: default
BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
LAPACK: /Library/Frameworks/R.framework/Versions/3.5/Resources/lib/libRlapack.dylib
locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] lodown_0.1.0
loaded via a namespace (and not attached):
[1] lattice_0.20-38 crayon_1.3.4 grid_3.5.2 R6_2.4.1 DBI_1.1.0 lifecycle_0.2.0 magrittr_1.5
[8] survey_4.0 pillar_1.4.6 rlang_0.4.8 rstudioapi_0.11 SAScii_1.0 Matrix_1.2-15 vctrs_0.3.4
[15] ellipsis_0.3.1 splines_3.5.2 tools_3.5.2 readr_1.4.0 glue_1.4.2 hms_0.5.3 survival_3.2-7
[22] yaml_2.2.1 compiler_3.5.2 pkgconfig_2.0.3 mitools_2.4 tibble_3.0.4
What could be the reason for this?
