asdfree icon indicating copy to clipboard operation
asdfree copied to clipboard

Error Downloading CES

Open galsk223 opened this issue 5 years ago • 1 comments

It looks like I got the folder, but they're all empty...

[1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252
[3] LC_MONETARY=English_United States.1252 LC_NUMERIC=C
[5] LC_TIME=English_United States.1252

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] lodown_0.1.0 devtools_2.1.0 usethis_1.5.1

loaded via a namespace (and not attached): [1] Rcpp_1.0.2 pillar_1.4.2 cellranger_1.1.0 plyr_1.8.4 compiler_3.6.1
[6] prettyunits_1.0.2 remotes_2.1.0 tools_3.6.1 testthat_2.2.1 digest_0.6.20
[11] pkgbuild_1.0.5 pkgload_1.0.2 tibble_2.1.3 memoise_1.1.0 lattice_0.20-38
[16] pkgconfig_2.0.2 rlang_0.4.0 Matrix_1.2-17 cli_1.1.0 DBI_1.0.0
[21] rstudioapi_0.10 curl_4.0 stringr_1.4.0 xml2_1.2.2 withr_2.1.2
[26] httr_1.4.1 desc_1.2.0 fs_1.3.1 mitools_2.4 rprojroot_1.3-2
[31] grid_3.6.1 glue_1.3.1 R6_2.4.0 processx_3.4.1 readxl_1.3.1
[36] survival_2.44-1.1 sessioninfo_1.1.1 reshape2_1.4.3 selectr_0.4-1 callr_3.3.1
[41] magrittr_1.5 backports_1.1.4 ps_1.3.0 splines_3.6.1 assertthat_0.2.1 [46] rvest_0.3.4 stringi_1.4.3 survey_3.36 crayon_1.3.4

lodown is now exiting unexpectedly. websites that host publicly-downloadable microdata change often and sometimes those changes cause this software to break. if the error call stack below appears to be a hiccup in your internet connection, then please verify your connectivity and retry the download. otherwise, please open a new issue at https://github.com/ajdamico/asdfree/issues with the contents of this error call stack and also the output of your sessionInfo().

[[1]] lodown("ces", output_dir = file.path(path.expand("~"), "CES"))

[[2]] withCallingHandlers(catalog <- load_fun(data_name = data_name, catalog, ...), error = function(e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } })

[[3]] load_fun(data_name = data_name, catalog, ...)

[[4]] census_thresholds()

[[5]] data.frame(readxl::read_excel(fn))

[[6]] readxl::read_excel(fn)

[[7]] read_excel_(path = path, sheet = sheet, range = range, col_names = col_names, col_types = col_types, na = na, trim_ws = trim_ws, skip = skip, n_max = n_max, guess_max = guess_max, progress = progress, .name_repair = .name_repair, format = format)

[[8]] set_readxl_names(read_fun(path = enc2native(normalizePath(path)), sheet_i = sheet, limits = limits, shim = shim, col_names = col_names, col_types = col_types, na = na, trim_ws = trim_ws, guess_max = guess_max, progress = progress), .name_repair = .name_repair)

[[9]] tibble::as_tibble(l, .name_repair = .name_repair)

[[10]] read_fun(path = enc2native(normalizePath(path)), sheet_i = sheet, limits = limits, shim = shim, col_names = col_names, col_types = col_types, na = na, trim_ws = trim_ws, guess_max = guess_max, progress = progress)

[[11]] stop(list(message = "\n filepath: C:\Users\samko\AppData\Local\Temp\RtmpGSJiSd\thresh18.xls\n libxls error: Unable to open file", call = NULL, cppstack = NULL))

[[12]] (function (e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } })(list(message = "\n filepath: C:\Users\samko\AppData\Local\Temp\RtmpGSJiSd\thresh18.xls\n libxls error: Unable to open file", call = NULL, cppstack = NULL))

Error: filepath: C:\Users\samko\AppData\Local\Temp\RtmpGSJiSd\thresh18.xls libxls error: Unable to open file type year full_url output_folder 1 intrvw 2017 https://www.bls.gov//cex/pumd/data/stata/intrvw17.zip C:/Users/samko/Documents/CES/2017/ 2 diary 2017 https://www.bls.gov//cex/pumd/data/stata/diary17.zip C:/Users/samko/Documents/CES/2017/ 3 intrvw 2016 https://www.bls.gov//cex/pumd/data/stata/intrvw16.zip C:/Users/samko/Documents/CES/2016/ 4 diary 2016 https://www.bls.gov//cex/pumd/data/stata/diary16.zip C:/Users/samko/Documents/CES/2016/ 5 intrvw 2015 https://www.bls.gov//cex/pumd/data/stata/intrvw15.zip C:/Users/samko/Documents/CES/2015/ 6 diary 2015 https://www.bls.gov//cex/pumd/data/stata/diary15.zip C:/Users/samko/Documents/CES/2015/ 7 intrvw 2014 https://www.bls.gov//cex/pumd/data/stata/intrvw14.zip C:/Users/samko/Documents/CES/2014/ 8 diary 2014 https://www.bls.gov//cex/pumd/data/stata/diary14.zip C:/Users/samko/Documents/CES/2014/ 9 intrvw 2013 https://www.bls.gov//cex/pumd/data/stata/intrvw13.zip C:/Users/samko/Documents/CES/2013/ 10 diary 2013 https://www.bls.gov//cex/pumd/data/stata/diary13.zip C:/Users/samko/Documents/CES/2013/ 11 intrvw 2012 https://www.bls.gov//cex/pumd/data/stata/intrvw12.zip C:/Users/samko/Documents/CES/2012/ 12 diary 2012 https://www.bls.gov//cex/pumd/data/stata/diary12.zip C:/Users/samko/Documents/CES/2012/ 13 intrvw 2011 https://www.bls.gov//cex/pumd/data/stata/intrvw11.zip C:/Users/samko/Documents/CES/2011/ 14 diary 2011 https://www.bls.gov//cex/pumd/data/stata/diary11.zip C:/Users/samko/Documents/CES/2011/ 15 intrvw 2010 https://www.bls.gov//cex/pumd/data/stata/intrvw10.zip C:/Users/samko/Documents/CES/2010/ 16 diary 2010 https://www.bls.gov//cex/pumd/data/stata/diary10.zip C:/Users/samko/Documents/CES/2010/ 17 intrvw 2009 https://www.bls.gov//cex/pumd/data/stata/intrvw09.zip C:/Users/samko/Documents/CES/2009/ 18 diary 2009 https://www.bls.gov//cex/pumd/data/stata/diary09.zip C:/Users/samko/Documents/CES/2009/ 19 intrvw 2008 https://www.bls.gov//cex/pumd/data/stata/intrvw08.zip C:/Users/samko/Documents/CES/2008/ 20 diary 2008 https://www.bls.gov//cex/pumd/data/stata/diary08.zip C:/Users/samko/Documents/CES/2008/ 21 intrvw 2007 https://www.bls.gov//cex/pumd/data/stata/intrvw07.zip C:/Users/samko/Documents/CES/2007/ 22 diary 2007 https://www.bls.gov//cex/pumd/data/stata/diary07.zip C:/Users/samko/Documents/CES/2007/ 23 intrvw 2006 https://www.bls.gov//cex/pumd/data/stata/intrvw06.zip C:/Users/samko/Documents/CES/2006/ 24 diary 2006 https://www.bls.gov//cex/pumd/data/stata/diary06.zip C:/Users/samko/Documents/CES/2006/ 25 intrvw 2005 https://www.bls.gov//cex/pumd/data/stata/intrvw05.zip C:/Users/samko/Documents/CES/2005/ 26 diary 2005 https://www.bls.gov//cex/pumd/data/stata/diary05.zip C:/Users/samko/Documents/CES/2005/ 27 intrvw 2004 https://www.bls.gov//cex/pumd/data/stata/intrvw04.zip C:/Users/samko/Documents/CES/2004/ 28 diary 2004 https://www.bls.gov//cex/pumd/data/stata/diary04.zip C:/Users/samko/Documents/CES/2004/ 29 intrvw 2003 https://www.bls.gov//cex/pumd/data/stata/intrvw03.zip C:/Users/samko/Documents/CES/2003/ 30 diary 2003 https://www.bls.gov//cex/pumd/data/stata/diary03.zip C:/Users/samko/Documents/CES/2003/ 31 intrvw 2002 https://www.bls.gov//cex/pumd/data/stata/intrvw02.zip C:/Users/samko/Documents/CES/2002/ 32 diary 2002 https://www.bls.gov//cex/pumd/data/stata/diary02.zip C:/Users/samko/Documents/CES/2002/ 33 intrvw 2001 https://www.bls.gov//cex/pumd/data/stata/intrvw01.zip C:/Users/samko/Documents/CES/2001/ 34 diary 2001 https://www.bls.gov//cex/pumd/data/stata/diary01.zip C:/Users/samko/Documents/CES/2001/ 35 intrvw 2000 https://www.bls.gov//cex/pumd/data/stata/intrvw00.zip C:/Users/samko/Documents/CES/2000/ 36 diary 2000 https://www.bls.gov//cex/pumd/data/stata/diary00.zip C:/Users/samko/Documents/CES/2000/ 37 intrvw 1999 https://www.bls.gov//cex/pumd/data/stata/intrvw99.zip C:/Users/samko/Documents/CES/1999/ 38 diary 1999 https://www.bls.gov//cex/pumd/data/stata/diary99.zip C:/Users/samko/Documents/CES/1999/ 39 intrvw 1998 https://www.bls.gov//cex/pumd/data/stata/intrvw98.zip C:/Users/samko/Documents/CES/1998/ 40 diary 1998 https://www.bls.gov//cex/pumd/data/stata/diary98.zip C:/Users/samko/Documents/CES/1998/ 41 intrvw 1997 https://www.bls.gov//cex/pumd/data/stata/intrvw97.zip C:/Users/samko/Documents/CES/1997/ 42 diary 1997 https://www.bls.gov//cex/pumd/data/stata/diary97.zip C:/Users/samko/Documents/CES/1997/ 43 intrvw 1996 https://www.bls.gov//cex/pumd/data/stata/intrvw96.zip C:/Users/samko/Documents/CES/1996/ 44 diary 1996 https://www.bls.gov//cex/pumd/data/stata/diary96.zip C:/Users/samko/Documents/CES/1996/ case_count 1 NA 2 NA 3 NA 4 NA 5 NA 6 NA 7 NA 8 NA 9 NA 10 NA 11 NA 12 NA 13 NA 14 NA 15 NA 16 NA 17 NA 18 NA 19 NA 20 NA 21 NA 22 NA 23 NA 24 NA 25 NA 26 NA 27 NA 28 NA 29 NA 30 NA 31 NA 32 NA 33 NA 34 NA 35 NA 36 NA 37 NA 38 NA 39 NA 40 NA 41 NA 42 NA 43 NA 44 NA

galsk223 avatar Aug 27 '19 01:08 galsk223

Sessioninfo

setting value
version R version 3.6.1 (2019-07-05) os Windows 10 x64
system x86_64, mingw32
ui RStudio
language (EN)
collate English_United States.1252
ctype English_United States.1252
tz America/Denver
date 2019-08-26

  • Packages ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- package * version date lib source
    assertthat 0.2.1 2019-03-21 [1] CRAN (R 3.6.1)
    backports 1.1.4 2019-04-10 [1] CRAN (R 3.6.0)
    callr 3.3.1 2019-07-18 [1] CRAN (R 3.6.1)
    cellranger 1.1.0 2016-07-27 [1] CRAN (R 3.6.1)
    cli 1.1.0 2019-03-19 [1] CRAN (R 3.6.1)
    crayon 1.3.4 2017-09-16 [1] CRAN (R 3.6.1)
    curl 4.0 2019-07-22 [1] CRAN (R 3.6.1)
    DBI 1.0.0 2018-05-02 [1] CRAN (R 3.6.1)
    desc 1.2.0 2018-05-01 [1] CRAN (R 3.6.1)
    devtools * 2.1.0 2019-07-06 [1] CRAN (R 3.6.1)
    digest 0.6.20 2019-07-04 [1] CRAN (R 3.6.1)
    fs 1.3.1 2019-05-06 [1] CRAN (R 3.6.1)
    glue 1.3.1 2019-03-12 [1] CRAN (R 3.6.1)
    httr 1.4.1 2019-08-05 [1] CRAN (R 3.6.1)
    lattice 0.20-38 2018-11-04 [2] CRAN (R 3.6.1)
    lodown * 0.1.0 2019-08-27 [1] Github (ajdamico/lodown@3225bf3) magrittr 1.5 2014-11-22 [1] CRAN (R 3.6.1)
    Matrix 1.2-17 2019-03-22 [2] CRAN (R 3.6.1)
    memoise 1.1.0 2017-04-21 [1] CRAN (R 3.6.1)
    mitools 2.4 2019-04-26 [1] CRAN (R 3.6.1)
    pillar 1.4.2 2019-06-29 [1] CRAN (R 3.6.1)
    pkgbuild 1.0.5 2019-08-26 [1] CRAN (R 3.6.1)
    pkgconfig 2.0.2 2018-08-16 [1] CRAN (R 3.6.1)
    pkgload 1.0.2 2018-10-29 [1] CRAN (R 3.6.1)
    plyr 1.8.4 2016-06-08 [1] CRAN (R 3.6.1)
    prettyunits 1.0.2 2015-07-13 [1] CRAN (R 3.6.1)
    processx 3.4.1 2019-07-18 [1] CRAN (R 3.6.1)
    ps 1.3.0 2018-12-21 [1] CRAN (R 3.6.1)
    R6 2.4.0 2019-02-14 [1] CRAN (R 3.6.1)
    Rcpp 1.0.2 2019-07-25 [1] CRAN (R 3.6.1)
    readxl 1.3.1 2019-03-13 [1] CRAN (R 3.6.1)
    remotes 2.1.0 2019-06-24 [1] CRAN (R 3.6.1)
    reshape2 1.4.3 2017-12-11 [1] CRAN (R 3.6.1)
    rlang 0.4.0 2019-06-25 [1] CRAN (R 3.6.1)
    rprojroot 1.3-2 2018-01-03 [1] CRAN (R 3.6.1)
    rstudioapi 0.10 2019-03-19 [1] CRAN (R 3.6.1)
    rvest 0.3.4 2019-05-15 [1] CRAN (R 3.6.1)
    selectr 0.4-1 2018-04-06 [1] CRAN (R 3.6.1)
    sessioninfo 1.1.1 2018-11-05 [1] CRAN (R 3.6.1)
    stringi 1.4.3 2019-03-12 [1] CRAN (R 3.6.0)
    stringr 1.4.0 2019-02-10 [1] CRAN (R 3.6.1)
    survey 3.36 2019-04-27 [1] CRAN (R 3.6.1)
    survival 2.44-1.1 2019-04-01 [2] CRAN (R 3.6.1)
    testthat 2.2.1 2019-07-25 [1] CRAN (R 3.6.1)
    tibble 2.1.3 2019-06-06 [1] CRAN (R 3.6.1)
    usethis * 1.5.1 2019-07-04 [1] CRAN (R 3.6.1)
    withr 2.1.2 2018-03-15 [1] CRAN (R 3.6.1)
    xml2 1.2.2 2019-08-09 [1] CRAN (R 3.6.1)

[1] C:/Users/samko/Documents/R/win-library/3.6 [2] C:/Program Files/R/R-3.6.1/library

galsk223 avatar Aug 27 '19 01:08 galsk223

hi! apologies for the long delay. i've made a couple of big updates to asdfree.com that hopefully make the website a bit better, but i've decided to stop maintaining the lodown package so probably won't fix the bug you've reported. the new asdfree does have ces data, but only for the most current year. thanks

ajdamico avatar Jan 09 '24 02:01 ajdamico