asdfree icon indicating copy to clipboard operation
asdfree copied to clipboard

Error downloading POF

Open jwainer opened this issue 5 years ago • 0 comments

Error downloading any of the POF data. My understanding is that the problem is in the httr call.

The ftp sites were ok when I ran lodown. Below is the call stack

[[1]] lodown("pof", pof2, path_to_7za = "7z")

[[2]] withCallingHandlers(catalog <- load_fun(data_name = data_name, catalog, ...), error = function(e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } })

[[3]] load_fun(data_name = data_name, catalog, ...)

[[4]] cachaca(catalog[i, "full_urls"], tf, mode = "wb")

[[5]] httr_filesize(this_url, attempts, sleepsec)

[[6]] stop(paste0("httr::HEAD( '", url, "' )\nfailed after ", initial.attempts, " attempts"))

[[7]] .handleSimpleError(function (e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } }, "httr::HEAD( 'ftp://ftp.ibge.gov.br/Orcamentos_Familiares/Pesquisa_de_Orcamentos_Familiares_2017_2018/Microdados/Dados.zip' )\nfailed after 3 attempts", base::quote(httr_filesize(this_url, attempts, sleepsec)))

[[8]] h(simpleError(msg, call))

Error in httr_filesize(this_url, attempts, sleepsec) : httr::HEAD( 'ftp://ftp.ibge.gov.br/Orcamentos_Familiares/Pesquisa_de_Orcamentos_Familiares_2017_2018/Microdados/Dados.zip' ) failed after 3 attempts full_urls 1 ftp://ftp.ibge.gov.br/Orcamentos_Familiares/Pesquisa_de_Orcamentos_Familiares_2017_2018/Microdados/Dados.zip period 1 2017_2018 documentation 1 ftp://ftp.ibge.gov.br/Orcamentos_Familiares/Pesquisa_de_Orcamentos_Familiares_2017_2018/Microdados/documentacao.zip aliment_file 1 ftp://ftp.ibge.gov.br/Orcamentos_Familiares/Pesquisa_de_Orcamentos_Familiares_2017_2018/Microdados/tradutores.zip output_folder case_count 1 /Users/wainer/DADOS/POF/2017_2018 NA

The sessionInfo() data

sessionInfo() R version 3.6.1 (2019-07-05) Platform: x86_64-apple-darwin15.6.0 (64-bit) Running under: macOS Mojave 10.14.6

Matrix products: default BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib LAPACK: /Library/Frameworks/R.framework/Versions/3.6/Resources/lib/libRlapack.dylib

locale: [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages: [1] grid stats graphics grDevices utils datasets methods base

other attached packages: [1] lodown_0.1.0 survey_3.36 survival_3.1-7 Matrix_1.2-17 dplyr_0.8.3

loaded via a namespace (and not attached): [1] tidyselect_0.2.5 xfun_0.11 remotes_2.1.0 purrr_0.3.3 mitools_2.4 splines_3.6.1
[7] lattice_0.20-38 vctrs_0.2.0 testthat_2.3.0 htmltools_0.4.0 usethis_1.5.1 yaml_2.2.0
[13] utf8_1.1.4 rlang_0.4.1 pkgbuild_1.0.6 pillar_1.4.2 glue_1.3.1 withr_2.1.2
[19] DBI_1.0.0 readxl_1.3.1 sessioninfo_1.1.1 cellranger_1.1.0 devtools_2.2.1 evaluate_0.14
[25] memoise_1.1.0 knitr_1.26 callr_3.3.2 ps_1.3.0 curl_4.2 fansi_0.4.0
[31] Rcpp_1.0.3 backports_1.1.5 desc_1.2.0 pkgload_1.0.2 fs_1.3.1 packrat_0.5.0
[37] digest_0.6.22 processx_3.4.1 rprojroot_1.3-2 bitops_1.0-6 cli_1.1.0 tools_3.6.1
[43] magrittr_1.5 RCurl_1.95-4.12 tibble_2.1.3 crayon_1.3.4 pkgconfig_2.0.3 zeallot_0.1.0
[49] ellipsis_0.3.0 rsconnect_0.8.15 prettyunits_1.0.2 httr_1.4.1 assertthat_0.2.1 rmarkdown_1.17
[55] rstudioapi_0.10 R6_2.4.1 compiler_3.6.1

jwainer avatar Nov 25 '19 00:11 jwainer