asdfree
asdfree copied to clipboard
Published
20 hours ago •
ajdamico
ajdamico
pisa catalog maker failing
Microsoft Windows [Version 6.3.9600]
(c) 2013 Microsoft Corporation. All rights reserved.
C:\Users\AnthonyD>"c:\program files\r\r-3.3.3\bin\x64\rterm.exe"
R version 3.3.3 (2017-03-06) -- "Another Canoe"
Copyright (C) 2017 The R Foundation for Statistical Computing
Platform: x86_64-w64-mingw32/x64 (64-bit)
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
Natural language support but running in an English locale
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
>
> source( lodown::syntaxtractor( "pisa" , replacements = list( c( "C:/My Direc$
> library(lodown)
> lodown( "pisa" , output_dir = "C:UsersAnthonyDAppDataLocalTemp9Rtmpo7LUCr/PISA
" )
building catalog for pisa
locally downloading pisa
Downloading from URL
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QQQ.zip'
to file
'C:\Users\AnthonyD\AppData\Local\Temp\19\Rtmpo7LUCr\file2f9c39652b2d'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QQQ.zip'
Content type 'application/x-zip-compressed' length 414921902 bytes (395.7 MB)
downloaded 395.7 MB
pisa catalog entry 1 of 33 stored in 'C:UsersAnthonyDAppDataLocalTemp9Rtmpo7LUCr
/PISA/MonetDB'
Downloading from URL
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_SCH_QQQ.zip'
to file
'C:\Users\AnthonyD\AppData\Local\Temp\19\Rtmpo7LUCr\file2f9c39652b2d'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_SCH_QQQ.zip'
Content type 'application/x-zip-compressed' length 3700290 bytes (3.5 MB)
downloaded 3.5 MB
pisa catalog entry 2 of 33 stored in 'C:UsersAnthonyDAppDataLocalTemp9Rtmpo7LUCr
/PISA/MonetDB'
Downloading from URL
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_TCH_QQQ.zip'
to file
'C:\Users\AnthonyD\AppData\Local\Temp\19\Rtmpo7LUCr\file2f9c39652b2d'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_TCH_QQQ.zip'
Content type 'application/x-zip-compressed' length 9604804 bytes (9.2 MB)
downloaded 9.2 MB
pisa catalog entry 3 of 33 stored in 'C:UsersAnthonyDAppDataLocalTemp9Rtmpo7LUCr
/PISA/MonetDB'
Downloading from URL
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_COG.zip'
to file
'C:\Users\AnthonyD\AppData\Local\Temp\19\Rtmpo7LUCr\file2f9c39652b2d'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_COG.zip'
Content type 'application/x-zip-compressed' length 196878270 bytes (187.8 MB)
downloaded 187.8 MB
pisa catalog entry 4 of 33 stored in 'C:UsersAnthonyDAppDataLocalTemp9Rtmpo7LUCr
/PISA/MonetDB'
Downloading from URL
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
to file
'C:\Users\AnthonyD\AppData\Local\Temp\19\Rtmpo7LUCr\file2f9c39652b2d'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
download issue with
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
download issue with
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
trying URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
download issue with
'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM.zip'
lodown is now exiting unexpectedly.
websites that host publicly-downloadable microdata change often and sometimes th
ose changes cause this software to break.
if the error call stack below appears to be a hiccup in your internet connection
, then please verify your connectivity and retry the download.
otherwise, please open a new issue at `https://github.com/ajdamico/lodown/issues
` with the contents of this error call stack and also the output of your `sessio
nInfo()`.
[[1]]
source(lodown::syntaxtractor("pisa", replacements = list(c("C:/My Directory",
tempdir())), setup_test = "setup"), echo = TRUE)
[[2]]
withVisible(eval(ei, envir))
[[3]]
eval(ei, envir)
[[4]]
eval(expr, envir, enclos)
[[5]]
lodown("pisa", output_dir = "C:UsersAnthonyDAppDataLocalTemp9Rtmpo7LUCr/PISA")
[[6]]
withCallingHandlers(catalog <- load_fun(data_name = data_name,
catalog, ...), error = function(e) {
if (grepl("cannot allocate vector of size", e))
message(memory_note)
else if (grepl("parameter must be specified", e))
message(parameter_note)
else if (grepl("to install", e))
message(installation_note)
else {
message(unknown_error_note)
print(sys.calls())
}
})
[[7]]
load_fun(data_name = data_name, catalog, ...)
[[8]]
cachaca(catalog[i, "full_url"], tf, mode = "wb")
[[9]]
stop(paste("download failed after", initial.attempts, "attempts"))
[[10]]
.handleSimpleError(function (e)
{
if (grepl("cannot allocate vector of size", e))
message(memory_note)
else if (grepl("parameter must be specified", e))
message(parameter_note)
else if (grepl("to install", e))
message(installation_note)
else {
message(unknown_error_note)
print(sys.calls())
}
}, "download failed after 3 attempts", quote(cachaca(catalog[i,
"full_url"], tf, mode = "wb")))
[[11]]
h(simpleError(msg, call))
Error in cachaca(catalog[i, "full_url"], tf, mode = "wb") :
download failed after 3 attempts
In addition: Warning messages:
1: In (function (url, destfile, method, quiet = FALSE, mode = "w", :
cannot open URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM
.zip': HTTP status was '404 Not Found'
2: In (function (url, destfile, method, quiet = FALSE, mode = "w", :
cannot open URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM
.zip': HTTP status was '404 Not Found'
3: In (function (url, destfile, method, quiet = FALSE, mode = "w", :
cannot open URL 'http://vs-web-fs-1.oecd.org/pisa/PUF_SAS_COMBINED_CMB_STU_QTM
.zip': HTTP status was '404 Not Found'
> source( lodown::syntaxtractor( "pisa" , replacements = list( c( "C:/My Direc$
https://github.com/jimhester/archive/issues/3 new error, same problem (fresh from brew on mac R: libarchive 3.3.3 )?:
archive_read_data_block(): Unsupported ZIP compression method (deflation-64-bit)
Low priority for me as I was just trying out asdfree but PISA appears stuck for now as it is using an unsupported format of zip for R's archive/libarchive.
Heh – I just followed your exact google trail via Stackoverflow, assuming 7z was the right answer and it looks like you unfortunately moved away from that most recently.: https://github.com/ajdamico/lodown/issues/99
[[1]]
lodown("pisa", output_dir = file.path(path.expand("~"), "PISA"))
[[2]]
withCallingHandlers(catalog <- load_fun(data_name = data_name,
catalog, ...), error = function(e) {
print(sessionInfo())
if (grepl("cannot allocate vector of size", e))
message(memory_note)
else if (grepl("parameter must be specified", e))
message(parameter_note)
else if (grepl("to install", e))
message(installation_note)
else {
message(unknown_error_note)
print(sys.calls())
}
})
[[3]]
load_fun(data_name = data_name, catalog, ...)
[[4]]
archive::archive_extract(tf, dir = paste0(tempdir(), "/unzips"))
[[5]]
archive_extract_(attr(archive, "path"), file)
[[6]]stop(list(message = "archive_read_data_block(): Unsupported ZIP compression method (deflation-64-bit)"...
[[7]]
(function (e)
{
print(sessionInfo())
if (grepl("cannot allocate vector of size", e))
message(memory_note)
else if (grepl("parameter must be specified", e))...
hi! apologies for the long delay. i've made a couple of big updates to asdfree.com that hopefully make the website a bit better, but i've decided to stop maintaining the lodown package so probably won't fix the bug you've reported. the new asdfree doesn't have pisa data yet, but it's on my to-do list. thanks