JuliaDB.jl
JuliaDB.jl copied to clipboard
Error with save()
I tried to rebuild the example with the NY Taxi data from the PyData Conference. I downloaded the data, saved it on my Computer and tried the following code:
addprocs()
@everywhere using JuliaDB
cd("//Users/NY_Taxi")
path = pwd()
db = loadtable(path; indexcols=[1,2])
save(db, "mydata")
With the save I get the following error message:
On worker 3:
[91mSystemError: opening file mydata/00002: No such file or directory[39m
#systemerror#44 at ./error.jl:64 [inlined]
systemerror at ./error.jl:64
open at ./iostream.jl:104
open at ./iostream.jl:132
open at ./iostream.jl:150
savechunk at /Users/tconring/.julia/v0.6/Dagger/src/chunks.jl:113
do_task at /Users/tconring/.julia/v0.6/Dagger/src/compute.jl:319
#106 at ./distributed/process_messages.jl:268 [inlined]
run_work_thunk at ./distributed/process_messages.jl:56
macro expansion at ./distributed/process_messages.jl:268 [inlined]
#105 at ./event.jl:73
Any ideas?
Update: if I run it on a single core - it works without any problems ...
Strange, looks like it's unable to create the mydata directory. That or it's creating it a bunch of time after mkdir is called.
There is always than an empty directory ...
Can you check this now? Also, what's the JuliaDB version you're using?
I have the same error message with loadtable. I am not sure what the problem may be?