JuliaDB.jl icon indicating copy to clipboard operation
JuliaDB.jl copied to clipboard

Error with save()

Open HamletFr opened this issue 7 years ago • 5 comments
trafficstars

I tried to rebuild the example with the NY Taxi data from the PyData Conference. I downloaded the data, saved it on my Computer and tried the following code:

addprocs()
@everywhere using JuliaDB

cd("//Users/NY_Taxi")
path = pwd()

db = loadtable(path; indexcols=[1,2])
save(db, "mydata")

With the save I get the following error message:

On worker 3:
[91mSystemError: opening file mydata/00002: No such file or directory[39m
#systemerror#44 at ./error.jl:64 [inlined]
systemerror at ./error.jl:64
open at ./iostream.jl:104
open at ./iostream.jl:132
open at ./iostream.jl:150
savechunk at /Users/tconring/.julia/v0.6/Dagger/src/chunks.jl:113
do_task at /Users/tconring/.julia/v0.6/Dagger/src/compute.jl:319
#106 at ./distributed/process_messages.jl:268 [inlined]
run_work_thunk at ./distributed/process_messages.jl:56
macro expansion at ./distributed/process_messages.jl:268 [inlined]
#105 at ./event.jl:73

Any ideas?

HamletFr avatar Feb 23 '18 20:02 HamletFr

Update: if I run it on a single core - it works without any problems ...

HamletFr avatar Feb 23 '18 20:02 HamletFr

Strange, looks like it's unable to create the mydata directory. That or it's creating it a bunch of time after mkdir is called.

shashi avatar Feb 24 '18 00:02 shashi

There is always than an empty directory ...

HamletFr avatar Feb 24 '18 05:02 HamletFr

Can you check this now? Also, what's the JuliaDB version you're using?

shashi avatar Mar 12 '18 05:03 shashi

I have the same error message with loadtable. I am not sure what the problem may be?

minyoungrho avatar Jun 25 '18 17:06 minyoungrho