EXCEPTION_ACCESS_VIOLATION

[MaximilianJHuber]

trafficstars

I constructed a JuliaDB table and encountered spurious errors. Some times Julia just gets stuck executing code (even calling a typeof on the data leads the memory to fills up, despite the data set begin small), some times Julia crashed, some times the code works.

I am not sure whether the issue belongs here.

Julia 1.0.3 with IndexedTables 0.10, MemPool 0.1.2, JuliaDB master crashed when I run:

@apply data begin
            @filter !ismissing(:someFloat)
            @groupby :periodenddate {n = sum(:someFloat.!= 0.)}
            @filter :n != 0
end

with:

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x28d5002d -- getindex at .\array.jl:731 [inlined]
cmpelts at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\columns.jl:88 [inlined]
macro expansion at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\columns.jl:117 [inlined]
roweq at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\columns.jl:117
in expression starting at C:\Users\Max\.julia\packages\IJulia\GIANC\src\kernel.jl:41
getindex at .\array.jl:731 [inlined]
cmpelts at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\columns.jl:88 [inlined]
macro expansion at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\columns.jl:117 [inlined]
roweq at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\columns.jl:117
unknown function (ip: 0000000028D50069)
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
iterate at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\reduce.jl:167
unknown function (ip: 00000000183249DE)
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
grow_to_structarray! at C:\Users\Max\.julia\packages\StructArrays\4PC0g\src\collect.jl:88
unknown function (ip: 0000000028D531CE)
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
#collect_structarray#100 at C:\Users\Max\.julia\packages\StructArrays\4PC0g\src\collect.jl:77
#collect_structarray at .\none:0 [inlined]
#collect_structarray#97 at C:\Users\Max\.julia\packages\StructArrays\4PC0g\src\collect.jl:30 [inlined]
#collect_structarray at .\none:0 [inlined]
collect_columns at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\collect.jl:17 [inlined]
#groupby#192 at C:\Users\Max\.julia\packages\IndexedTables\iX34D\src\reduce.jl:233
#groupby at .\none:0 [inlined]
#_groupby#12 at C:\Users\Max\.julia\packages\JuliaDBMeta\nJuxd\src\groupby.jl:1 [inlined]
#_groupby at .\none:0 [inlined]
#14 at C:\Users\Max\.julia\packages\JuliaDBMeta\nJuxd\src\groupby.jl:4
jl_fptr_trampoline at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:1831
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
#52 at .\operators.jl:832
#52 at .\operators.jl:832
#_pipe#17 at C:\Users\Max\.julia\packages\JuliaDBMeta\nJuxd\src\apply.jl:4
jl_fptr_trampoline at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:1831
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
_pipe at C:\Users\Max\.julia\packages\JuliaDBMeta\nJuxd\src\apply.jl:4
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
do_call at /home/Administrator/buildbot/worker/package_win64/build/src\interpreter.c:324
eval_value at /home/Administrator/buildbot/worker/package_win64/build/src\interpreter.c:430
eval_stmt_value at /home/Administrator/buildbot/worker/package_win64/build/src\interpreter.c:363 [inlined]
eval_body at /home/Administrator/buildbot/worker/package_win64/build/src\interpreter.c:678
jl_interpret_toplevel_thunk_callback at /home/Administrator/buildbot/worker/package_win64/build/src\interpreter.c:806
unknown function (ip: FFFFFFFFFFFFFFFE)
unknown function (ip: 00000000082831BF)
unknown function (ip: 000000000000002B)
jl_toplevel_eval_flex at /home/Administrator/buildbot/worker/package_win64/build/src\toplevel.c:805
jl_toplevel_eval_in at /home/Administrator/buildbot/worker/package_win64/build/src\builtins.c:622
eval at .\boot.jl:319 [inlined]
softscope_include_string at C:\Users\Max\.julia\packages\SoftGlobalScope\dLfaZ\src\SoftGlobalScope.jl:218
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
execute_request at C:\Users\Max\.julia\packages\IJulia\GIANC\src\execute_request.jl:67
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
jl_apply at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:1537 [inlined]
jl_f__apply at /home/Administrator/buildbot/worker/package_win64/build/src\builtins.c:556
jl_f__apply_latest at /home/Administrator/buildbot/worker/package_win64/build/src\builtins.c:594
#invokelatest#1 at .\essentials.jl:697 [inlined]
invokelatest at .\essentials.jl:696 [inlined]
eventloop at C:\Users\Max\.julia\packages\IJulia\GIANC\src\eventloop.jl:8
#15 at .\task.jl:259
jl_fptr_trampoline at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:1831
jl_apply_generic at /home/Administrator/buildbot/worker/package_win64/build/src\gf.c:2184
jl_apply at /home/Administrator/buildbot/worker/package_win64/build/src\julia.h:1537 [inlined]
start_task at /home/Administrator/buildbot/worker/package_win64/build/src\task.c:268
Allocations: 236341497 (Pool: 236301204; Big: 40293); GC: 514

[joshday]

Can you also provide how you made data?

[MaximilianJHuber]

Sent you an email. Thank you!

[MaximilianJHuber]

I am afraid I can not provide a reproducible example. The exception happens some times when I start Jupyter fresh, but when the kernel rebooted and I run the exact same code again it works.

[joshday]

I haven't had time to load your data yet. Can you reproduce it outside of a macro? That might help narrow it down.