arrow-julia icon indicating copy to clipboard operation
arrow-julia copied to clipboard

Segfault when filtering Arrow-backed DataFrame

Open ericphanson opened this issue 3 years ago • 2 comments

signal (11): Segmentation fault
in expression starting at none:1
unknown function (ip: 0x7f82a3ce5527)
jl_symbol_n at /buildworker/worker/package_linux64/build/src/symbol.c:113
_symbol at /home/ubuntu/.julia/packages/ArrowTypes/dkiHE/src/ArrowTypes.jl:208 [inlined]
fromarrow at /home/ubuntu/.julia/packages/ArrowTypes/dkiHE/src/ArrowTypes.jl:209 [inlined]
getindex at /home/ubuntu/.julia/packages/Arrow/PQ5Mm/src/arraytypes/list.jl:56 [inlined]
macro expansion at ./multidimensional.jl:860 [inlined]
macro expansion at ./cartesian.jl:64 [inlined]
_unsafe_getindex! at ./multidimensional.jl:855 [inlined]
_unsafe_getindex at ./multidimensional.jl:846
_getindex at ./multidimensional.jl:832 [inlined]
getindex at ./abstractarray.jl:1170
unknown function (ip: 0x7f821e6d691c)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2237 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2419
_threaded_getindex at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/dataframe/dataframe.jl:531
getindex at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/dataframe/dataframe.jl:574 [inlined]
#filter#78 at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/abstractdataframe/abstractdataframe.jl:1017 [inlined]
filter at /home/ubuntu/.julia/packages/DataFrames/vuMM8/src/abstractdataframe/abstractdataframe.jl:1016 [inlined]

which points to https://github.com/JuliaData/Arrow.jl/blob/56f8f9342389c1b9664157ca4a2d1f5501d8341d/src/ArrowTypes/src/ArrowTypes.jl#L208

I don't have a MWE currently.

ericphanson avatar Oct 28 '21 20:10 ericphanson

Another one. I think I'm calling copy(::DataFrame).

signal (11): Segmentation fault
in expression starting at /home/...
__memmove_sse2_unaligned_erms at /nix/store/s9qbqh7gzacs7h68b2jfmn9l6q4jwfjz-glibc-2.33-59/lib/libc.so.6 (unknown line)
jl_pchar_to_string at /buildworker/worker/package_linux64/build/src/array.c:507
unsafe_string at ./strings/string.jl:67 [inlined]
fromarrow at /home/user/.julia/packages/ArrowTypes/dkiHE/src/ArrowTypes.jl:201 [inlined]
getindex at /home/user/.julia/packages/Arrow/ZlMFU/src/arraytypes/list.jl:56 [inlined]
copyto_unaliased! at ./abstractarray.jl:1018
copyto! at ./abstractarray.jl:998
copymutable at ./abstractarray.jl:1129
copy at ./abstractarray.jl:1073 [inlined]
_preprocess_column at /home/user/.julia/packages/DataFrames/zqFGs/src/dataframe/dataframe.jl:229
unknown function (ip: 0x7fbb3c15a98e)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2247 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2429
#155 at ./threadingconstructs.jl:178
unknown function (ip: 0x7fb88a1a3c1f)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2247 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2429
jl_apply at /buildworker/worker/package_linux64/build/src/julia.h:1788 [inlined]
start_task at /buildworker/worker/package_linux64/build/src/task.c:877
Allocations: 917429815 (Pool: 917324438; Big: 105377); GC: 1888
zsh: segmentation fault (core dumped)  juliab

jariji avatar Aug 26 '22 08:08 jariji

I wonder if https://github.com/JuliaLang/julia/pull/47865 is related; the _Symbol there differs from the problematic line here by a root argument 🤔

ericphanson avatar Dec 21 '22 00:12 ericphanson