graalpython icon indicating copy to clipboard operation
graalpython copied to clipboard

GraalPy doesn't work with spaCy NLP

Open kevintanhongann opened this issue 1 year ago • 1 comments

GraalPy doesn't work with spaCy libraries because spaCy uses native extensions. Python binary wheels don't exist for spaCy yet.

GboX5l7bcAAPQK7

kevintanhongann avatar Nov 06 '24 02:11 kevintanhongann

Thanks for reporting this, @kevintanhongann.

spaCy not only uses native extensions itself, it also depends on numpy and numerous other Python packages that also use native extensions. Building all of this from source can easily take over an hour on a standard developer machine, which probably explains why the build process is not done on your machine after 12min.

An early experiment on our end shows that spaCy can be built from source for GraalPy, and that a bunch of tests are passing already. However, there are also some segfaults that need to be addressed before it makes sense to look into distributing binary wheels for all of this.

fniephaus avatar Nov 06 '24 09:11 fniephaus