rasterframes icon indicating copy to clipboard operation
rasterframes copied to clipboard

rf-notebooks: Permissions on proj directory

Open vpipkt opened this issue 6 years ago • 5 comments

In trying to work with pyproj library within the rf-notebooks docker container we see error messages like this on the notebook server stdout:

proj_create: Open of /opt/conda/share/proj failed proj_create: init=epsg:/init=IGNF: syntax not supported in non-PROJ4 emulation mode

Which I suspect is due to the way the libraries are installed. Root permissions for subfolders of /opt/conda/share/proj....

$ !ls -la /opt/conda/share/proj/
total 12888
drwxr-sr-x 2 root   users    4096 Aug 12 15:22 .
drwsrwsr-x 1 jovyan users    4096 Aug 23 18:17 ..
-rw-rw-r-- 2 root   root  1053928 May 23 11:47 alaska
-rw-rw-r-- 2 root   root    83696 May 23 11:47 BETA2007.gsb
-rw-rw-r-- 2 root   root     1183 May 23 11:47 CH
-rw-rw-r-- 2 root   root   264424 May 23 11:47 conus
-rw-rw-r-- 2 root   root  4153000 May 23 11:47 egm96_15.gtx
-rw-rw-r-- 2 root   root     8872 May 23 11:47 FL
-rw-rw-r-- 2 root   root      728 May 23 11:47 GL27
-rw-rw-r-- 2 root   root   452008 May 23 11:47 hawaii
-rw-rw-r-- 2 root   root     2099 May 23 11:47 ITRF2000
-rw-rw-r-- 2 root   root     3660 May 23 11:47 ITRF2008
-rw-rw-r-- 2 root   root     3498 May 23 11:47 ITRF2014
-rw-rw-r-- 2 root   root     3560 May 23 11:47 MD
-rw-rw-r-- 2 root   root    19535 May 23 11:47 nad27
-rw-rw-r-- 2 root   root    16593 May 23 11:47 nad83
-rw-rw-r-- 2 root   root     6385 May 23 11:47 nad.lst
-rw-rw-r-- 2 root   root   277424 May 23 11:47 ntf_r93.gsb
-rw-rw-r-- 2 root   root  1113184 May 23 11:47 ntv1_can.dat
-rw-rw-r-- 2 root   root      232 May 23 11:47 null
-rw-rw-r-- 2 root   root   318464 May 23 11:47 nzgd2kgrid0005.gsb
-rw-rw-r-- 2 root   root     3915 May 23 11:47 other.extra
-rw-rw-r-- 2 root   root  5201920 May 23 11:47 proj.db
-rw-rw-r-- 2 root   root    26728 May 23 11:47 prvi
-rw-rw-r-- 2 root   root    59208 May 23 11:47 stgeorge
-rw-rw-r-- 2 root   root    26728 May 23 11:47 stlrnc
-rw-rw-r-- 2 root   root     7048 May 23 11:47 stpaul
-rw-rw-r-- 2 root   root     4424 May 23 11:47 TN
-rw-rw-r-- 2 root   root     6760 May 23 11:47 WI
-rw-rw-r-- 2 root   root    11112 May 23 11:47 WO
-rw-rw-r-- 2 root   root     7079 May 23 11:47 world

vpipkt avatar Sep 05 '19 18:09 vpipkt

a good test for this would be to try to render some vector data with folium ... a little difficult to do in a unit test though. but right now we get a segmentation fault within the container on trying to create a folium.GeoJson(geopandas_df) object

vpipkt avatar Sep 09 '19 14:09 vpipkt

FWIW i tried changing permissions on teh directory but no joy

vpipkt avatar Sep 09 '19 14:09 vpipkt

FWIW i tried changing permissions on the directory but no joy.

I suspect perhaps we ought to be pip installing versus conda installing these: https://github.com/locationtech/rasterframes/blob/develop/rf-notebook/src/main/docker/Dockerfile#L15

vpipkt avatar Sep 09 '19 14:09 vpipkt

Now i suspect this is causing a segmentation fault when trying soemthing like geopandas df.to_crs(crs) ... need to get to a minimum reproducible example

vpipkt avatar Nov 12 '19 18:11 vpipkt

@vpipkt

I suspect perhaps we ought to be pip installing versus conda installing these

I'm worried if we go back to pip we'll run into the problem with packages not all getting resolved from conda-forge.

Which directory and what permissions do you want? We can just set it during the docker build.

metasim avatar Nov 12 '19 18:11 metasim