templates-jupyter-datascience-notebooks icon indicating copy to clipboard operation
templates-jupyter-datascience-notebooks copied to clipboard

pysprark module not found with pyspark image

Open artm opened this issue 1 year ago • 0 comments

  1. create a dev container from quay.io/jupyter/pyspark-notebook:latest
  2. create a notebook
  3. select base python kernel
  4. enter:
from pyspark.sql import SparkSession
  1. run and get:
ModuleNotFoundError                       Traceback (most recent call last)
Cell In[1], [line 1](vscode-notebook-cell:?execution_count=1&line=1)
----> [1](vscode-notebook-cell:?execution_count=1&line=1) from pyspark.sql import SparkSession
ModuleNotFoundError: No module named 'pyspark'

what am I missing?

artm avatar Apr 27 '24 07:04 artm