templates-jupyter-datascience-notebooks
templates-jupyter-datascience-notebooks copied to clipboard
pysprark module not found with pyspark image
- create a dev container from quay.io/jupyter/pyspark-notebook:latest
- create a notebook
- select base python kernel
- enter:
from pyspark.sql import SparkSession
- run and get:
ModuleNotFoundError Traceback (most recent call last)
Cell In[1], [line 1](vscode-notebook-cell:?execution_count=1&line=1)
----> [1](vscode-notebook-cell:?execution_count=1&line=1) from pyspark.sql import SparkSession
ModuleNotFoundError: No module named 'pyspark'
what am I missing?