sparkmagic

sparkmagic copied to clipboard

[BUG]%%pretty with chinese character error

11

**Describe the bug** when use %%pretty function, if there is chinese character in the table, the table cannot show properly and return this error. An internal error was encountered. Please...

kongLingming06

**Describe the bug** I am using a PySpark kernel inside a Jupyter notebook attached to an EMR cluster. When I first start my PySpark session and run some code to...

rankol

Add configurable progress and session info indicators

4

### Description Configuration options are added to allow override of the spark statement progress indicator and for the html table of session info upon startup. Both come with defaults that...

amitschang

### Description DataFrame may contain some data which may get parsed to MathJax elements which don't play nicely with tables & may not properly represent the actual dataframe data. To...

utkarshgupta137

[BUG] Running sparkmagic notebook in sagemaker lifecycle script

4

**Describe the bug** Through sagemaker notebooks I am trying to run a sparkmagic notebook (to talk to an emr) via nbconvert inside of the lifecycle script that runs during start...

byteford

Create official Docker images (was: docker-compose build failure)

17

docker-compose build Not able to build spark core. Error logs: >[error] /apps/build/spark/core/src/test/java/test/org/apache/spark/JavaAPISuite.java:36: warning: [deprecation] Accumulator in org.apache.spark has been deprecated [error] import org.apache.spark.Accumulator; [error] ^ [error] /apps/build/spark/core/src/test/java/test/org/apache/spark/JavaAPISuite.java:37: warning: [deprecation] AccumulatorParam...

devender-yadav

Add CI support for Python 3.10

1

### Description Follow up from https://github.com/jupyter-incubator/sparkmagic/pull/755, this adds Python 3.10 to CI, so we can have a stronger support guarantees. ### Checklist - [x] Wrote a description of my changes...

devstein

### Description This PR is WIP -- unit tests coming shortly, wanted to sanity check the general approach and see if this makes sense at all. The motivation is this...

walarue

[BUG] Ipython API change

4

**Describe the bug** Starting a new session on IPython 8.0.1 produces the error: `AttributeError: 'ZMQInteractiveShell' object has no attribute 'write'` **To Reproduce** Start a session with the following versions: IPython==8.0.1...

spencer-bullent-work

hi, I am trying to cycle through date variables as strings in jupyter hub and run a spark session for each date. startdate enddate finaldate while startdate != finaldate: v_start...

vadensam