Alexandre Archambault

https://github.com/almond-sh/almond/pull/248 now allows to return some extra metadata along completions. This could be used to return stuff like https://github.com/ipython/ipykernel/pull/222 does. I don't know if there are front-ends that handle that...

Reproduced [here](https://gist.github.com/alexarchambault/ec4bae556354faeb7ce1c7062fd5183b), notebook with an `AmmoniteSparkSession` for comparison [here](https://gist.github.com/alexarchambault/3c967f5f11ac79ecf3fa643252c94f14), and [with just progress bars disabled](https://gist.github.com/alexarchambault/d828632b28605b1b0b72b37071506f9f). I would blame [our progress listener](https://github.com/almond-sh/almond/blob/fdcd0d805c45eaa476f386f3a9aeee587ee9f0b5/modules/scala/almond-spark/src/main/scala/org/apache/spark/sql/almondinternals/ProgressSparkListener.scala#L62-L97), that subsequently [sends updates to the front-end](https://github.com/almond-sh/almond/blob/fdcd0d805c45eaa476f386f3a9aeee587ee9f0b5/modules/scala/almond-spark/src/main/scala/org/apache/spark/sql/almondinternals/StageElem.scala#L73). Possibly some...

Should now "just" be a matter of implementing [this method](https://github.com/almond-sh/almond/blob/b11e947c52cedc5da65912c9d5f96e37a365b071/modules/scala/scala-interpreter/src/main/scala/almond/ScalaInterpreter.scala#L497-L500) well. Although last time I checked, it seemed to be no easy task to get the javadoc of symbols this...

We're using Ammonite, so we have [an instance](https://github.com/almond-sh/almond/blob/5a5dff4b7f626c78549132039ff8ada394ffa35c/modules/scala/scala-interpreter/src/main/scala/almond/ScalaInterpreter.scala#L165) of an [`ammonite.interp.Interpreter`](https://github.com/lihaoyi/Ammonite/blob/b5082b2e174f11379cc117f719be8252f95f5adc/amm/interp/src/main/scala/ammonite/interp/Interpreter.scala), which itself has a [`CompilerLifecycleManager`](https://github.com/lihaoyi/Ammonite/blob/b5082b2e174f11379cc117f719be8252f95f5adc/amm/interp/src/main/scala/ammonite/interp/CompilerLifecycleManager.scala), which can give us the current compiler instance. Note that we [receive requests](https://github.com/almond-sh/almond/blob/b11e947c52cedc5da65912c9d5f96e37a365b071/modules/scala/scala-interpreter/src/main/scala/almond/ScalaInterpreter.scala#L497) as...

Per the [Jupyter spec](https://jupyter-client.readthedocs.io/en/5.2.3/messaging.html#introspection), tooltips can be text, HTML (even with images and JS), markdown, ...

https://github.com/almond-sh/almond/pull/235 should provide `symbol.info.toString`.

The versions of almond and ammonite-spark don't match exactly. almond needs https://github.com/almond-sh/almond/pull/391 to be compatible with ammonite-spark `0.6.0`. I guess I should add the almond versions to [the ammonite-spark README](https://github.com/alexarchambault/ammonite-spark/blob/master/README.md#compatibility).

The upcoming almond `0.7.0` should be fine with ammonite-spark `0.6.0`.

I'd recommend loading the hadoop JARs before spark itself, like ```scala import $ivy.`org.apache.hadoop:hadoop-common:2.9.2` import $ivy.`org.apache.hadoop:hadoop-azure-datalake:3.1.1` import $ivy.`org.apache.spark::spark-sql:2.4.0` import org.apache.spark.sql.SparkSession val spark = NotebookSparkSession.builder().appName("Spark").master("local[*]").getOrCreate() import org.apache.hadoop.fs.adl.AdlFileSystem val hadoopConf = spark.sparkContext.hadoopConfiguration hadoopConf.set("fs.adl.impl",...

@javadba Don't know, what's the source of that list?