henridf

@lightclient I moved the ssz definitions into the repo. Unfortunately right now annotating `types.Block` isn't possible due to some current limitations of fastssz: - can't handle the `common.Hash` and `common.Address`...

@tobilg yes, some sort of high-level docs explaining the design choices tradeoffs are a good idea. It's probably still early to write those because all of those concepts are still...

Once things are in decent shape, I'm hoping that keeping up with Spark API changes won't be a huge burden - generally they tend to avoid make breaking API changes,...

Hi @Enilia - as @tobilg answers this doesn't appear to be an issue but if we're missing something please post a more complete description and I'll do my best to...

@itayw yes Zeppelin seems like another good candidate. I don't know if it already has javascript support though? Whichever one (Zeppelin, Beaker, ...) my hope is that this shouldn't require...

Note that (as of 149712572280c65682af48ed0e6e76ce637d44de) jsdoc creates docs for the _class_ SQLContext and its constructor, which isn't accessible outside of sqlContext.js. Need to figure out how to address this.

Also need to make a pass to do something about the backticks in comments as they currently just add noise. One option is to remove them, another is to replace...

`lib/sqlContext.js` done in 149712572280c65682af48ed0e6e76ce637d44de and 81be03622047bd78b249316ab7b9d7fe8f3644d8 `lib/DataFrameReader.js` done in c73dbdc6ce189db3152c719d4b5c7739b138351f `lib/GroupedData.js` done in bdf9d1d5830f2507ea96e4d0290397440dc0ab6e

`lib/functions.js` done in b30df948ca88b095f11d96c60244af9f76a01352

lib/Column.js docs done in da6c0cd515381ba589e6f906e38bf7b32f16e2e5 and db2f67eeff8610e22f0278e1527ca77e70b29730