frameless
frameless copied to clipboard
typelevel
Expressive types for Spark.
Updates [org.scoverage:sbt-scoverage](https://github.com/scoverage/sbt-scoverage) from 2.0.0 to 2.0.2. [GitHub Release Notes](https://github.com/scoverage/sbt-scoverage/releases/tag/v2.0.2) - [Version Diff](https://github.com/scoverage/sbt-scoverage/compare/v2.0.0...v2.0.2) I'll automatically update this PR to resolve conflicts as long as you don't change it yourself. If you'd...
![typelevel-steward[bot] avatar](https://avatars.githubusercontent.com/u/3731824?v=4 "typelevel-steward[bot] avatar"){kind=avatar}
I took a TypedDataset of case class A, grouped it, mixing the order of two columns of the same type, resulting in a tupled dataset. I had to do this...
Resolves #186. Would be a good idea to wait for #110 before merging this to avoid conflict on `SelectTests.scala`.
…y Column functions Related to #164
This adds a typed API over Spark ML's `OneHotEncoderEstimator` since Spark 2.3.0
this pull request allows us to make Job into cats Reader/Kleisli monads. It opens up the proper monad stack for Job and enables the potential to use Job in Monad...
I am trying to use frameless in Databricks. Thanks to advice on gitter, I made some code modifications as described in [dsabanin/frameless@1ce8f0b](https://github.com/dsabanin/frameless/commit/1ce8f0b8b44b070f7f00079d65ec2c2f5dc42786), based on frameless 0.8.0. However, running some tests...
Currently there is no way to call several joins in chain. (ON condition fails to work with types) It makes code much less readable because of hard-to-read variables names.
Fix is shown here: https://github.com/dsabanin/frameless/commit/1ce8f0b8b44b070f7f00079d65ec2c2f5dc42786 Thanks to @dsabanin for the fix!
Great work on this lib! It's a great way to write Spark code! [As discussed here](https://github.com/typelevel/frameless/issues/321) and [in the docs](https://typelevel.org/frameless/FeatureOverview.html), `withColumn` requires a full schema when a column is added....
