Matthew Powers
Matthew Powers
@ggalves - Think I finally fixed this: https://github.com/MrPowers/spark-fast-tests/commit/28351e772a48e7968b6e90e674d1fb2b2853844f Sorry for keeping on messing this one up. See version 0.19.2. Let me know if there is anything else you need.
@robvadai - This sounds like a great idea. [This describes the current publishing process](https://github.com/MrPowers/spark-fast-tests/#publishing). Do you know how I can update this workflow to publish the sources? FYI @capdevc. I...
@awhillas - I don't think your issue is related, but this should help you get past your error 😄 : ```scala val expectedDF = spark.createDF( List( (1, 2017, 12, 1L),...
The new command is `sbt new scala/scala-seed.g8`. You can also run `brew edit giter8`, delete the `disable! because: "fetches unversioned dependencies at runtime"` line and rerun `brew install giter8`, [as...
@imarios - Thanks for the detailed responses. I started brainstorming the idea of typed columns, [see here](https://github.com/MrPowers/bebe#typedfunctions), and think this idea might be useful for frameless as well. Columns are...
@TomAugspurger - thanks for reviewing. I updated the example to build the Parquet lake from CSV files. Checking in CSV files to source control doesn't feel as wrong. The Parquet...
@TomAugspurger - thanks for the response. This code reads in CSV files and writes out Parquet files, so the current code should satisfy your wish to write out the Parquet...
Thank you for making this library. I can submit a pull request to bump the Spark version and set this to cross compile with Scala 2.12. Should be a relatively...
@l-gelman thanks for the ping, but I'm actually not working on Spark so much these days, so probably won't get to this.
I agree that it'd be great to have delta-spark in Conda. In the meantime, just posting an example environment file demonstrating how delta-spark can be installed via pip into a...