Matthew Powers

Results 285 comments of Matthew Powers

See here for the utest output that doesn't have all the info warnings: https://github.com/MrPowers/spark-fast-tests/issues/64

@gorros @carlsverre - Here's a PR to migrate spark-fast-tests back to Scalatest (it's currently using utest): https://github.com/MrPowers/spark-fast-tests/pull/69 I think it'll be easier to develop the optimal Scalatest output if this...

Here's the current DataFrame comparison message: Here's the new message (added in [this PR](https://github.com/MrPowers/spark-fast-tests/pull/71)): @carlsverre @gorros @snithish - can you please take a look and let me know if this...

@akuzni2 - cool, feel free to send a PR ;) Here's the current syntax for unordered row comparisons: `assertSmallDataFrameEquality(sourceDF, expectedDF, orderedComparison = false)`. What do you think about this syntax...

@akuzni2 - sounds great, feel free to open up a pull request and let me know if you have any questions / need any help!

@akuzni2 - You can manage the Java versions on your machine with [jenv](https://mungingdata.com/java/jenv-multiple-versions-java/) or [sdkman](https://mungingdata.com/java/sdkman-multiple-versions-java-sbt-scala/)... if you're using a Mac at least. Not sure about the Docker setup, but that...

@miikargh - I [pushed up a fixed](https://github.com/MrPowers/spark-fast-tests/commit/d78854d876f7ca68ece7f21b30dc12db7bbb4e15) and released a new version. Can you please try `libraryDependencies += "com.github.mrpowers" %% "spark-fast-tests" % "0.22.0" % "test"` and let me know if...

@adrixgc - Here's a fix: https://github.com/MrPowers/spark-fast-tests/pull/92 Looks like we can avoid the column ordering. Let me know if this fix looks alright to you! Thanks for reporting this edge case!

@adrixgc - you're right, thanks for the additional test case to illustrate the issue. Pushed up [another commit](https://github.com/MrPowers/spark-fast-tests/pull/92/commits/20b1b5f4574a63c8c8007b0f77a94b11e7156b08) that only sorts the precise columns (not the float, decimal, or double)...

Thanks for the great question @jdk2588 😄 It looks like [it's possible to run a Scala JAR file in Java](https://stackoverflow.com/questions/29778327/how-to-run-scala-jar-file-within-java-file), but I don't know because I've never used Java. You...