Jolan Rensen

Results 441 comments of Jolan Rensen

Well... ![image](https://user-images.githubusercontent.com/17594275/169815632-0aaed276-2e17-4dfa-ad50-fdcf9dd74834.png) It can be generated like this, but the file becomes 7+ GB... so enjoy I guess... But for real, the only way to do this would be to...

It's strange, Scala cán do this. It allows the type to switch within the copy method, keeping the original types when a parameter is not supplied. It feels like it's...

Related youtracks issue: https://youtrack.jetbrains.com/issue/KT-52519

Oops, looks like we didn't update the getting started guide correctly! At the time of writing we only support one Scala version, so the correct way to use version 1.1.0...

I'm not sure what's wrong, it's available like that on mavenCentral: https://mvnrepository.com/artifact/org.jetbrains.kotlinx.spark/kotlin-spark-api-3.2/1.1.0 Maybe another `gradle clean`?

@asm0dey Pretty interesting idea indeed! I got curious, so I removed KSparkSession using the new context receivers and while IntelliJ does not seem to agree, it does work! You can...

@asm0dey yes that's right. That's already possible, but it might be heavy, since it needs to first collect everything in memory and then run the stdlib functions on the resulting...

@asm0dey Yeah you're right. It's somewhere in between. However, for some functions, I'm not sure how efficient they will be. For instance, `first { it.a > 0 }`. If you...

@asm0dey What should I do? In many cases I have the option to go a spark-only route or convert it to an iterable first. In almost all cases, the spark-only...

@asm0dey Alright, but one needs to be the default, because it's an operator function in this case :)