Spark-The-Definitive-Guide
Spark-The-Definitive-Guide copied to clipboard
Chapter 9: DataSources - Partitioning based on a sliding window section - python
The below piece of code when run on a spark 3 cluster
in python
colName = "count" upperBound = 348113L numPartitions = 10 lowerBound = 0L
fails with File "
Below is the correct code
colName = "count"
upperBound = 348113
numPartitions = 10
lowerBound = 0