Change Delta Lake, Hadoop and Spark versions

[osopardo1]

Description

Changes version for Delta, Hadoop, and Spark, and solves compatibility issues. This is for setting up the build for the upcoming changes in #98 and #4.

Type of change

Describe the change you're making: how it affects the API, user experience...

This will trigger a new Qbeast Spark release tag, so we can make it compatible with the newest Delta Version 1.2.0, Spark 3.2.x

Checklist:

Here is the list of things you should do before submitting this pull request:

• [x] New feature / bug fix has been committed following the Contribution guide.
• [x] Change the documentation.
• [x] Your branch is updated to the main branch (dependent changes have been merged).

[codecov[bot]]

Codecov Report

Merging #109 (be0f5b6) into main (133ca0b) will increase coverage by 0.01%. The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #109      +/-   ##
==========================================
+ Coverage   91.68%   91.70%   +0.01%     
==========================================
  Files          62       62              
  Lines        1432     1447      +15     
  Branches      105      114       +9     
==========================================
+ Hits         1313     1327      +14     
- Misses        119      120       +1     

Impacted Files	Coverage Δ
.../spark/internal/commands/AnalyzeTableCommand.scala	100.00% <ø> (ø)
.../spark/internal/commands/CompactTableCommand.scala	100.00% <ø> (ø)
...spark/internal/commands/OptimizeTableCommand.scala	100.00% <ø> (ø)
...o/qbeast/spark/delta/QbeastMetadataOperation.scala	69.84% <100.00%> (ø)
...spark/internal/expressions/QbeastMurmur3Hash.scala	100.00% <100.00%> (ø)
...ala/io/qbeast/spark/delta/writer/BlockWriter.scala	95.65% <0.00%> (-2.18%)	:arrow_down:
...rc/main/scala/io/qbeast/core/model/QDataType.scala	100.00% <0.00%> (ø)
...a/io/qbeast/core/transform/LinearTransformer.scala	100.00% <0.00%> (ø)
...o/qbeast/core/transform/LinearTransformation.scala	89.33% <0.00%> (+0.60%)	:arrow_up:
...ala/io/qbeast/spark/utils/SparkToQTypesUtils.scala	92.30% <0.00%> (+1.39%)	:arrow_up:
... and 1 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

[osopardo1]

If you approve the change of versions @polsm91 @eavilaes , I will merge it immediately and you could check any incompatibility if you want :+1:

[osopardo1]

Some versions still need to be changed (These are some of them, maybe do a find all):

This block references Spark 3.1 and Hadoop 3.2:

https://github.com/Qbeast-io/qbeast-spark/blob/be0f5b6be3535fe9b53e1a2a3f312a7c363d05bd/README.md?plain=1#L76-L86

And (I'm not sure that we must change this one yet) these refer to qbeast-spark 0.2 & delta 1.0:

https://github.com/Qbeast-io/qbeast-spark/blob/be0f5b6be3535fe9b53e1a2a3f312a7c363d05bd/README.md?plain=1#L92-L96

I also find old Spark 3.1.1 references here: qbeast-spark/docs/sample_pushdown_demo.ipynb

Yep, I left those untouched because we did not publish the package yet, so it's okay to use the old ones. Once we upload the release to the Maven Repository, I will update them. Thanks!