John Zhuge
John Zhuge
It'd nice to allow loading multiple properties files, e.g., env var `SPARK_CONF_DEFAULTS` may contain comma/space delimited paths.
At https://github.com/alexarchambault/ammonite-spark/blob/ff9df488bd7b7d721833ce7fc1323e665a6ffb79/modules/core/src/main/scala/org/apache/spark/sql/ammonitesparkinternals/AmmoniteSparkSessionBuilder.scala#L138, key and value must be delimited by spaces, while Java properties file format allows `=` and `:`. https://docs.oracle.com/javase/7/docs/api/java/util/Properties.html#load%28java.io.Reader%29
The version is incorrectly set to "$scalaVersion" which is 2.12. It should use semver, e.g. 2.12.15. By removing the explicit version, the version specified by Spark modules will be used....
### What changes were proposed in this pull request? ViewCatalog API described in [SPIP](https://docs.google.com/document/d/1XOxFtloiMuW24iqJ-zJnDzHl2KMxipTjJoxleJFz66A/edit?usp=sharing). ### Why are the changes needed? First step towards DataSourceV2 view support. ### Does this PR...
### What changes were proposed in this pull request? This PR adds support to load, create, alter, and drop views in DataSource V2 catalogs. This is an umbrella PR that...
Save scheduler job metadata entries to env so that they are available for Spark run.py.
**Describe the bug** `weep credential_process --generate` overwrites the aws config file. It is not desirable. **To Reproduce** Steps to reproduce the behavior: 1. Install weep and run `weep credential_process --generate`...
One label can be os type: ubuntu14, ubuntu16, windows, centos65, etc. Enable grind to select test slaves based on specified label matching patterns.