Neil Best

Results 27 comments of Neil Best

Log4j was upgraded from 1.x to 2.x ("Log4j2") ~DBR 11.0 # DBR 13.3 Driver config: `/databricks/spark/dbconf/log4j/driver/log4j2.xml` Executor config: `/databricks/spark/dbconf/log4j/executor/log4j2.xml` (both on the driver's host FS) # Log4j2 docs from "[Configuration...

Because the logging configuration that ships with a DBR can change let's consider this approach to adding new elements to the config: "[Initialize Log4j by Combining Configuration File with Programmatic...

There are some [relevant code snippets](https://databricks.atlassian.net/wiki/x/IwCcr) in our internal wiki that I need to study. Here they are for convenience: > # Using scala commands: > > ## For package...

@souravbaner-da, what does the comment [here](https://github.com/databrickslabs/overwatch/blob/9eb4a3c2c0f3e81ae2d1b1307f9d553562f17a16/src/main/scala/com/databricks/labs/overwatch/pipeline/WorkflowsTransforms.scala#L1055) imply now that this issue is resolved? https://github.com/databrickslabs/overwatch/blob/9eb4a3c2c0f3e81ae2d1b1307f9d553562f17a16/src/main/scala/com/databricks/labs/overwatch/pipeline/WorkflowsTransforms.scala#L1055 There are other comments in the `0810_release` branch that say "TODO . . . after 503"...

Looks like the fix goes [here](https://github.com/databrickslabs/migrate/blob/52b7eb3e8505b68be20a342341200198c9524b8d/dbclient/SecretsClient.py#L45). Looking for the right idiom . . . my Python is not so good-looking (hat tip, Celia Cruz) . . .

Would [this](https://stackoverflow.com/a/59848177) work? > If the directory name contains a slash the OS module sees this as a :. Therefore you can create dirs containing slashes by specifying the dirname...

Let's check whether this is still happening during the next milestone.

Do runs in progress already get closed? Need to check the data again.

`0820_release` should be moved to the tip of `main` before completing this PR, therefore I am leaving it in draft status for now.