aztk

aztk copied to clipboard

Feature/job plugins

1

support plugins in cluster_configuration in job.yaml

SidWeng

How can one connect to azure datalake gen2. We don't see any documentation around this.

devendrasr

Adding user not working

1

I tried creating a user with just a password and also with setting an SSH key. In both cases, I cannot log in with the password. I get "Permission denied,...

C-K-Loan

Misleading CLI exit codes

3

We've had some automated jobs silently failing due to exit code 0 being returned in these two error conditions: * Cluster provisioning with `aztk spark cluster create` failed due to...

jaley

SparklyR Setup

1

Hi. I'm following the instructions from "SparklyR on Azure with AZTK", but gets an error when I run: aztk spark cluster create --id testsparkclust4 --size 2 Error: Toolkit doesn't have...

martindut

AZTK container has 338 CVEs

2

In running a security scan of the AZTK container using Artifactory X-Ray, I find 338 CVEs. This is largely due to basically using a complete, desktop linux system. For example,...

seanmmccormick

Currently, docker image downloads default to the OS disk. This behavior should change so that the ephemeral disk is used. A new `/mnt/aztk-docker/` folder can be set as docker root...

jafreck

The following `spark-submit` options are really useful for tweaking the spark configuration/environment on a per-app/job basis: - `--packages` - `--exclude-packages` - `--repositories` - `--conf` - `--properties-file` The changes to the...

jamesclarke

Setup_host.sh retry docker image pull bug

1

This line in setup_host.sh is invalid bash: https://github.com/Azure/aztk/blob/72c7833fbfa3d7e166a07c64c3a170ff6c17b651/aztk/node_scripts/setup_host.sh#L49 As a result, image pull retries never fire. Arithmetic should be enclosed in double parenthesis.

jafreck

Fix #629

jafreck