aztk
aztk copied to clipboard
AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure
Will there be any chance or plan to support higher version of spark, say spark2.4.5 and spark3.0.0? Thanks.
Bumps [cryptography](https://github.com/pyca/cryptography) from 2.8 to 3.2. Changelog Sourced from cryptography's changelog. 3.2 - 2020-10-25 * **SECURITY ISSUE:** Attempted to make RSA PKCS#1v1.5 decryption more constant time, to protect against Bleichenbacher...
Docker Images to deploy an AZTK Batch Account Cluster with the latest Spark Version 3.0 Here are the feature highlights in Spark 3.0: **1. Adaptive query execution; 2. Dynamic partition...
Tried to SSH into cluster on Windows 10 using the following [https://github.com/Azure/aztk/wiki/SparklyR-on-Azure-with-AZTK](url) but faced similar issue to #368: Secrets.yaml seems to be in the right format (public-private key pair is...
I was getting the same error from: https://github.com/Azure/aztk/issues/665 So, I tried using the 0.9.1 version and now get this error when installing: ``` tommy@Azure:~$ wget -q https://raw.githubusercontent.com/Azure/aztk/v0.9.1/account_setup.shwget -q https://raw.githubusercontent.com/Azure/aztk/v0.9.1/account_setup.sh tommy@Azure:~$...
 Link points to: https://github.com/Azure/aztk/blob/master/01-Getting-Started-Script
Created a new cloud shell, run the command and this error is given; `Installing dependencies... Finished installing dependencies. Getting account setup script... Finished getting account setup script. Running account setup...
I'm trying to install aztk inside a virtualenv (i.e. fresh install); however, I'm getting an error similar to https://github.com/Azure/aztk/issues/665 ``` …/tmp/spark virtualenv aztk Using base prefix '/usr/local/Cellar/python/3.7.3/Frameworks/Python.framework/Versions/3.7' New python...
I've used the template in core-site.xml to access containers in Azure Storage before, but when I tried it again recently it didn't work. I found I had to replace the...