Carsten Behring
Carsten Behring
I did a complete walk-through, which starts from "zero" up to analysing a 10GB CVS file stored in a newly created Azure File Storage with Geni on an AKS cluster....
Thanks for the feedback, I will take it on board when writing the text. There is one piece eventually missing, not sure what you think. Working in a "kubectl exec"...
> I think that's a really good point. Copying and pasting to the terminal is not the end of the world, but it would absolutely be a deal breaker for...
> I think that's a really good point. Copying and pasting to the terminal is not the end of the world, but it would absolutely be a deal breaker for...
We could potentially make a bash script, which does the whole setup "on keypress". Including copy of a data file into the blob storage. (this can be the most time...
> > I did without using geni CLI, just by adding the nrepl start into the command used by the string container. > > Yes, this is exactly what I...
Please find here the working setup script: https://github.com/behrica/geni/blob/azure_storage_doc/docs/azureSetup/setupKubernetes.sh It does all the tasks as from here : https://github.com/behrica/geni/blob/azure_storage_doc/docs/kubernetes_azureStorage.md in one go. In the beginning there are some parameters to be...
I am not sure, in which form the script could be re-used, either "as is" , or with some modifications. The concrete setup has so many "moving parts", which a...
Maybe an easier pathway to the above is: - let geni/spark do everything and let it write parquet files to disk - write a cli tool which can convert a...
Maybe it helps to think about Geni + TDM in three scenarios: 1) I want to use TMD interactively but I have initial big data: - I know perfectly how...