doAzureParallel icon indicating copy to clipboard operation
doAzureParallel copied to clipboard

AzureRMR interface

Open hongooi73 opened this issue 6 years ago • 3 comments

@brnleehng Would you be interested in a PR to add an AzureRMR interface, now that it's on CRAN? This should simplify the process of setup, and also allow possible future integration with AzureStor for storage accounts.

hongooi73 avatar Feb 10 '19 06:02 hongooi73

Hi Hong,

Are you thinking of a PR for Batch management APIs to AzureRMR?

Thanks, Brian

brnleehng avatar Feb 13 '19 20:02 brnleehng

No, I mean adding an AzureRMR interface to doAzureParallel and/or rAzureBatch. AzureRMR provides the framework for interacting with Resource Manager, which can be extended and customised by other packages.

This means people could do something like

library(rAzureBatch)
az <- AzureRMR::get_azure_login()
res <- az$
    get_subscription("sub_id")$
    get_resource_group("resgrp")$
    create_batch("clusname", nodes=10, size="Standard_DS2_v2", ...etc...)

# get the batch cluster
clus <- res$get_cluster()
clus$start()
clus$stop()
# etc

The closest analogue might be the AzureContainers package, which has methods for creating and working with AKS clusters. See the code here for the methods to create the cluster. There is a vignette that describes how you would interact with the cluster (scroll down to the "deploy to a Kubernetes cluster" section).

hongooi73 avatar Feb 14 '19 02:02 hongooi73

Here is a reference arch repo that demonstrates using AKS to provide a real-time scoring service in R.

https://github.com/Azure/RealtimeRDeployment

hongooi73 avatar Feb 14 '19 02:02 hongooi73