databricks-sdk-go icon indicating copy to clipboard operation
databricks-sdk-go copied to clipboard

Published 20 hours ago • verified publisher icon databricks

[ISSUE] `cluster_mount_infos` is missing from `compute.ClusterSpec`

Open stevenayers-bge opened this issue 1 year ago • 0 comments
trafficstars

More details can be found here: https://github.com/databricks/cli/issues/1306

The OpenAPI spec used to generate the Go SDK is missing cluster_mount_infos so it is not added to compute.ClusterSpec https://github.com/databricks/databricks-sdk-go/blob/a823ca32fc4199d8cf2269b78cfe89331b4b688a/service/compute/model.go#L1090

The field is also currently undocumented in the API. It mounts the NFS at /db-mnt/<local path>, but cannot be accessed via dbutils.fs and is invisible. To access it data from spark, you must use spark.read.text('file:///db-mnt/<local path>')

stevenayers-bge avatar Mar 24 '24 11:03 stevenayers-bge