[ISSUE] cannot create mws workspaces: unexpected error handling request: invalid character 'M' looking for beginning of value. This is likely a bug in the Databricks SDK for Go or the underlying REST API. (may be duplicate of #959?)

[neilpvirtualitics]

Description Can't deploy workspace to new govcloud account using the terraform-terraform-rsa

Reproduction Using the terraform-databricks-rsa module; fails on creating the workspace.

Expected behavior expected the workspace to be created without errors

Is it a regression? This sounds like it may be a duplicate of Issue #959; but that's supposedly fixed as of Aug 20? So maybe a similar scenario?

Debug Logs

  diagnostic_summary=
  | cannot create mws workspaces: unexpected error handling request: invalid character 'M' looking for beginning of value. This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues. Request log:
  | ```
  | POST /api/2.0/accounts/<redacted>/workspaces
  | > * Host:
  | > * Accept: application/json
  | > * Authorization: REDACTED
  | > * Content-Type: application/json
  | > * Traceparent: <redacted>
  | > * User-Agent: databricks-tf-provider/1.50.0 databricks-sdk-go/0.44.0 go/1.22.6 os/darwin terraform/1.9.4 resource/mws_workspaces auth/oauth-m2m
  | > {
  | >   "account_id": "<redacted>",
  | >   "aws_region": "us-gov-west-1",
  | >   "credentials_id": "<redacted>",
  | >   "is_no_public_ip_enabled": true,
  | >   "managed_services_customer_managed_key_id": "<redacted>",
  | >   "network_id": "<redacted>",
  | >   "pricing_tier": "ENTERPRISE",
  | >   "private_access_settings_id": "<redacted>",
  | >   "storage_configuration_id": "<redacted>",
  | >   "storage_customer_managed_key_id": "<redacted>",
  | >   "workspace_name": "virt-poc"
  | > }
  | < HTTP/2.0 400 Bad Request
  | < * Content-Type: text/plain; charset=utf-8
  | < * Date: Tue, 05 Nov 2024 00:09:03 GMT
  | < * Server: databricks
  | < * Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
  | < * Vary: Accept-Encoding
  | < * X-Content-Type-Options: nosniff
  | < * X-Request-Id: 09e69783-86ac-4fd6-b7be-15a3563efd66
  | < MALFORMED_REQUEST: Compliance Security Profile and Enhanced Security Monitoring must be provided in workspace info during workspace creation in AWS GovCloud.
  | ```
   tf_proto_version=5.6 tf_rpc=ApplyResourceChange @caller=/home/runner/go/pkg/mod/github.com/hashicorp/[email protected]/tfprotov5/internal/diag/diagnostics.go:58 @module=sdk.proto diagnostic_detail="" tf_provider_addr=registry.terraform.io/databricks/databricks tf_req_id=f98e48d0-0295-6ed7-5d00-6397f3bb2313 tf_resource_type=databricks_mws_workspaces timestamp=2024-11-04T17:09:02.946-0700
2024-11-04T17:09:02.989-0700 [ERROR] vertex "module.SRA.module.databricks_mws_workspace.databricks_mws_workspaces.this" error: cannot create mws workspaces: unexpected error handling request: invalid character 'M' looking for beginning of value. This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues. Request log:

Other Information

• OS: MacOS 14.7 (intel)

Additional context terraform version 1.9.4

[neilpvirtualitics]

note, per:

MALFORMED_REQUEST: Compliance Security Profile and Enhanced Security Monitoring must be provided in workspace info during workspace creation in AWS GovCloud.

These are enabled in our Account. (by default; the GUI controls are disabled, but the settings are in the "enabled" state).