Document modification required for UC storage prefix

[Neha-vs123]

The UC prerequisite document has examples for storage prefix as < UC external Location >/<storage_prefix>. But this is misinterpreted by customers and fail to provide the full storage account in place of UC External Location.

[followingell]

I believe I may be experiencing an issue related to this as such I'd like some clarification if possible.

Say I have the following values related to an Azure storage account:

• Storage account: overwatchsa
• Container in storage account: all-workspace-cluster-logs
• Directory in storage container within storage account storing prod workspace cluster logs: prod

What should my storage_prefix value be?

1. abfss://[email protected]/prod
2. abfss://[email protected]
3. Something else ?

I look forward to hearing back.

[mohanbaabu1996]

Hi @followingell ,

Why you are referring the cluster log path to storage prefix column ? Storage prefix column contains the information regarding the output path not the cluster log location path.

[followingell]

Hi @followingell ,

Why you are referring the cluster log path to storage prefix column ? Storage prefix column contains the information regarding the output path not the cluster log location path.

@mohanbaabu1996

Good question, in that case maybe I am not understanding exactly what the .../storage_prefix part of the <UC External Location>/<storage_prefix> represents. Is this the directory on Overwatch's storage account where I would like the Overwatch job to write the data which is then referenced (as external tables I assume) by the etl_database_name and consumer_database_name to create the data model?

As such, should this be something like abfss://[email protected]/overwatch_job_output?

[mohanbaabu1996]

Is this the directory on Overwatch's storage account where I would like the Overwatch job to write the data which is then referenced (as external tables I assume) by the etl_database_name and consumer_database_name to create the data model? - Yes

should this be something like abfss://[email protected]/overwatch_job_output - Yes