overwatch icon indicating copy to clipboard operation
overwatch copied to clipboard

Have question on Configuration csv file

Open learnprofile opened this issue 9 months ago • 8 comments

Sensitive Content Alert Please remember that this repository is publicly visible so do not post anything sensitive in your report such as user emails, secrets, etc.

Overwatch Version 0.8.0.x+

Describe the bug Based on the documentation : https://databrickslabs.github.io/overwatch/deployoverwatch/configureoverwatch/configuration/ it says to use this .csv file and make changes with respect to Azure Databricks URL.

Screenshots If applicable, add screenshots to help explain your problem. Be sure to blur or cover any sensitive data.

The documentation is not clear if i need to upload this .csv file to storage account/ mount point and then which command to run? however based on existing notebook i made changes and while running below step:

image

It throws this error:

DeltaAnalysisException: [DELTA_MISSING_TRANSACTION_LOG] Incompatible format detected.

You are trying to write to dbfs:/test/1206-003704-wvqwgqbx/global_share/instancedetails using Delta, but there is no transaction log present. Check the upstream job to make sure that it is writing using format("delta") and that you are trying to write to the table base path.

To learn more about Delta, see https://docs.microsoft.com/azure/databricks/delta/index

So wanted to know what is going wrong?

Issue Reports Please provide the reports requested from the Troubleshooting page in the docs.

learnprofile avatar Apr 29 '24 01:04 learnprofile

Hi @learnprofile,

Please let me know your timezone. We need to get on a call to understand your existing configurations and what is missing. I am from the IST timezone. We can connect at an available time.

Regards, Neha

Neha-vs123 avatar Apr 29 '24 06:04 Neha-vs123

if you are available we can connect now?

learnprofile avatar Apr 29 '24 07:04 learnprofile

Hi Neha, I am available now for a call, could you send teams invite we can discuss further.

Thanks, Prashanth Kumar

Sent from Outlookhttp://aka.ms/weboutlook


From: Neha VS @.> Sent: Monday, April 29, 2024 12:28 PM To: databrickslabs/overwatch @.> Cc: learnprofile @.>; Mention @.> Subject: Re: [databrickslabs/overwatch] Have question on Configuration csv file (Issue #1190)

Hi @learnprofilehttps://github.com/learnprofile,

Please let me know your timezone. We need to get on a call to understand your existing configurations and what is missing. I am from the IST timezone. We can connect at an available time.

Regards, Neha

— Reply to this email directly, view it on GitHubhttps://github.com/databrickslabs/overwatch/issues/1190#issuecomment-2082009340, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AHU4H7QCNSZ34R7644Y7MC3Y7XVTHAVCNFSM6AAAAABG5N5PNCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBSGAYDSMZUGA. You are receiving this because you were mentioned.Message ID: @.***>

learnprofile avatar Apr 29 '24 07:04 learnprofile

Hi @learnprofile,

I have a conflict, can we connect at 3pm IST?

Neha-vs123 avatar Apr 29 '24 07:04 Neha-vs123

Yes 3pm IST will work for me, please send me the meeting invite accordingly.

learnprofile avatar Apr 29 '24 07:04 learnprofile

@learnprofile please share your mail id to send the meeting invite. If not, can you send the invite directly? My mail id is [email protected]

Neha-vs123 avatar Apr 29 '24 09:04 Neha-vs123

Sure thank you, I just sent you teams invite.

learnprofile avatar Apr 29 '24 09:04 learnprofile

Hi @learnprofile, Thanks for joining the call. Hope your doubts are cleared. Please let me know if you have any other issues.

Regards, Neha

Neha-vs123 avatar Apr 29 '24 10:04 Neha-vs123