overwatch icon indicating copy to clipboard operation
overwatch copied to clipboard

AWS Bucket need historical logs to run overwatch

Open mohanbaabu1996 opened this issue 2 years ago • 8 comments

"Exception: Audit Logs Module Failure: Audit logs are required to use Overwatch and no data was found in the following locations:"

Following error occurred due to no historical log in the bucket. Overwatch required atleast one day historical load to run. Above information need to be added in the documentation.

mohanbaabu1996 avatar Jul 12 '22 05:07 mohanbaabu1996

@mohanbaabu1996 -- Did you have an idea of where you wanted this included in the docs?

GeekSheikh avatar Jul 20 '22 18:07 GeekSheikh

This is appropriate for both AWS and Azure, however we can add it under AWS Environment setup because we have addressed event hubs in Azure.

mohanbaabu1996 avatar Jul 21 '22 06:07 mohanbaabu1996

@mohanbaabu1996 can you verify that this is done?

GeekSheikh avatar Oct 05 '22 15:10 GeekSheikh

@GeekSheikh We indicated on the AWS Setup page that audit and cluster logs should be checked before deploying overwatch. However, we did not specify that some historical data should be available in the audit bucket.

mohanbaabu1996 avatar Oct 10 '22 08:10 mohanbaabu1996

@mohanbaabu1996 , I'm running into this issue as well and I'm wondering if 1 day means one s3 subpath partition or is it 1 day of audit logs (i.e. I start audit logs mid day yesterday and have to wait a full 24 hours)?

kennes913 avatar Oct 14 '22 16:10 kennes913

@kennes913 You need to have atleast one day audit logs to run overwatch. For example, S3 audit path looks like s3a:////workspaceId=********/date=2022--/

mohanbaabu1996 avatar Oct 17 '22 05:10 mohanbaabu1996

@mohanbaabu1996, I have several days worth of audit logs and this is still not working. I know I must be missing something obvious. Is it possible that the audit logs path has to be in the same bucket as the root storage bucket?

kennes913 avatar Oct 17 '22 19:10 kennes913

@kennes913 Anusha is helping you in #564 , she will connect with you to resolve this. Thanks!

mohanbaabu1996 avatar Oct 18 '22 06:10 mohanbaabu1996