centralized-logging-with-opensearch icon indicating copy to clipboard operation
centralized-logging-with-opensearch copied to clipboard

LogPipelinelogBucketNotifications183A08DA: An error occurred (InvalidArgument) when calling the PutBucketNotificationConfiguration operation: Unable to validate the following destination configurations

Open SeagullTian opened this issue 3 years ago • 8 comments
trafficstars

Describe the bug

Face following error during the deployment:

Received response status [FAILED] from custom resource. Message returned: Error: An error occurred (InvalidArgument) when calling the PutBucketNotificationConfiguration operation: Unable to validate the following destination configurations

Logical ID: LogPipelinelogBucketNotifications183A08DA

May I ask if there's any insight how to solve this problem?

Thanks in advance.

Expected Behavior

Make this deployment work

Current Behavior

Deployment Failure with error:

Received response status [FAILED] from custom resource. Message returned: Error: An error occurred (InvalidArgument) when calling the PutBucketNotificationConfiguration operation: Unable to validate the following destination configurations

Reproduction Steps

Use the Template for China Region and it will face the error

Possible Solution

No response

Additional Information/Context

No response

Log Hub Version

N/A

AWS Region. e.g., us-east-1

cn-north-1

Other information

No response

SeagullTian avatar Jul 20 '22 09:07 SeagullTian

Hi @SeagullTian , could you please check the region of your log source bucket? It should be the same as your Log Hub deploy region (cn-north-1). This error log seems like caused by the failure of S3 notification creation.

YikaiHu avatar Jul 20 '22 09:07 YikaiHu

Thanks Kervin for checking. I can confirm that the source bucket is in the same region

SeagullTian avatar Jul 20 '22 09:07 SeagullTian

Hi @SeagullTian , what's the type of the Log in this pipeline?
And can you provide the earliest error message in CloudFormation Stack's event?

YikaiHu avatar Jul 20 '22 09:07 YikaiHu

WAF Log, I'm not sure if this is what you ask for.

as you can see, the error I shared is the earliest one. image

i also tried to check the CloudWatch log but it seems useless: image

SeagullTian avatar Jul 20 '22 09:07 SeagullTian

Hi @SeagullTian , sorry for the late reply.

According to our experiments, we found that this is an open issue related to AWS S3 notification. We will continue to follow the progress of this root issue https://github.com/aws/aws-cdk/issues/18090.

The workaround is delete this WAF Log Pipeline in Log Hub console and recreated one.

YikaiHu avatar Jul 21 '22 01:07 YikaiHu

May i ask if there's an ETA for the fix? Even I tried to create the S3Notification manually in Management Console does NOT help. image

Currently, I'm not able to use LogHub console to recreate a pipeline. Please let me know if there's any other way we can do this.

SeagullTian avatar Jul 21 '22 06:07 SeagullTian

Hi @SeagullTian, thanks for your info and we have added this issue in our backlog. For now, this issue can not be fixed and we are also waiting for CDK team's update. Sorry for the inconvenience, I will end this thread for now.

owenCCY avatar Jul 21 '22 07:07 owenCCY

Root cause: https://github.com/aws/aws-cdk/issues/18090#issuecomment-1853374393

wchaws avatar Dec 13 '23 07:12 wchaws

We changed to EventBridge in v2.3, no longer exists

JoeShi avatar Nov 27 '24 02:11 JoeShi