Azure-Sentinel icon indicating copy to clipboard operation
Azure-Sentinel copied to clipboard

Data connector Oracle cloud infrastructure failed with error "the cursor is outside the retention period and is now invalid"

Open sandeep5234 opened this issue 1 year ago • 9 comments

We have deployed Oracle cloud infrastructure data connector from Microsoft Sentinel content gallery. As process provided instructions to provision Azure function app and configure the data connector. As of first run the data ingested fine, but after few days below error start coming image

I have deleted and re-deployed the same connector but error persists.

Oracle support reply as below: As we have checked on our side, we're not getting any heartbeat from the customer's side stream/tenancy.

Also, the request frequency is very less because of which the cursor is getting out of retention. For this, we suggest to add handling in your code to recreate the cursor if expired.

The customer can add in the code to create the cursor again for handling this issue. As in, once they start the consumer they can create the cursor and call the same code again if cursor expires.

sandeep5234 avatar Feb 21 '24 23:02 sandeep5234

Hi @sandeep5234, Thanks for flagging this issue, we will investigate this issue and get back to you with some updates by 11-03-2024 . Thanks!

v-sudkharat avatar Mar 05 '24 08:03 v-sudkharat

Hi @sandeep5234 ,Still need some more time ,working on analysis ,will update you,meanwhile could you please share invocation logs from app insights with stack traces to [email protected]

v-muuppugund avatar Mar 11 '24 02:03 v-muuppugund

Hi @sandeep5234 , Gentle reminder,could you please share invocation logs from app insights with stack traces to [email protected],working on cursor creation options through code

v-muuppugund avatar Mar 15 '24 03:03 v-muuppugund

Hi @sandeep5234 ,Gentle reminder, could you please share invocation logs from app insights with stack traces to [email protected],working on cursor creation options through code,still need some time on further analysis.

v-muuppugund avatar Mar 19 '24 04:03 v-muuppugund

@v-muuppugund sorry for the delay, I have sent the information on provided email. Please let me know.

sandeep5234 avatar Mar 19 '24 04:03 sandeep5234

@v-muuppugund sorry for the delay, I have sent the information on provided email. Please let me know.

@sandeep5234 ,Thanks for sharing the details over an email,will check and update you

v-muuppugund avatar Mar 19 '24 05:03 v-muuppugund

@sandeep5234 ,as discussed today morning, we have tested package for this issue (https://github.com/Azure/Azure-Sentinel/issues/9203) but unable to proceed due to cursor issue and will merge the group and group instance name changes PR with these issue changes ,test and close it,just want to update.

@PCNZ FYI

v-muuppugund avatar Mar 20 '24 04:03 v-muuppugund

@v-muuppugund sorry for the delay, I have sent the information on provided email. Please let me know.

@sandeep5234 ,Thanks for sharing the details over an email,will check and update you

Hi @sandeep5234 ,Analysed the logs and working on option for retaining cursor retention period in python,will update you

v-muuppugund avatar Mar 22 '24 04:03 v-muuppugund

Ok thank you @v-muuppugund

sandeep5234 avatar Mar 22 '24 07:03 sandeep5234

Hi @sandeep5234 ,I have done some code changes and working on local testing for the changes,Will share the package with you for detailed testing

v-muuppugund avatar Mar 26 '24 14:03 v-muuppugund

Thank you @v-muuppugund

sandeep5234 avatar Mar 27 '24 10:03 sandeep5234

Hi @sandeep5234 , Still need some time for local testing

Thank you @v-muuppugund

Hi @sandeep5234 ,Will update you over teams with package url this week for further testing if needed will have call again

v-muuppugund avatar Apr 03 '24 01:04 v-muuppugund

Hi @sandeep5234 , Still need some time for local testing

Thank you @v-muuppugund

Hi @sandeep5234 ,Will update you over teams with package url this week for further testing if needed will have call again

Hi @sandeep5234 ,Still need some more time on this and share the package url over teams,will update you

v-muuppugund avatar Apr 10 '24 02:04 v-muuppugund

Hi @sandeep5234 , I have added changes in same package, As shared the steps over teams last call,Could you please test this package (https://github.com/Azure/Azure-Sentinel/raw/users/v-muppugundu/OCIDocumentationupdates/Solutions/Oracle%20Cloud%20Infrastructure/Data%20Connectors/OCILogsConn.zip )and let me know if any issues

v-muuppugund avatar Apr 11 '24 23:04 v-muuppugund

Thank you @v-muuppugund , I will test it next week on Monday.

sandeep5234 avatar Apr 12 '24 22:04 sandeep5234

Hi @sandeep5234 ,Could you please test the package shared over teams and let me know if any issues.

v-muuppugund avatar Apr 16 '24 13:04 v-muuppugund

Hi @sandeep5234 ,As discussed today over teams,could you please test and let me know if any issues

v-muuppugund avatar Apr 18 '24 05:04 v-muuppugund

Hi @sandeep5234 ,Thanks for confirmation over teams ,the issue has been resolved,Please let me know if any issues.

v-muuppugund avatar Apr 19 '24 05:04 v-muuppugund

Yes thank you issue has been resolved now. T

sandeep5234 avatar Apr 19 '24 05:04 sandeep5234

Hi @sandeep5234 ,Thanks for confirmation ,closing the issue

v-muuppugund avatar Apr 19 '24 08:04 v-muuppugund