Azure-Sentinel icon indicating copy to clipboard operation
Azure-Sentinel copied to clipboard

Oracle Database Audit - OracleDatabaseAuditEvent function is looking for "Oracle Unified Audit" in Syslog messages but does not match logs produced

Open PCNZ opened this issue 1 year ago • 29 comments

Describe the bug This line does not parse the syslog correctly with default Oracle Database Audit configuration. Syslog | where SyslogMessage contains "Oracle Unified Audit" https://github.com/Azure/Azure-Sentinel/blob/master/Solutions/OracleDatabaseAudit/Parsers/OracleDatabaseAuditEvent.yaml When logs are ingested by AMA, part of the Oracle syslog message is mapped into the ProcessName field so the parser does not match. Changing it to this resolves the problem. Syslog | where SyslogMessage contains "Unified Audit" and ProcessName == "Oracle" Here is an example of a RAW syslog message. 2023-10-26T03:07:34.040652-04:00 acmeproddb1 Oracle Unified Audit[15149]: LENGTH: '150' TYPE:"4" DBID:"816595110" SESID:"1215445" CLIENTID:"" ENTRYID:"0" STMTID:"0" DBUSER:"PIMSDB" CURUSER:"" ACTION:"102" RETCODE:"0" SCHEMA:"" OBJNAME:"" acmeproddb1 is mapped to Syslog\Computer Oracle is mapped to Syslog\ProcessName The rest of the message is mapped to Syslog\SyslogMessage

To Reproduce Steps to reproduce the behavior:

  1. Install Oracle DB on SUSE Linux acmeproddb1
  2. Modify init.ora to add UNIFIED_AUDIT_SYSTEMLOG = ‘LOCAL7.INFO’ UNIFIED_AUDIT_COMMON_SYSLOG = TRUE
  3. Add acmeproddb1 to Azure Arc
  4. Create DCR to collect Linux Syslog from acmeproddb1 on the Local7 facility
  5. Install Oracle Database Audit solution from Content Hub 2.0.4
  6. Observe output in the Syslog,
  7. Run log query and observe no results Syslog | where SyslogMessage contains "Oracle Unified Audit"
  8. Run log query using function "OracleDatabaseAuditEvent" and observe no results10.

Expected behavior Default configuration of Oracle Database Audit using AMA should return results when using the function "OracleDatabaseAuditEvent" included with the Content Hub solution.

Additional context Add any other context about the problem here.

PCNZ avatar Nov 01 '23 23:11 PCNZ

Thank you for submitting an Issue to the Azure Sentinel GitHub repo! You should expect an initial response to your Issue from the team within 5 business days. Note that this response may be delayed during holiday periods. For urgent, production-affecting issues please raise a support ticket via the Azure Portal.

github-actions[bot] avatar Nov 01 '23 23:11 github-actions[bot]

Hi @PCNZ , Thanks for flagging this issue, we will investigate this issue and get back to you with some updates by 07Nov23. Thanks!

v-muuppugund avatar Nov 03 '23 13:11 v-muuppugund

@PCNZ I am unable to replicate exact machine for this issue ,could you please confirm the exact configuration using to set up the oracle db?please find below screen shot for reference is it the same configuration? image

v-muuppugund avatar Nov 07 '23 15:11 v-muuppugund

@PCNZ Could you please help me with above details on this issue,so will proceed further

v-muuppugund avatar Nov 10 '23 02:11 v-muuppugund

Hi @PCNZ , Gentle Reminder: We are waiting for your response on this issue. If you still need to keep this issue active, please respond to it in the next 2 days. If we don't receive response by the given date, we will close this issue.

v-muuppugund avatar Nov 14 '23 11:11 v-muuppugund

@PCNZ I am unable to replicate exact machine for this issue ,could you please confirm the exact configuration using to set up the oracle db?please find below screen shot for reference is it the same configuration? image

Yes this was SUSE 15 SP4, it was installed on prem not using an Azure template though.

PCNZ avatar Nov 14 '23 20:11 PCNZ

@PCNZ ,Sure will check on it and work on the analysis and come back with an update

v-muuppugund avatar Nov 15 '23 08:11 v-muuppugund

@PCNZ Unable to set up the environment as having windows machine,meanwhile checking internally,Could you please share email id and convenient time ,so can understand more about the issue and work for a solution,Thanks

v-muuppugund avatar Nov 17 '23 15:11 v-muuppugund

@PCNZ , Gentle reminder, Could you please check the above comment and share email id and convenient time for teams meeting for further trouble shooting issue.

v-muuppugund avatar Nov 21 '23 06:11 v-muuppugund

@PCNZ Unable to set up the environment as having windows machine,meanwhile checking internally,Could you please share email id and convenient time ,so can understand more about the issue and work for a solution,Thanks

No way to share email id privately here. What would you like to know?

PCNZ avatar Nov 21 '23 07:11 PCNZ

Hi @PCNZ ,Please share convenient time slots to this email id [email protected],Thanks.

v-muuppugund avatar Nov 21 '23 10:11 v-muuppugund

Hi @PCNZ , Gentle Reminder: Please share convenient time slots to this email id [email protected],Thanks.

v-muuppugund avatar Nov 23 '23 06:11 v-muuppugund

Hi @PCNZ , received email not the time slots, Gentle Reminder: Please share convenient time slots to this email id [email protected],Thanks.

v-muuppugund avatar Nov 28 '23 14:11 v-muuppugund

Hi @PCNZ , received email not the time slots, Gentle Reminder: Please share convenient time slots to this email id [email protected],Thanks.

You got my first email but are you saying you haven't seen my subsequent emails? Please check.

PCNZ avatar Nov 28 '23 21:11 PCNZ

Hi @PCNZ ,I have replied your email on 23Nov23 for convenient time slots,Could you please share convenient time slots,Thanks,Please find below screen shot for reference. image

v-muuppugund avatar Nov 29 '23 12:11 v-muuppugund

Hi @PCNZ, could you please have a look at above comment and share your convenient time with @v-muuppugund Thanks!

v-sudkharat avatar Dec 01 '23 11:12 v-sudkharat

Hi @PCNZ, could you please have a look at above comment and share your convenient time with @v-muuppugund Thanks!

We caught up yesterday, v-muuppugund had tested using OMS not AMA and DCR. So is going to retest and compare with example provided in OP. Suspect AMA maybe the reason for the log format being different or specific Oracle DB config is needed and the steps in the data connector need to be updated to reflect this. They can message me directly if any further info is needed.

PCNZ avatar Dec 01 '23 16:12 PCNZ

Hi @PCNZ, Noted. Thanks!

v-sudkharat avatar Dec 05 '23 05:12 v-sudkharat

Hi @PCNZ ,As discussed over teams ,I am working on this ,will share updates from next week by 21Dec23

v-muuppugund avatar Dec 15 '23 08:12 v-muuppugund

Hi @PCNZ ,Still working on set up ,once data ingested, will work on further analysis of the issue and share updates to you.

v-muuppugund avatar Dec 21 '23 15:12 v-muuppugund

Hi @PCNZ ,As discussed over teams, working on data ingestion, will update you.

v-muuppugund avatar Jan 02 '24 18:01 v-muuppugund

Hi @PCNZ ,Yesterday blocked your calendar to explain the status,I have resolved the issues and working on issue replication,will get back to you with an update

v-muuppugund avatar Jan 16 '24 03:01 v-muuppugund

Hi @PCNZ , Still need some time to replicate the issue,will try to update by Wednesday i.e. 24/1/2024 for status updates,Please join the meeting and let me know this time isn't conveninet.

v-muuppugund avatar Jan 21 '24 12:01 v-muuppugund

@PCNZ ,As discussed yesterday, working on replication of issue with other options and blocked calendar for wednesday ,trying my best to replicate the issue and have a e2e demo session ,will post updates over teams

v-muuppugund avatar Jan 25 '24 06:01 v-muuppugund

@PCNZ ,As discussed over call today,Showed demo for environment configured, as noticed there are certain logs not updated in linux VM ,so will be working on it and will update you ,we can have a teams meeting for a demo.

v-muuppugund avatar Jan 31 '24 06:01 v-muuppugund

@PCNZ ,updated the configuration for enabling missing logs ,working on it, once ready ,will block some time this week or early next week for e2e demo.

v-muuppugund avatar Feb 06 '24 01:02 v-muuppugund

@PCNZ ,As discussed over teams, due to VM complicance and its been deleted,so set up again, once setup completed, will schedule call for demo.

v-muuppugund avatar Feb 08 '24 10:02 v-muuppugund

@PCNZ ,as discussed over teams, set up done, working on data in oracle, once done, will do configurations test it and then block your time for e2e demo session.

v-muuppugund avatar Feb 21 '24 00:02 v-muuppugund

Hi @PCNZ ,as discussed over email,The following is the status and worked on this week,will update you 1.VM created 2.Oracle server and db created 3.Int.ora updated with unfiied auditing 4.Audited the records as demoed earlier

I am having an issue with logging the audit records from oracle and working on it ,please find below screen shot for reference,Once issue resolved ,will schedule call for demo,

image image

v-muuppugund avatar Mar 22 '24 06:03 v-muuppugund

Hi @PCNZ , I have fixed the issue and replicate the issue and please find below screen shot for reference,will discuss in detail on call image

v-muuppugund avatar Apr 08 '24 02:04 v-muuppugund