newrelic-quickstarts icon indicating copy to clipboard operation
newrelic-quickstarts copied to clipboard

FR: Log Parsing rule definitions support in Quickstarts

Open thezackm opened this issue 3 years ago • 6 comments

Summary

Requesting support of adding Log Parsing definitions in quickstarts.

Desired Behavior

Log Parsing Rules have Nerdgraph mutations available.

As a user, I need to have pre-built parsing rules applied to the log data I send to New Relic from common situations and use-cases that enhance the value of my logs telemetry by adding fields for better searching and faceting.

Example:

When I click to instrument and add dashboards for a quickstart with NPM data for my Cisco ASA firewalls; I expect to have pre-built parsing rules added as well so my syslog data is immediately valuable to me.

Possible Solution

New YAML standard for outlining the required fields on a parsing rule

    rule: {
      description: "example parsing rule"
      enabled: false
      grok: "sampleattribute=%{NUMBER:test:int}"
      lucene: "logtype:testLogs"
      nrql: "SELECT * FROM Log WHERE `logtype` = 'testLogs'"
    }
rules:
  - description: 
      enabled: 
      grok:
      lucene: 
      nrql: 

Note: there is an open ticket in the logs team to remove the requirement for the NRQL field here, FYI

cc: @jpvajda

thezackm avatar Dec 10 '21 15:12 thezackm

@thezackm Are there particular quickstarts that would benefit from this feature? Which ones come to mind off the top of your head?

jpvajda avatar Dec 10 '21 23:12 jpvajda

@thezackm do we have any customer references asking for this feature?

jpvajda avatar Dec 10 '21 23:12 jpvajda

@jpvajda

We've had several requests since NR Logs was released. As a follow-up to Zack's PR here, my colleague Marcel and I would like to submit default parsing patterns for our OHIs.

In general, this would allow engineers in the field to submit parsing patterns for other data sources on behalf of customers and allow them to be shared. As it is today, when we create custom parsing for customers it stays with that customer and isn't shared with the rest of the field or other customers.

lchapman4 avatar Dec 15 '21 22:12 lchapman4

Old issues will be closed after 105 days of inactivity. This issue has been quiet for 90 days and is being marked as stale. Reply here to keep this issue open.

github-actions[bot] avatar Mar 16 '22 02:03 github-actions[bot]

commenting to appease the stale-bot overlords

thezackm avatar Mar 16 '22 02:03 thezackm

@thezackm 🤖 🤖 🙏

jpvajda avatar Mar 16 '22 17:03 jpvajda

Old issues will be closed after 105 days of inactivity. This issue has been quiet for 90 days and is being marked as stale. Reply here to keep this issue open.

github-actions[bot] avatar Apr 04 '23 01:04 github-actions[bot]

@lchapman4 @thezackm this just came across my radar screen. How can we proceed with making this happen?

seemantk avatar Apr 04 '23 07:04 seemantk

Old issues will be closed after 105 days of inactivity. This issue has been quiet for 90 days and is being marked as stale. Reply here to keep this issue open.

github-actions[bot] avatar Jul 05 '23 02:07 github-actions[bot]

This issue is being closed due to inactivity. Is this a mistake? Please re-open this issue or create a new one.

github-actions[bot] avatar Oct 19 '23 01:10 github-actions[bot]