libqb icon indicating copy to clipboard operation
libqb copied to clipboard

[RFE] Add support for structured logging to reflect the shift towards machine log processing

Open jnpkrn opened this issue 7 years ago • 6 comments

This is an intended prerequisite to add support for new log back-ends like:

  • native journald handover
    • https://freedesktop.org/software/systemd/man/sd_journal_send.html
    • https://freedesktop.org/software/systemd/man/systemd.journal-fields.html
  • The OpenTracing Semantic Specification compliant back-end
    • https://github.com/opentracing/specification/blob/master/specification.md#the-opentracing-api
    • https://github.com/opentracing/specification/blob/master/semantic_conventions.md#standard-span-tags-and-log-fields

jnpkrn avatar Jan 01 '18 22:01 jnpkrn

Possibly interesting in this context: ~~https://is.muni.cz/th/172673/fi_d/thesis-twoside-final-bw.pdf~~ https://is.muni.cz/th/rjfzq/thesis-twoside-final-bw.pdf

jnpkrn avatar Jun 03 '18 22:06 jnpkrn

For how Linux deals with this task: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/kernel/printk/printk.c?h=v4.19#n309

jnpkrn avatar Dec 19 '18 23:12 jnpkrn

See also possible syslog mapping proposed in another context in the past https://cee.mitre.org/language/1.0-beta1/clt.html#clt-syslog-mapping

jnpkrn avatar Dec 19 '18 23:12 jnpkrn

Ah, even RFC exists (proposed standard, exists since 2009): https://tools.ietf.org/html/rfc5424

jnpkrn avatar Jan 29 '19 17:01 jnpkrn

Regarding prior work, it's good to also mention logfmt, detailed, e.g., in https://brandur.org/logfmt

jnpkrn avatar Feb 27 '19 12:02 jnpkrn

See a particular motivational example: structured logging flag to mark secrecy-sensitive log items

jnpkrn avatar Mar 11 '21 12:03 jnpkrn