Framework should work nicely with structured logger

[adrianna-chang-shopify]

The canonical logger project is underway to provide structured logging in jobs.

Right now the logger doesn't work well with the Maintenance Tasks gem because the logs get appended to after each iteration and are only written when the job is stopped.

We want to keep the gem as Shopify-agnostic as possible, but we should keep an eye out on making sure the gem integrates with the structured logger for Shopify apps. Supposedly the canonical logger will be compatible with iterative jobs once structured logging is in Rails 7.0.

[adrianna-chang-shopify]

Looks like the team who worked on structures logging is not intending to build compatibility with job iteration after all. In this case, we should probably allow apps to opt-out of logging (or disable the Job Iteration logs altogether).

[simonlevasseur]

Last time I spoke to @thomasbarton, we were considering allowing nested units of work which would play well with job-iteration. Is that still the case?

[thomasbarton]

Here is a ticket to track discussion -> https://github.com/Shopify/observability/issues/587

[elfassy]

Has this been fixed?

[bdewater]

FWIW https://github.com/Shopify/job-iteration/pull/338 will help, JobIteration::LogSubscriber.detach_from(:iteration) and attach_to your own log subscriber.

[github-actions[bot]]

This issue has been marked as stale because it has not been commented on in two months. Please reply in order to keep the issue open. Otherwise, it will close in 14 days. Thank you for contributing!