ui icon indicating copy to clipboard operation
ui copied to clipboard

Add the ability to search/sort by logger name on the Flow run logs page

Open znicholasbrown opened this issue 4 years ago • 0 comments

Why

Prefect core exposes hooks for logging non-Prefect specific logs to Cloud such as logs that would be from external libraries like boto3 and kubernetes. These logs are great for debugging and monitoring purposes. When visiting the logs page in the UI for a flow run it is easy to search based on the message of the log but it would be nice to either search or sort by the name of the logger itself.

For example:

February 26th 2020 at 1:03:56pm | prefect.CloudTaskRunner
Task 'reduce_task': finished task run for task with final state: 'Success'
---
February 26th 2020 at 1:03:58pm | distributed.deploy.adaptive
INFO Retiring workers [1]
---
February 26th 2020 at 1:04:02pm | dask_kubernetes.core
Deleted pod: dask-root-26896ee1-06s7h7

Without scrolling through all of the logs from my flow run it would be nice to be able to specifically look for the logs that come from the dask_kubernetes.core logger because they might provide some insight into the resource usage of my run.

What

A user would be able to visit the flow run's logs page to:

  • [ ] filter logs based on the name of a logger used in their flow
  • [ ] save only the logs from that specific logger

Notes

The core PR https://github.com/PrefectHQ/prefect/pull/2089 makes this more relevant because by default the DaskKubernetesEnvironment will now output some cluster autoscaling logs for users to provide visibility into their deployments.

(Moved from #1275 in old repo)

znicholasbrown avatar Oct 19 '20 17:10 znicholasbrown