imeoer

It seems the nydus snapshotter process has exited exceptionally, could you paste the snapshotter logs?

@yawqi @wraymo Thanks! We can split it into the two sub-tasks, "trace collection" and "cpu/memory/network requests statistics", Which one you prefer?

@wraymo @yawqi Thanks! Any specific design doc can be committed here first and discussed together.

> Hello 👋 I haven't seen any of the tracing bits land yet, is there a plan to use something like opentel for this. Do you need anything, I am...

@lilic nydusd exported some metrics by an API, this is also the data source of nydusctl: https://github.com/dragonflyoss/image-service/blob/f3cdd071b01ea5d2086e376a7b2bfee3ee233360/api/openapi/nydus-api-v1.yaml#L241 But indeed we'd better make it get in open tracing, unfortunately no one...

@lilic Here is an example to get the backend metric: https://github.com/dragonflyoss/image-service/blob/f3cdd071b01ea5d2086e376a7b2bfee3ee233360/smoke/tests/tool/nydusd.go#L384C18-L384C18

Sorry for the late reply, it seems we're not reproducing the issue, please provide more information if you have it.

After offline discussion, will wait @hangvane to fix this. :)

1. Make sure all nydus image and the containers using nydus image has been removed, and no nydusd processes: `ps aux | grep nydusd`; 2. If the nydus snapshotter root...

It seems that some snapshots have not been reclaimed, maybe containerd hasn't started GC? Can you find any files in these snapshot directories?