construct-hub icon indicating copy to clipboard operation
construct-hub copied to clipboard

Published 20 hours ago • verified publisher icon cdklabs

Identify missing packages

Open iliapolo opened this issue 4 years ago • 4 comments

For various reasons, it might be the case that messages were lost from the pipeline before properly ingested.

Right now, if a package was discovered and staged, but was lost before it was ingested, we have no way to recover that package apart from doing a complete backfill from npm.

This is because the re-process workflow only operates on packages that were ingested.

We should have a way to detect packages that were discovered, but never ingested, and re-ingest them.

iliapolo avatar Nov 11 '21 16:11 iliapolo

How does a package get lost after staging but before it is was ingested? Shouldn't such a package end up in the Staging DLQ?

Chriscbr avatar Nov 12 '21 23:11 Chriscbr

@iliapolo are you still working on this issue?

Chriscbr avatar Dec 20 '21 19:12 Chriscbr

Nope. Never really started...unassigning

iliapolo avatar Dec 21 '21 20:12 iliapolo

This issue is now marked as stale because it hasn't seen activity for a while. Add a comment or it will be closed soon. If you wish to exclude this issue from being marked as stale, add the "backlog" label.

github-actions[bot] avatar Feb 20 '22 01:02 github-actions[bot]