ort icon indicating copy to clipboard operation
ort copied to clipboard

Re-resolve / delete stored provenance information if downloading it in the scanner fails

Open sschuberth opened this issue 1 year ago • 3 comments

Sometimes, a provenance resolved successfully to some fixed revision, but at a later point in time the host disappeared (e.g. svn.codehaus.org). In that case, the resolved provenance is retrieved from the database and passed to the scanner wrapper, but the scanner implementation will fail to download it. See e.g. this data

  - provenance:
      vcs_info:
        type: "Subversion"
        url: "https://svn.codehaus.org/plexus/plexus-containers"
        revision: "981837"
        path: ""
      resolved_revision: "981837"
    scanner:
      name: "DOS"
      version: "1.0"
      configuration: ""
    summary:
      start_time: "2024-02-19T16:05:39.209930165Z"
      end_time: "2024-02-19T16:05:39.266308013Z"
      issues:
      - timestamp: "2024-02-19T16:05:39.265568285Z"
        source: "DOS"
        message: "IOException: Unable to initialize a Subversion working tree in '/tmp/ort-DefaultWorkingTreeCache4990696171266543978'\
          \ from https://svn.codehaus.org/plexus/plexus-containers.\nCaused by: SVNException:\
          \ svn: E175002: unknown host\nsvn: E175002: OPTIONS request failed on '/plexus/plexus-containers'\n\
          \    Caused by: UnknownHostException: svn.codehaus.org: Name or service\
          \ not known"
        severity: "ERROR"

In such a case it would be nice if the scanner implementation had a way to either trigger re-resolution of the provenance immediately, or at least delete the stored provenance to trigger re-resolution on the next run.

sschuberth avatar Feb 19 '24 16:02 sschuberth

or at least delete the stored provenance

@fviernau do we happen to have a helper-cli command for this. maybe?

sschuberth avatar Feb 19 '24 18:02 sschuberth

@fviernau do we happen to have a helper-cli command for this. maybe?

not that I'm aware of. orthw has a commad to delete the resolved provenance entries.

fviernau avatar Feb 19 '24 18:02 fviernau

orthw has a commad to delete the resolved provenance entries.

Note to myself:

https://github.com/oss-review-toolkit/orthw/blob/727d6dd4ba645872dd4cd5acb038232ba7d10a11/orthw#L666-L682

sschuberth avatar Feb 19 '24 19:02 sschuberth