bids-specification icon indicating copy to clipboard operation
bids-specification copied to clipboard

con/tinuous archival of the CI logs

Open yarikoptic opened this issue 2 years ago • 1 comments

We (@jwodder primarily) developed the https://github.com/con/tinuous/ to establish archives of logs from various CIs. Unfortunately circle CI is not yet supported since we did not have a use-case yet so it was not implemented (https://github.com/con/tinuous/issues/124). But even without circle-ci I think it would be good to have such an archive.

Typically I just keep those logs on a server which is accessible to all project members. But BIDS project does not have such a private ssh-able server, so I might better just publish them to github.

  • Are you aware of any sensitive information in those logs so we might better not share them publicly?
  • Since there will be "subdatasets" (I usually do one per month), we better not publish as part of this org to not pollute repos, but create a dedicated bids-standard-ci-logs or alike. But then it would be another burden to manage access. So may be they should all go under this org? or what other location if any public or not?

yarikoptic avatar Jul 19 '22 15:07 yarikoptic

Are you aware of any sensitive information in those logs so we might better not share them publicly?

to my knowledge the CircleCI logs are openly accessible anyhow ... and I just tried accessing the GitHub action logs through a non-logged in browser and I think there the steps are not accessible.

More importantly: I don't think there is any sensitive information in these logs, so we may archive them without problems.

Since there will be "subdatasets" (I usually do one per month)

you mean a new repo each month?

Couldn't we just have a single repo and keep pushing the logs there? Or will we run into storage space issues?

sappelhoff avatar Jul 27 '22 10:07 sappelhoff