dataverse icon indicating copy to clipboard operation
dataverse copied to clipboard

new script for make data count log processing as well as updated docu…

Open stevenwinship opened this issue 1 year ago • 4 comments

new script for make data count log processing as well as updated documentation for counter-processor

PR adds automation for processing log files for metrics capture and send to DataCite (Make Data Count)

Closes # https://github.com/IQSS/dataverse.harvard.edu/issues/3

Special notes for your reviewer:

Suggestions on how to test this: Test files have been added to ./tests/data/app-1 and app-2. To properly test, new logs should be generated, tar-ed, and added to these directories so the processed logs will match datasets in your test db. counter-processor needs to be installed.

Does this PR introduce a user interface change? If mockups are available, please link/include them here: No

Is there a release notes update needed for this change?: Added

Additional documentation: Multiple documents regarding counter-processor have been updated

stevenwinship avatar Apr 10 '24 13:04 stevenwinship

:package: Pushed preview images as

ghcr.io/gdcc/dataverse:mdc-process-files-via-script
ghcr.io/gdcc/configbaker:mdc-process-files-via-script

:ship: See on GHCR. Use by referencing with full name as printed above, mind the registry name.

github-actions[bot] avatar Apr 10 '24 14:04 github-actions[bot]

:package: Pushed preview images as

ghcr.io/gdcc/dataverse:mdc-process-files-via-script
ghcr.io/gdcc/configbaker:mdc-process-files-via-script

:ship: See on GHCR. Use by referencing with full name as printed above, mind the registry name.

github-actions[bot] avatar Apr 10 '24 17:04 github-actions[bot]

:package: Pushed preview images as

ghcr.io/gdcc/dataverse:mdc-process-files-via-script
ghcr.io/gdcc/configbaker:mdc-process-files-via-script

:ship: See on GHCR. Use by referencing with full name as printed above, mind the registry name.

github-actions[bot] avatar May 08 '24 15:05 github-actions[bot]

:package: Pushed preview images as

ghcr.io/gdcc/dataverse:mdc-process-files-via-script
ghcr.io/gdcc/configbaker:mdc-process-files-via-script

:ship: See on GHCR. Use by referencing with full name as printed above, mind the registry name.

github-actions[bot] avatar Jun 18 '24 18:06 github-actions[bot]

@stevenwinship Just double-checking, what is the scope of the QA for this PR - do I need to be testing the actual scripts (that are checked-in in the local repo)? Or is just to review the documentation in this PR?

landreev avatar Aug 05 '24 18:08 landreev

@stevenwinship Just double-checking, what is the scope of the QA for this PR - do I need to be testing the actual scripts (that are checked-in in the local repo)? Or is just to review the documentation in this PR?

I would think since counter_processor has moved to gdcc and has a new release version the install instruction are important. The scripts that are here only change the version number. The other scripts have already been merged into dataverse.harvard

stevenwinship avatar Aug 05 '24 19:08 stevenwinship