modules icon indicating copy to clipboard operation
modules copied to clipboard

fix-5612 / s3 cloud-storage compatibility

Open glichtenstein opened this issue 8 months ago • 1 comments

PR checklist

Closes #5612

To address issue #5612, the following changes have been made to ensure compatibility with cloud storage like S3:

  • File Path Creation: Replaced the Java method new File() with Nextflow's file() method to properly handle file paths in cloud storage environments.
  • File Writing Method: Replaced direct Java I/O operations with Nextflow's withWriterAppend for appending to the log file, maintaining consistency with Nextflow.
  • Type Change: Changed the parameter type from File to Path in the appendToLogFile function to align with Nextflow.

Tests required to be performed in an s3 enviroment, samplesheet should have at least one bad barcode to test the entire functionality.

  • [x] This comment contains a description of changes (with reason).
  • [x] If you've fixed a bug or added code that should be tested, add tests!
  • [ ] If you've added a new tool - have you followed the module conventions in the contribution docs
  • [ ] If necessary, include test data in your PR.
  • [ ] Remove all TODO statements.
  • [ ] Emit the versions.yml file.
  • [ ] Follow the naming conventions.
  • [ ] Follow the parameters requirements.
  • [ ] Follow the input/output options guidelines.
  • [ ] Add a resource label
  • [ ] Use BioConda and BioContainers if possible to fulfil software requirements.
  • Ensure that the test works with either Docker / Singularity. Conda CI tests can be quite flaky:
    • For modules:
      • [ ] nf-core modules test <MODULE> --profile docker
      • [ ] nf-core modules test <MODULE> --profile singularity
      • [ ] nf-core modules test <MODULE> --profile conda
    • For subworkflows:
      • [ ] nf-core subworkflows test <SUBWORKFLOW> --profile docker
      • [ ] nf-core subworkflows test <SUBWORKFLOW> --profile singularity
      • [ ] nf-core subworkflows test <SUBWORKFLOW> --profile conda

glichtenstein avatar Jun 09 '24 19:06 glichtenstein