Move fastp arguments to modules.config
Move the fastp arguments that turn off the adapter/read trimming into the modules.config instead of hardcoded into the module itself.
nf-core pipelines lint overall result: Passed :white_check_mark: :warning:
Posted for pipeline commit 800a7a6
+| ✅ 198 tests passed |+
#| ❔ 10 tests were ignored |#
!| ❗ 18 tests had warnings |!
:heavy_exclamation_mark: Test warnings:
- files_exist - File not found:
assets/multiqc_config.yml - readme - README contains the placeholder
zenodo.XXXXXXX. This should be replaced with the zenodo doi (after the first release). - pipeline_todos - TODO string in
nextflow.config: Optionally, you can add a pipeline-specific nf-core config at https://github.com/nf-core/configs - pipeline_todos - TODO string in
main.nf: Optionally add bibliographic entries to this list. - pipeline_todos - TODO string in
main.nf: Only uncomment below if logic in toolCitationText/toolBibliographyText has been filled! - pipeline_todos - TODO string in
awsfulltest.yml: You can customise AWS full pipeline tests as required - schema_params - Schema param
panelnot found from nextflow config - schema_params - Schema param
fastp_umi_locationnot found from nextflow config - schema_params - Schema param
fastp_umi_lengthnot found from nextflow config - schema_params - Schema param
fastp_umi_skipnot found from nextflow config - schema_params - Schema param
redux_umi_duplex_delimnot found from nextflow config - schema_params - Schema param
genome_versionnot found from nextflow config - schema_params - Schema param
genome_typenot found from nextflow config - schema_params - Schema param
ref_data_hmf_data_pathnot found from nextflow config - schema_params - Schema param
ref_data_panel_data_pathnot found from nextflow config - schema_params - Schema param
ref_data_virusbreakenddb_pathnot found from nextflow config - schema_params - Schema param
ref_data_genome_gtfnot found from nextflow config - schema_params - Schema param
ref_data_hla_slice_bednot found from nextflow config
:grey_question: Tests ignored:
- files_exist - File is ignored:
lib/Utils.groovy - files_exist - File is ignored:
lib/WorkflowMain.groovy - files_exist - File is ignored:
lib/WorkflowOncoanalyser.groovy - nextflow_config - Config default ignored: params.fastp_umi_length
- nextflow_config - Config default ignored: params.fastp_umi_skip
- files_unchanged - File ignored due to lint config:
assets/nf-core-oncoanalyser_logo_light.png - files_unchanged - File ignored due to lint config:
docs/images/nf-core-oncoanalyser_logo_light.png - files_unchanged - File ignored due to lint config:
docs/images/nf-core-oncoanalyser_logo_dark.png - actions_ci - actions_ci
- multiqc_config - multiqc_config
:white_check_mark: Tests passed:
- files_exist - File found:
.gitattributes - files_exist - File found:
.gitignore - files_exist - File found:
.nf-core.yml - files_exist - File found:
.editorconfig - files_exist - File found:
.prettierignore - files_exist - File found:
.prettierrc.yml - files_exist - File found:
CHANGELOG.md - files_exist - File found:
CITATIONS.md - files_exist - File found:
CODE_OF_CONDUCT.md - files_exist - File found:
LICENSEorLICENSE.mdorLICENCEorLICENCE.md - files_exist - File found:
nextflow_schema.json - files_exist - File found:
nextflow.config - files_exist - File found:
README.md - files_exist - File found:
.github/.dockstore.yml - files_exist - File found:
.github/CONTRIBUTING.md - files_exist - File found:
.github/ISSUE_TEMPLATE/bug_report.yml - files_exist - File found:
.github/ISSUE_TEMPLATE/config.yml - files_exist - File found:
.github/ISSUE_TEMPLATE/feature_request.yml - files_exist - File found:
.github/PULL_REQUEST_TEMPLATE.md - files_exist - File found:
.github/workflows/branch.yml - files_exist - File found:
.github/workflows/ci.yml - files_exist - File found:
.github/workflows/linting_comment.yml - files_exist - File found:
.github/workflows/linting.yml - files_exist - File found:
assets/email_template.html - files_exist - File found:
assets/email_template.txt - files_exist - File found:
assets/sendmail_template.txt - files_exist - File found:
assets/nf-core-oncoanalyser_logo_light.png - files_exist - File found:
conf/modules.config - files_exist - File found:
conf/test.config - files_exist - File found:
conf/test_full.config - files_exist - File found:
docs/images/nf-core-oncoanalyser_logo_light.png - files_exist - File found:
docs/images/nf-core-oncoanalyser_logo_dark.png - files_exist - File found:
docs/output.md - files_exist - File found:
docs/README.md - files_exist - File found:
docs/README.md - files_exist - File found:
docs/usage.md - files_exist - File found:
main.nf - files_exist - File found:
conf/base.config - files_exist - File found:
conf/igenomes.config - files_exist - File found:
conf/igenomes_ignored.config - files_exist - File found:
.github/workflows/awstest.yml - files_exist - File found:
.github/workflows/awsfulltest.yml - files_exist - File found:
modules.json - files_exist - File not found check:
.github/ISSUE_TEMPLATE/bug_report.md - files_exist - File not found check:
.github/ISSUE_TEMPLATE/feature_request.md - files_exist - File not found check:
.github/workflows/push_dockerhub.yml - files_exist - File not found check:
.markdownlint.yml - files_exist - File not found check:
.nf-core.yaml - files_exist - File not found check:
.yamllint.yml - files_exist - File not found check:
bin/markdown_to_html.r - files_exist - File not found check:
conf/aws.config - files_exist - File not found check:
docs/images/nf-core-oncoanalyser_logo.png - files_exist - File not found check:
lib/Checks.groovy - files_exist - File not found check:
lib/Completion.groovy - files_exist - File not found check:
lib/NfcoreTemplate.groovy - files_exist - File not found check:
lib/Workflow.groovy - files_exist - File not found check:
parameters.settings.json - files_exist - File not found check:
pipeline_template.yml - files_exist - File not found check:
Singularity - files_exist - File not found check:
lib/nfcore_external_java_deps.jar - files_exist - File not found check:
.travis.yml - nextflow_config - Found nf-schema plugin
- nextflow_config - Config variable found:
manifest.name - nextflow_config - Config variable found:
manifest.nextflowVersion - nextflow_config - Config variable found:
manifest.description - nextflow_config - Config variable found:
manifest.version - nextflow_config - Config variable found:
manifest.homePage - nextflow_config - Config variable found:
timeline.enabled - nextflow_config - Config variable found:
trace.enabled - nextflow_config - Config variable found:
report.enabled - nextflow_config - Config variable found:
dag.enabled - nextflow_config - Config variable found:
process.cpus - nextflow_config - Config variable found:
process.memory - nextflow_config - Config variable found:
process.time - nextflow_config - Config variable found:
params.outdir - nextflow_config - Config variable found:
params.input - nextflow_config - Config variable found:
validation.help.enabled - nextflow_config - Config variable found:
manifest.mainScript - nextflow_config - Config variable found:
timeline.file - nextflow_config - Config variable found:
trace.file - nextflow_config - Config variable found:
report.file - nextflow_config - Config variable found:
dag.file - nextflow_config - Config variable found:
validation.help.beforeText - nextflow_config - Config variable found:
validation.help.afterText - nextflow_config - Config variable found:
validation.help.command - nextflow_config - Config variable found:
validation.summary.beforeText - nextflow_config - Config variable found:
validation.summary.afterText - nextflow_config - Config variable (correctly) not found:
params.nf_required_version - nextflow_config - Config variable (correctly) not found:
params.container - nextflow_config - Config variable (correctly) not found:
params.singleEnd - nextflow_config - Config variable (correctly) not found:
params.igenomesIgnore - nextflow_config - Config variable (correctly) not found:
params.name - nextflow_config - Config variable (correctly) not found:
params.enable_conda - nextflow_config - Config variable (correctly) not found:
params.max_cpus - nextflow_config - Config variable (correctly) not found:
params.max_memory - nextflow_config - Config variable (correctly) not found:
params.max_time - nextflow_config - Config variable (correctly) not found:
params.validationFailUnrecognisedParams - nextflow_config - Config variable (correctly) not found:
params.validationLenientMode - nextflow_config - Config variable (correctly) not found:
params.validationSchemaIgnoreParams - nextflow_config - Config variable (correctly) not found:
params.validationShowHiddenParams - nextflow_config - Config
timeline.enabledhad correct value:true - nextflow_config - Config
report.enabledhad correct value:true - nextflow_config - Config
trace.enabledhad correct value:true - nextflow_config - Config
dag.enabledhad correct value:true - nextflow_config - Config
manifest.namebegan withnf-core/ - nextflow_config - Config variable
manifest.homePagebegan with https://github.com/nf-core/ - nextflow_config - Config
dag.fileended with.html - nextflow_config - Config variable
manifest.nextflowVersionstarted with >= or !>= - nextflow_config - Config
manifest.versionends indev:1.1.0dev - nextflow_config - Config
params.custom_config_versionis set tomaster - nextflow_config - Config
params.custom_config_baseis set tohttps://raw.githubusercontent.com/nf-core/configs/master - nextflow_config - Lines for loading custom profiles found
- nextflow_config - nextflow.config contains configuration profile
test - nextflow_config - Config default value correct: params.force_genome= false
- nextflow_config - Config default value correct: params.force_panel= false
- nextflow_config - Config default value correct: params.prepare_reference_only= false
- nextflow_config - Config default value correct: params.create_stub_placeholders= false
- nextflow_config - Config default value correct: params.max_fastq_records= 10000000
- nextflow_config - Config default value correct: params.fastp_umi= false
- nextflow_config - Config default value correct: params.redux_umi= false
- nextflow_config - Config default value correct: params.isofox_functions= TRANSCRIPT_COUNTS;ALT_SPLICE_JUNCTIONS;FUSIONS;RETAINED_INTRONS
- nextflow_config - Config default value correct: params.igenomes_ignore= true
- nextflow_config - Config default value correct: params.igenomes_base= s3://ngi-igenomes/igenomes/
- nextflow_config - Config default value correct: params.hmf_genomes_base= https://pub-cf6ba01919994c3cbd354659947f74d8.r2.dev/genomes
- nextflow_config - Config default value correct: params.custom_config_version= master
- nextflow_config - Config default value correct: params.custom_config_base= https://raw.githubusercontent.com/nf-core/configs/master
- nextflow_config - Config default value correct: params.publish_dir_mode= copy
- nextflow_config - Config default value correct: params.validate_params= true
- nextflow_config - Config default value correct: params.pipelines_testdata_base_path= https://raw.githubusercontent.com/nf-core/test-datasets/oncoanalyser
- files_unchanged -
.gitattributesmatches the template - files_unchanged -
.prettierrc.ymlmatches the template - files_unchanged -
CODE_OF_CONDUCT.mdmatches the template - files_unchanged -
LICENSEmatches the template - files_unchanged -
.github/.dockstore.ymlmatches the template - files_unchanged -
.github/CONTRIBUTING.mdmatches the template - files_unchanged -
.github/ISSUE_TEMPLATE/bug_report.ymlmatches the template - files_unchanged -
.github/ISSUE_TEMPLATE/config.ymlmatches the template - files_unchanged -
.github/ISSUE_TEMPLATE/feature_request.ymlmatches the template - files_unchanged -
.github/PULL_REQUEST_TEMPLATE.mdmatches the template - files_unchanged -
.github/workflows/branch.ymlmatches the template - files_unchanged -
.github/workflows/linting_comment.ymlmatches the template - files_unchanged -
.github/workflows/linting.ymlmatches the template - files_unchanged -
assets/email_template.htmlmatches the template - files_unchanged -
assets/email_template.txtmatches the template - files_unchanged -
assets/sendmail_template.txtmatches the template - files_unchanged -
docs/README.mdmatches the template - files_unchanged -
.gitignorematches the template - files_unchanged -
.prettierignorematches the template - actions_awstest - '.github/workflows/awstest.yml' is triggered correctly
- actions_awsfulltest -
.github/workflows/awsfulltest.ymlis triggered correctly - actions_awsfulltest -
.github/workflows/awsfulltest.ymldoes not use-profile test - readme - README Nextflow minimum version badge matched config. Badge:
24.04.2, Config:24.04.2 - plugin_includes - No wrong validation plugin imports have been found
- pipeline_name_conventions - Name adheres to nf-core convention
- template_strings - Did not find any Jinja template strings (0 files)
- schema_lint - Schema lint passed
- schema_lint - Schema title + description lint passed
- schema_lint - Input mimetype lint passed: 'text/csv'
- system_exit - No
System.exitcalls found - actions_schema_validation - Workflow validation passed: download_pipeline.yml
- actions_schema_validation - Workflow validation passed: ci.yml
- actions_schema_validation - Workflow validation passed: release-announcements.yml
- actions_schema_validation - Workflow validation passed: branch.yml
- actions_schema_validation - Workflow validation passed: linting_comment.yml
- actions_schema_validation - Workflow validation passed: template_version_comment.yml
- actions_schema_validation - Workflow validation passed: awstest.yml
- actions_schema_validation - Workflow validation passed: linting.yml
- actions_schema_validation - Workflow validation passed: awsfulltest.yml
- actions_schema_validation - Workflow validation passed: clean-up.yml
- actions_schema_validation - Workflow validation passed: fix-linting.yml
- merge_markers - No merge markers found in pipeline files
- modules_json - Only installed modules found in
modules.json - modules_structure - modules directory structure is correct 'modules/nf-core/TOOL/SUBTOOL'
- base_config -
conf/base.configfound and not ignored. - modules_config -
conf/modules.configfound and not ignored. - modules_config -
WRITE_REFERENCE_DATAfound inconf/modules.configand Nextflow scripts. - modules_config -
FASTPfound inconf/modules.configand Nextflow scripts. - modules_config -
STAR_GENOMEGENERATEfound inconf/modules.configand Nextflow scripts. - modules_config -
GATK4_MARKDUPLICATESfound inconf/modules.configand Nextflow scripts. - modules_config -
REDUXfound inconf/modules.configand Nextflow scripts. - modules_config -
AMBERfound inconf/modules.configand Nextflow scripts. - modules_config -
COBALTfound inconf/modules.configand Nextflow scripts. - modules_config -
PURPLEfound inconf/modules.configand Nextflow scripts. - modules_config -
BAMTOOLSfound inconf/modules.configand Nextflow scripts. - modules_config -
CHORDfound inconf/modules.configand Nextflow scripts. - modules_config -
EXTRACTCONTIGfound inconf/modules.configand Nextflow scripts. - modules_config -
LILACfound inconf/modules.configand Nextflow scripts. - modules_config -
SIGSfound inconf/modules.configand Nextflow scripts. - modules_config -
VIRUSBREAKENDfound inconf/modules.configand Nextflow scripts. - modules_config -
VIRUSINTERPRETERfound inconf/modules.configand Nextflow scripts. - modules_config -
ISOFOXfound inconf/modules.configand Nextflow scripts. - modules_config -
NEO_found inconf/modules.configand Nextflow scripts. - modules_config -
NEO_SCORERfound inconf/modules.configand Nextflow scripts. - modules_config -
NEO_FINDERfound inconf/modules.configand Nextflow scripts. - modules_config -
CUPPAfound inconf/modules.configand Nextflow scripts. - modules_config -
ORANGEfound inconf/modules.configand Nextflow scripts. - nfcore_yml - Repository type in
.nf-core.ymlis valid:pipeline - nfcore_yml - nf-core version in
.nf-core.ymlis set to the latest version:3.0.2
Run details
- nf-core/tools version 3.0.2
- Run at
2025-03-06 22:24:02
This change makes sense within the nf-core framework wrt use of process selectors to define arguments. I have to admit I'm not much of an advocate for the heavy use of process selectors to set arguments since imo it can cause some degree of obfuscation of process configuration, though this modification seems fairly straightforward.
Could you note your use-case and justification below for this change that we discussed earlier for anyone following along?
[!WARNING] Newer version of the nf-core template is available.
Your pipeline is using an old version of the nf-core template: 3.0.2. Please update your pipeline to the latest version.
For more documentation on how to update your pipeline, please see the nf-core documentation and Synchronisation documentation.
Further rationale for this change: https://github.com/nf-core/oncoanalyser/commit/ba241d1daae37018d4270cac28693f1445448a7f#commitcomment-149188254
Presumably needs an entry in the CHANGELOG. What is the rational behind not trimming at all? Is the assumption that it has already been done? We could make a new global parameter that performs basic trimming From what I recall, in my case the input DNA was quite fragmented, so many of the reads had a lot of adapter contamination, which bloats all the downstream file sizes.
Good catch, I'll make that change and then merge! That's right we don't perform trimming as it's assumed to have already been done. I'd like to leave the ability for users to flexibly control trimming via NF config as proposed rather than implementing a global parameter but thank you for the suggestion