Skip to content

Release with multiple bug fixed 1.5.0#549

Merged
ypriverol merged 171 commits intomasterfrom
dev
Jun 2, 2025
Merged

Release with multiple bug fixed 1.5.0#549
ypriverol merged 171 commits intomasterfrom
dev

Conversation

@ypriverol
Copy link
Member

@ypriverol ypriverol commented May 21, 2025

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the pipeline conventions in the contribution docs
  • If necessary, also make a PR on the bigbio/quantms branch on the nf-core/test-datasets repository.
  • Make sure your code lints (nf-core pipelines lint).
  • Ensure the test suite passes (nextflow run . -profile test,docker --outdir <OUTDIR>).
  • Check for unexpected warnings in debug mode (nextflow run . -profile debug,test,docker --outdir <OUTDIR>).
  • Usage Documentation in docs/usage.md is updated.
  • Output Documentation in docs/output.md is updated.
  • CHANGELOG.md is updated.
  • README.md is updated (including new tool citations and authors/contributors).

Summary by CodeRabbit

  • New Features

    • Introduced workflows for phospho-site localization, protein inference, protein quantification, and feature mapping.
    • Added a new boolean parameter for removing invalid PSMs.
    • Added a process to extract spectrum features for improved rescoring.
    • Added methionine excision support in search engines COMET and DIANN.
  • Improvements

    • Standardized module and process names with consistent naming conventions.
    • Updated container images and dependencies to newer versions.
    • Enhanced output channels for more detailed statistics and version tracking.
    • Improved output directory structures with verbose mode support.
    • Updated workflows to use renamed modules and refined input/output channels.
  • Bug Fixes

    • Fixed issues related to SNR processing and TMT-labelled sample handling.
    • Resolved errors in reporting steps and pmultiqc integration.
  • Documentation

    • Clarified output documentation with detailed directory layouts and file descriptions.
    • Cleaned duplicated README content and updated acknowledgments.
  • Style/Refactor

    • Refactored workflows and modules for clarity and maintainability.
    • Renamed and reorganized modules, workflows, and configuration files.
    • Simplified rescoring workflow logic and removed deprecated branching.
  • Chores

    • Added new contributor Fabian Egli.
    • Updated pipeline version to 1.5.0 across configuration and metadata files.

daichengxin and others added 30 commits May 8, 2025 09:49
Co-authored-by: Chengxin Dai <37200167+daichengxin@users.noreply.github.com>
Co-authored-by: Chengxin Dai <37200167+daichengxin@users.noreply.github.com>
Removed redundant paragraph
preparing for version 1.4.1dev
@ypriverol ypriverol requested a review from Copilot May 30, 2025 18:31
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR prepares the 1.5.0 release by bumping the version, refining documentation, and adding new test flags.

  • Bump pipeline version to 1.5.0 and update CHANGELOG, README, and .nf-core.yml.
  • Enhance docs/output.md with detailed default output structure and pMultiQC references.
  • Introduce new parameters (mzml_features, add_snr_feature_percolator) in test configs and add DSL2 module configs under conf/modules.

Reviewed Changes

Copilot reviewed 132 out of 132 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
docs/output.md Clarify output directories, fix pMultiQC references
README.md Remove outdated snippet and add new contributor entry
CHANGELOG.md Add 1.5.0 section with added, changed, fixed, dependencies
.nf-core.yml Update lint/files_unchanged entries and bump version
conf/tests/test_lfq.config Enable mzml_features flag in LFQ test configuration
conf/tests/test_dda_id.config Enable add_snr_feature_percolator in DDA-ID test config
conf/modules/verbose_modules.config Add verbose publishDir overrides for intermediate outputs
conf/modules/modules.config Define default DSL2 per-module publishDir options
Comments suppressed due to low confidence (3)

conf/tests/test_lfq.config:38

  • [nitpick] Add or update unit/integration tests to cover the new 'mzml_features' flag and verify expected behavior when enabled.
mzml_features = true

conf/tests/test_dda_id.config:39

  • [nitpick] Include tests to confirm that enabling 'add_snr_feature_percolator' actually triggers SNR feature addition in the Percolator step.
add_snr_feature_percolator = true

README.md:160

  • Remove the stray empty code block delimiters at the end of the README to avoid rendering an unintended blank code section.
</details>

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

♻️ Duplicate comments (1)
docs/output.md (1)

28-28: Add missing comma after "pMultiQC"

Improve readability by adding a comma:

- Generation of QC reports using pMultiQC a library for QC proteomics data analysis.
+ Generation of QC reports using pMultiQC, a library for QC proteomics data analysis.
🧹 Nitpick comments (1)
docs/output.md (1)

5-5: Use consistent English spelling

This file currently mixes British English ("summarises", "visualisation") with American English ("visualizations"). Select one variant and apply it consistently across documentation.

Also applies to: 37-37

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between d246760 and aa69443.

📒 Files selected for processing (4)
  • .nf-core.yml (2 hunks)
  • docs/output.md (3 hunks)
  • nextflow.config (5 hunks)
  • ro-crate-metadata.json (2 hunks)
🚧 Files skipped from review as they are similar to previous changes (3)
  • ro-crate-metadata.json
  • .nf-core.yml
  • nextflow.config
🧰 Additional context used
🪛 LanguageTool
docs/output.md

[uncategorized] ~54-~54: Loose punctuation mark.
Context: ...cross all workflows: - pipeline_info/: Contains Nextflow pipeline information,...

(UNLIKELY_OPENING_PUNCTUATION)


[uncategorized] ~56-~56: Do not mix variants of the same word (‘visualization’ and ‘visualisation’) within a single text.
Context: ...ultiqc/: Contains pMultiQC reports and visualizations - multiqc_data/`: Raw data used by p...

(EN_WORD_COHERENCY)


[uncategorized] ~58-~58: Do not mix variants of the same word (‘visualization’ and ‘visualisation’) within a single text.
Context: ... used by pMultiQC - multiqc_plots/: Visualizations in different formats - png/: PNG ...

(EN_WORD_COHERENCY)


[uncategorized] ~207-~207: Loose punctuation mark.
Context: ...ollowing directories: - quant_tables/: Contains all quantification results inc...

(UNLIKELY_OPENING_PUNCTUATION)


[uncategorized] ~210-~210: Do not mix variants of the same word (‘visualization’ and ‘visualisation’) within a single text.
Context: ...`: Contains quality control reports and visualizations The specific files include: - DDA-LFQ...

(EN_WORD_COHERENCY)

🪛 markdownlint-cli2 (0.17.2)
docs/output.md

52-52: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


63-63: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


65-65: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


81-81: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


83-83: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


97-97: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


99-99: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


115-115: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


117-117: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


128-128: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


130-130: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


149-149: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


180-180: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)

⏰ Context from checks skipped due to timeout of 90000ms (20)
  • GitHub Check: Docker Tests (latest-everything, test_dia)
  • GitHub Check: Docker Tests (24.10.5, test_tmt_corr)
  • GitHub Check: Docker Tests (24.10.5, test_localize)
  • GitHub Check: Docker Tests (24.10.5, test_dda_id)
  • GitHub Check: Docker Tests (24.10.5, test_tmt_corr)
  • GitHub Check: Docker Tests (latest-everything, test_dda_id)
  • GitHub Check: Docker Tests (24.10.5, test_localize)
  • GitHub Check: Docker Tests (latest-everything, test_tmt)
  • GitHub Check: Docker Tests (latest-everything, test_dia)
  • GitHub Check: Docker Tests (latest-everything, test_localize)
  • GitHub Check: Docker Tests (24.10.5, test_dda_id)
  • GitHub Check: Docker Tests (24.10.5, test_tmt)
  • GitHub Check: Docker Tests (24.10.5, test_dia)
  • GitHub Check: Docker Tests (24.10.5, test_lfq)
  • GitHub Check: Run pipeline with test data (24.10.5, test_lfq, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_lfq, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_dia, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_localize, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_dda_id, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_tmt, docker)
🔇 Additional comments (6)
docs/output.md (6)

16-21: Clear addition of LC-MS predictor and rescoring steps

The newly added steps 4–9 clearly describe LC-MS feature prediction, SNR feature addition, merging runs, PSM rescoring, and FDR combination. The documentation aligns with the pipeline enhancements.


30-30: Grammar fix applied correctly

The phrase "For DIA-LFQ experiments, the workflow is different:" correctly resolves the prior grammar issue.


33-33: Grammar fix applied correctly

The line "DIA-NN is used for identification and quantification…" now reads clearly and fixes the earlier typo.


43-43: Clarify output directory description

The sentence explaining --outdir and standard file formats is concise and informative, helping users understand where and how outputs are organized.


45-46: mzML and mzTab definitions are accurate

The links and descriptions for mzML and mzTab are correct, using valid URLs and clarifying the formats.


368-368: pMultiQC usage description is clear

The note on pMultiQC report collation and the link to the repository provide valuable context and traceability.

@ypriverol ypriverol requested review from Copilot May 30, 2025 18:44
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This release updates the pipeline to version 1.5.0, standardizes output documentation and directory layouts, adds new test flags, and restructures module configuration (including a verbose-mode config).

  • Update output docs to reflect pMultiQC plugin and detailed directory structures
  • Add new parameters (mzml_features, add_snr_feature_percolator) to test configs
  • Replace old conf/modules.config with a modular conf/modules/modules.config and add conf/modules/verbose_modules.config

Reviewed Changes

Copilot reviewed 132 out of 132 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
docs/output.md Updated output documentation for pMultiQC reports and default/verbose structures
conf/tests/test_lfq.config Added mzml_features = true to exercise new features
conf/tests/test_dda_id.config Enabled SNR feature for Percolator rescore
conf/modules/verbose_modules.config New verbose-mode publishDir overrides for intermediate files
conf/modules/modules.config Modularized publish rules and conditional blocks
conf/modules.config Removed legacy top-level modules config
conf/igenomes_ignored.config Removed legacy iGenomes stub config
README.md Incorporated new contributor and cleaned up duplicates
CHANGELOG.md Added 1.5.0 changelog entries
.nf-core.yml Bumped pipeline version; updated lint file list
Comments suppressed due to low confidence (2)

.nf-core.yml:11

  • The lint section still references conf/modules.config and conf/igenomes_ignored.config even though those files were removed. Please remove or update these entries to avoid CI failures.
-    - conf/modules.config

docs/output.md:56

  • [nitpick] Indentation of nested list items under pmultiqc/ is inconsistent; aligning bullets by two spaces (or using proper markdown nesting) will improve readability.
- `pmultiqc/`: Contains pMultiQC reports and visualizations

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

@ypriverol ypriverol requested a review from Copilot May 31, 2025 04:38
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the pipeline to version 1.5.0, adds new parameters and modules configurations, and refreshes documentation and CI lint settings.

  • Bumps version to 1.5.0 and updates CHANGELOG, README, and .nf-core.yml.
  • Adds mzml_features and add_snr_feature_percolator to test configs.
  • Introduces new conf/modules/verbose_modules.config and conf/modules/modules.config, removes outdated configs, and extends output documentation.

Reviewed Changes

Copilot reviewed 132 out of 132 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
docs/output.md Updated output docs for pMultiQC, default/verbose directory structure.
conf/tests/test_lfq.config Enabled new mzml_features parameter.
conf/tests/test_dda_id.config Added add_snr_feature_percolator parameter.
conf/modules/verbose_modules.config Added verbose publishDir mappings for intermediate steps.
conf/modules/modules.config Introduced central modules config with publishDir rules and conditions.
conf/modules.config Removed outdated modules.config file.
conf/igenomes_ignored.config Removed unused iGenomes ignore config.
README.md Removed duplicate intro paragraph; added new contributor.
CHANGELOG.md Updated to v1.5.0 and listed added, changed, fixed items.
.nf-core.yml Updated lint patterns, removed old modules config entries, bumped version.
Comments suppressed due to low confidence (3)

conf/tests/test_lfq.config:38

  • Added new parameter mzml_features, but there is no test validating its effect on output directory structure or process activation; consider adding assertions or coverage for modules that depend on this parameter.
mzml_features = true

conf/tests/test_dda_id.config:39

  • Introduced add_snr_feature_percolator parameter; ensure there are tests verifying that SNR features are correctly included in Percolator rescoring outputs.
add_snr_feature_percolator = true

.nf-core.yml:20

  • Duplicate entry for conf/modules.config in lint file lists; consider removing redundant lines to avoid confusion in CI linting patterns.
-    - conf/modules.config

ypriverol and others added 2 commits May 31, 2025 05:46
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

♻️ Duplicate comments (1)
docs/output.md (1)

28-28: Comma needed after pMultiQC
Insert a comma for correct apposition: “pMultiQC, a library…”

- 16. Generation of QC reports using pMultiQC a library for QC proteomics data analysis.
+ 16. Generation of QC reports using pMultiQC, a library for QC proteomics data analysis.
🧹 Nitpick comments (5)
docs/output.md (5)

5-5: Link pMultiQC in introduction
Add a hyperlink to the pMultiQC plugin to aid discoverability.

- This document describes the output produced by the pipeline. Most plots are taken from the pMultiQC report, which summarises results at the end of the pipeline.
+ This document describes the output produced by the pipeline. Most plots are taken from the [pMultiQC](https://github.com/bigbio/pmultiqc) report, which summarises results at the end of the pipeline.

16-18: Unify list item verb forms for consistency
Standardize the pipeline step descriptions to use parallel gerund forms and clearer phrasing.

- 4. (optional) Performs LC-MS predictors such as MS²PIP and DeepLC to add new peptide spectrum match (PSM) features by MS2Rescore
- 5. (optional) Add spectrum signal-to-noise (SNR) features for Percolator rescore
- 6. (optional) Merge different MS runs by samples or whole projects
+ 4. (optional) Perform LC-MS predictions (MS²PIP, DeepLC) to add PSM features via MS2Rescore
+ 5. (optional) Add spectrum signal-to-noise (SNR) features via Percolator rescore
+ 6. (optional) Merge multiple MS runs by sample or project

33-33: Remove unnecessary article “the”
Simplify phrasing by dropping the definite article before plural objects.

- 2. DIA-NN is used for identification and quantification of the peptides and proteins
+ 2. DIA-NN is used for identification and quantification of peptides and proteins

43-43: Refine --outdir description
Use more natural wording and move backticks to the parameter name.

- Output will be saved to the folder defined by the parameter `--outdir`. Each step of the workflow exports different files and reports with the specific data, peptide identifications, protein quantifications, etc. Most of the pipeline outputs are [HUPO-PSI](https://www.psidev.info/) standard file formats:
+ Output will be saved in the folder specified by the `--outdir` parameter. Each step of the workflow exports files and reports containing specific data (peptide identifications, protein quantifications, etc.). Most outputs follow the [HUPO-PSI](https://www.psidev.info/) standard file formats:

368-368: Hyperlink the GitHub URL
Convert the raw URL to a markdown link for consistency.

- For more information about how to use pMultiQC reports in general, see <https://github.com/bigbio/pmultiqc>.
+ For more information about how to use pMultiQC reports in general, see [pMultiQC](https://github.com/bigbio/pmultiqc).
📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL
Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between aa69443 and 05cbbbb.

📒 Files selected for processing (2)
  • conf/modules/verbose_modules.config (1 hunks)
  • docs/output.md (4 hunks)
🚧 Files skipped from review as they are similar to previous changes (1)
  • conf/modules/verbose_modules.config
🧰 Additional context used
🪛 LanguageTool
docs/output.md

[uncategorized] ~54-~54: Loose punctuation mark.
Context: ...cross all workflows: - pipeline_info/: Contains Nextflow pipeline information,...

(UNLIKELY_OPENING_PUNCTUATION)


[uncategorized] ~207-~207: Loose punctuation mark.
Context: ...ollowing directories: - quant_tables/: Contains all quantification results inc...

(UNLIKELY_OPENING_PUNCTUATION)

🪛 markdownlint-cli2 (0.17.2)
docs/output.md

52-52: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


63-63: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


65-65: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


81-81: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


83-83: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


97-97: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


99-99: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


115-115: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


117-117: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


128-128: Trailing punctuation in heading
Punctuation: ':'

(MD026, no-trailing-punctuation)


130-130: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


149-149: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)


180-180: Fenced code blocks should have a language specified
null

(MD040, fenced-code-language)

⏰ Context from checks skipped due to timeout of 90000ms (20)
  • GitHub Check: Docker Tests (24.10.5, test_dda_id)
  • GitHub Check: Docker Tests (24.10.5, test_dia)
  • GitHub Check: Run pipeline with test data (24.10.5, test_dia, docker)
  • GitHub Check: Docker Tests (latest-everything, test_tmt_corr)
  • GitHub Check: Docker Tests (24.10.5, test_localize)
  • GitHub Check: Docker Tests (latest-everything, test_tmt)
  • GitHub Check: Docker Tests (latest-everything, test_localize)
  • GitHub Check: Docker Tests (latest-everything, test_dda_id)
  • GitHub Check: Docker Tests (latest-everything, test_lfq)
  • GitHub Check: Docker Tests (24.10.5, test_tmt_corr)
  • GitHub Check: Docker Tests (24.10.5, test_tmt)
  • GitHub Check: Docker Tests (latest-everything, test_dia)
  • GitHub Check: Docker Tests (24.10.5, test_dda_id)
  • GitHub Check: Docker Tests (24.10.5, test_lfq)
  • GitHub Check: Docker Tests (24.10.5, test_dia)
  • GitHub Check: Run pipeline with test data (24.10.5, test_localize, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_lfq, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_dia, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_dda_id, docker)
  • GitHub Check: Run pipeline with test data (24.10.5, test_tmt, docker)
🔇 Additional comments (1)
docs/output.md (1)

45-46: Corrected mzTab link
The mzTab URL is now correct and Markdown syntax is valid.

@ypriverol ypriverol merged commit b17b26b into master Jun 2, 2025
67 checks passed
@coderabbitai coderabbitai bot mentioned this pull request Aug 13, 2025
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

mzTab sometimes not included inside the results folder for pmultqic quantms-rescoring in DeepLC step

5 participants