Living proteomics benchmark
benchmark
Living proteomics benchmark: benchmark. Community-driven, continuously-updated benchmarking resource for deep-learning de novo peptide sequencing: evaluates tools across a broad span of experimental conditions…
Community-driven, continuously-updated benchmarking resource for deep-learning de novo peptide sequencing: evaluates tools across a broad span of experimental conditions and proteomic applications rather than one frozen test set. Nature Methods Registered Report co-authored by 53 researchers spanning most of the groups that build the tools being benchmarked.
| Kind | benchmark |
Code
Live stars, open issues and last-push figures are on the Code activity chart.
Data
What the papers describing this method trained it on and reported its results on, as each paper states it. A version is named only where the paper names one.
Also used, purpose not recorded
- A comprehensive LFQ benchmark dataset to validate data analysis pipelines on modern day acquisition strategies in proteo (as deposited)
- ABRF iPRG2020 Metaproteomics Study Data (as deposited)
- Anti-FLAG-M2 antibody sequencing (as deposited)
- Benchmarking DIA data analysis workflows (as deposited)
- Critical Assessment of Metaproteome Investigation (CAMPI): a Multi-Lab Comparison of Established Workflows (as deposited)
- De novo peptide sequencing tools benchmark (as deposited)
- Effect of POR knockdown on the proteome of HepaRG cells (as deposited)
- Files for: Improved Protein Inference from Multiple Protease Bottom-Up Mass Spectrometry Data (as deposited)
- Fully automated sample processing and analysis workflow for low-input proteome profiling (as deposited)
- IPRG2015 (as deposited)
- Monoclonal antibody de novo assembly (as deposited)
- Nine-species benchmark (version not stated)
- ProteomeTools (21-PTM subset)
- ProteomeTools (Bruker timsTOF)
- ProteomeTools (Parts I-III)
- ProteomeTools (TMT 6-plex)
- ProteomeTools (non-tryptic (Bruker))
- Rewiring of B cell receptor signaling by Epstein-Barr virus LMP2A (as deposited)
- Ultra-fast label-free quantification and comprehensive proteome coverage with narrow-window data-independent acquisition (as deposited)
- non-canonical HLA peptides in cancer (as deposited)
Paper describing it
- A living proteomics benchmark for comprehensive evaluation of deep learning-based de novo peptide sequencing tools (2026, Nature Methods (Registered Report), preprint)