π-SPECFormer: A Mass Spectrometry-based Foundation Model for Decoding the Dark Proteome
preprint · bioRxiv · 2026
| Date | 2026-11-09 |
| Type | preprint |
| Venue | bioRxiv |
| Publisher | Cold Spring Harbor Laboratory |
| Contribution | algorithm |
| DOI | 10.64898/2026.11.06.764812 |
Abstract
In mass-spectrometry-based proteomics, a substantial proportion of acquired spectra remain unidentified, concealing a vast reservoir of biological variations commonly termed the “dark proteome”, potentially obscuring sequence mutations, non-canonical peptides and post-translational modifications. Existing deep-learning methods largely rely on supervised training with peptide-spectrum matches (PSMs), limiting their ability to learn from the much larger pool of unannotated spectra. Here we introduce π-SPECFormer, a mass-spectrometry foundation model pre-trained on 291 million spectra through a two-stage framework that combines self-supervised and PSMs-guided representation learning. π-SPECFormer transfers effectively to de novo peptide sequencing, spectrum clustering and modification detection, consistently outperforming task-specific baselines. When applied to proteomic profiles from 103 individuals with lung adenocarcinoma, the model identified nine high-confidence mutated peptides, including six that were absent from the reference databases. π-SPECFormer thus enables unbiased decoding of molecular complexity beyond the boundaries of the canonical proteome.
Methods and tools
- π-SPECFormer: Mass-spectrometry foundation model: a 21M-parameter Transformer spectrum encoder pre-trained contrastively (MoCo-style, InfoNCE over masked-peak views) on 178M unidentified spectra, then refined on 114M PSMs grouped by precursor. For de novo sequencing the frozen encoder feeds a task-specific Transformer encoder and autoregressive peptide decoder; the same embeddings serve spectrum clustering and, fine-tuned, PTM detection. Applied to mine single-amino-acid variants from dark spectra in a 103-patient lung adenocarcinoma cohort.
Trained on
- IPX0001804000 (as deposited) · IPX0001804000
Evaluated on
- IPX0001804000 (as deposited) · IPX0001804000
- Nine-species benchmark (original (DeepNovo, 2017)) · MSV000081382, PXD003868 (provenance), PXD004325 (provenance), PXD004424 (provenance), PXD004467 (provenance), PXD004536 (provenance), PXD004565 (provenance), PXD004947 (provenance), PXD004948 (provenance), PXD005025 (provenance)