Accès ouvert · CC BY

Rigorous validation of graph-based network analysis reappraises biologically coherent ADHD-associated transcriptomic modules in peripheral blood

Article scientifique 2026 Sciences de la vie et biotechnologies › Biotechnologies (OCDE 2.9) Anglais

Résumé

BACKGROUND: Graph attention networks (GATs) are increasingly applied to transcriptomic data because they integrate gene-network structure while producing attention weights that are often interpreted as indicators of biological importance. However, whether attention-derived explanations reliably reflect biologically meaningful signals has received little systematic evaluation, particularly in the small, heterogeneous cohorts common in psychiatric transcriptomics. METHODS: We systematically re-evaluated a GAT using peripheral blood RNA-sequencing data from 76 individuals (39 ADHD, 37 controls), including 16 discordant monozygotic twin pairs. To maximize analytical rigor, we implemented a leakage-aware pipeline, incorporating twin-aware group-stratified cross-validation, fold-wise gene selection, corrected transcript-to-gene mapping, and validation through repeated cross-validation, permutation testing, three complementary feature-importance methods, orthogonal differential-expression and pathway analyses, and data-quality controls. RESULTS: Across 20 repeated cross-validation splits, GAT achieved a slightly higher mean AUC than a graph convolutional network (mean AUC 0.624 vs. 0.599) and outperformed five classical machine-learning models on a prespecified split. However, GAT performance was not statistically distinguishable from a rigorously matched permutation-derived null distribution (p = 0.327), while an exploratory sample-size calculation indicated that roughly twice the current sample size would be needed to detect an effect this size at conventional power. Independent validation analyses converged on the same conclusion: attention-derived gene rankings were significantly negatively correlated with both SHAP and permutation importance, whereas differential-expression analyses---including discordant twin-pair comparisons---and pathway enrichment identified no reproducible biological signals after multiple-testing correction. Recovery of established co-expression modules and the absence of blood-cell marker differences supported pipeline validity. CONCLUSIONS: Graph-based models may show modest predictive gains, but predictive performance and biological interpretation are distinct scientific questions. Our findings demonstrate that attention-derived importance should be regarded as hypothesis-generating rather than mechanistic evidence unless independently validated, illustrating why rigorous, multi-level validation is essential before biological conclusions are drawn from graph neural networks in transcriptomic research.

Citer ce document

Ali, N. M. (2026). Rigorous validation of graph-based network analysis reappraises biologically coherent ADHD-associated transcriptomic modules in peripheral blood. PLoS ONE. https://doi.org/10.1371/journal.pone.0359656

Exporter : BibTeX · RIS (Zotero, Mendeley, EndNote)

Accès au document

Texte intégral archivé sur SPHAERO, en accès ouvert : lisible gratuitement en ligne après connexion. Le document reste aussi disponible à sa source. Se connecter

Voir l'article sur le site de la revue

Licence et provenance

Licence : CC BY

Notice moissonnée depuis OpenAlex le 26/10/2026. Le document reste hébergé par sa source.
Voir le document à la source →

Auteur(s)

Statistiques

Consultations (hors robots) : 11

Téléchargements (hors robots) : 0

Méthode de comptage