New Calibration Framework Improves Confidence in AI Virtual Cell Models
Across 14 genetic perturbation datasets and 18 evaluation metrics, commonly used measures such as mean squared error and control-referenced Pearson correlation were often poorly calibrated, particularly in datasets with weaker perturbations. The post New Calibration Framework Improves Confidence in AI Virtual Cell Models appeared first on GEN - Genetic Engineering and Biotechnology News .
A new calibration framework published in Nature Biotechnology improves confidence in AI virtual cell models' ability to predict cellular responses to genetic perturbations. Researchers from Shift Bioscience and collaborators developed an "interpolated duplicate" positive control and a dynamic range fraction metric to assess the effectiveness of various evaluation metrics.
These metrics consistently showed higher calibration, particularly for weighted and rank-based measures like WMSE and NIR. By using these calibrated metrics, deep learning models significantly outperformed previous baselines, particularly when trained on broader gene combination datasets. The findings suggest that virtual cell models can generate biologically meaningful insights when evaluated with the right metrics and datasets, offering promise for identifying therapeutic targets relevant to aging and disease.
Written by urgent.news from GEN Biotechnology's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.