军事知识服务平台
CRC-BERT-GCN: Development and validation of a pre-trained language model for predicting colorectal cancer phenotypes from radiology reports and electronic health records
摘要 Background:Colorectal cancer (CRC) presents a significant global health challenge owing to its rising incidence. Early detection and precise prediction of molecular target expression, guided by key biomarkers, such as CK-20, Ki-67, P-53, and microsatellite instability, are essential for personalizing treatment strategies and improving patient outcomes. However, current approaches often struggle to capture intricate semantic and relational structures within vast medical records and corpus.Methods:We developed CRC-Bidirectional Encoder Representations from Transformer (BERT)-graph convolutional network (GCN), a pre-trained deep learning framework that integrates graph neural network, to fully use the semantic information in predicting cancer phenotypes. We retrospectively collected data on 6,468 patients with CRC from a tertiary hospital in Beijing, from 2012 to 2022, electronic health records and radiology reports were collected and divided into training sets (70%), validation sets (10%), and tests (20%) stratified by molecular phenotypes. The model performance was evaluated on accuracy, precision, recall, and F1-Score. Ablation studies and attention analysis were performed to interpret the model’s performance and internal mechanisms.Results:CRC-BERT-GCN outperformed all basic models and achieved the best performance across all evaluation metrics, with an F1 Score of 73.67%. Compared with the baseline models, it improved accuracy by 4.25% and F1 Score by 4.39%, demonstrating the effectiveness of integrating GCN for biomarker prediction. Moreover, the results were interpreted using attention heatmap.Conclusion:CRC-BERT-GCN may demonstrate superior performance in predicting CRC biomarkers, and outperforming baseline models, highlighting its potential for advancing personalized treatment strategies through improved molecular target prediction.