Development of a Knowledge-Based Multimodal Deep Learning System for Automatic Breast Lesion Segmentation and Diagnosis in Mg/Dmr Images

Abstract

Deep learning networks (DLNs) rely on labeled training datasets as their fundamental building blocks. While various databases exist worldwide, there is currently no domestic solution available in our country. This project aims to create a domestic database by automatically segmenting breast lesions in MG/DMR images based on their types and developing a knowledge-based multimodal DL-based integrated computer-aided diagnosis system to analyze the images, thereby providing the system with continuous learning capability. Different brands of devices exist for MG/DMR, necessitating the multimodal operation of image processing/artificial intelligence algorithms. To achieve this goal, the network was trained first, and then prelearned data were transferred to enable the training of data from different networks once accurate results are obtained. The developed system has the potential to enable the automatic detection of breast lesions, ensuring fast and high diagnostic accuracy. Additionally, it might also facilitate the retrospective analysis of patients' periodic check-up results.