• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Zhang, X. (Zhang, X..) | Dou, S. (Dou, S..) | Ji, J. (Ji, J..) | Liu, Y. (Liu, Y..) | Wang, Z. (Wang, Z..)

Indexed by:

EI Scopus SCIE

Abstract:

Automatic generation of medical reports for Brain Computed Tomography (CT) imaging is crucial for helping radiologists make more accurate clinical diagnoses efficiently. Brain CT imaging typically contains rich pathological information, including common pathologies that often co-occur in one report and rare pathologies that appear in medical reports with lower frequency. However, current research ignores the potential co-occurrence between common pathologies and pays insufficient attention to rare pathologies, severely restricting the accuracy and diversity of the generated medical reports. In this paper, we propose a Co-occurrence Relationship Driven Hierarchical Attention Network (CRHAN) to improve Brain CT report generation by mining common and rare pathologies in Brain CT imaging. Specifically, the proposed CRHAN follows a general encoder-decoder framework with two novel attention modules. In the encoder, a co-occurrence relationship guided semantic attention (CRSA) module is proposed to extract the critical semantic features by embedding the co-occurrence relationship of common pathologies into semantic attention. In the decoder, a common-rare topic driven visual attention (CRVA) module is proposed to fuse the common and rare semantic features as sentence topic vectors, and then guide the visual attention to capture important lesion features for medical report generation. Experiments on the Brain CT dataset demonstrate the effectiveness of the proposed method. IEEE

Keyword:

Biomedical imaging Medical diagnostic imaging Semantics Computed tomography medical report generation Co-occurrence relationship Brain CT Pathology Visualization hierarchical attention mechanism Feature extraction

Author Community:

  • [ 1 ] [Zhang X.]College of Computer Science, Beijing University of Technology, Beijing, China
  • [ 2 ] [Dou S.]College of Computer Science, Beijing University of Technology, Beijing, China
  • [ 3 ] [Ji J.]College of Computer Science, Beijing University of Technology, Beijing, China
  • [ 4 ] [Liu Y.]Department of Radiology, Peking University Third Hospital, Beijing, China
  • [ 5 ] [Wang Z.]Department of Radiology, Peking University Third Hospital, Beijing, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Emerging Topics in Computational Intelligence

ISSN: 2471-285X

Year: 2024

Issue: 5

Volume: 8

Page: 1-11

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:509/10577572
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.