Skip to main content
Erschienen in: Neuroradiology 4/2024

21.02.2024 | Diagnostic Neuroradiology

Automatic generation of conclusions from neuroradiology MRI reports through natural language processing

verfasst von: Pilar López-Úbeda, Teodoro Martín-Noguerol, Jorge Escartín, Antonio Luna

Erschienen in: Neuroradiology | Ausgabe 4/2024

Einloggen, um Zugang zu erhalten

Abstract

Purpose

The conclusion section of a radiology report is crucial for summarizing the primary radiological findings in natural language and essential for communicating results to clinicians. However, creating these summaries is time-consuming, repetitive, and prone to variability and errors among different radiologists. To address these issues, we evaluated a fine-tuned Text-To-Text Transfer Transformer (T5) model for abstractive summarization to automatically generate conclusions for neuroradiology MRI reports in a low-resource language.

Methods

We retrospectively applied our method to a dataset of 232,425 neuroradiology MRI reports in Spanish. We compared various pre-trained T5 models, including multilingual T5 and those newly adapted for Spanish. For precise evaluation, we employed BLEU, METEOR, ROUGE-L, CIDEr, and cosine similarity metrics alongside expert radiologist assessments.

Results

The findings are promising, with the models specifically fine-tuned for neuroradiology MRI achieving scores of 0.46, 0.28, 0.52, 2.45, and 0.87 in the BLEU-1, METEOR, ROUGE-L, CIDEr, and cosine similarity metrics, respectively. In the radiological experts’ evaluation, they found that in 75% of the cases evaluated, the conclusions generated by the system were as good as or even better than the manually generated conclusions.

Conclusion

The methods demonstrate the potential and effectiveness of customizing state-of-the-art pre-trained models for neuroradiology, yielding automatic MRI report conclusions that nearly match expert quality. Furthermore, these results underscore the importance of designing and pre-training a dedicated language model for radiology report summarization.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Hartung MP, Bickle IC, Gaillard F et al (2020) How to create a great radiology report. Radiographics 40:1658–1670CrossRefPubMed Hartung MP, Bickle IC, Gaillard F et al (2020) How to create a great radiology report. Radiographics 40:1658–1670CrossRefPubMed
3.
Zurück zum Zitat Clinger NJ, Hunter TB, Hillman BJ (1988) Radiology reporting: attitudes of referring physicians. Radiology 169:825–826CrossRefPubMed Clinger NJ, Hunter TB, Hillman BJ (1988) Radiology reporting: attitudes of referring physicians. Radiology 169:825–826CrossRefPubMed
4.
Zurück zum Zitat Reda AS, Hashem DA, Khashoggi K, Abukhodair F (2020) Clinicians' behavior toward radiology reports: a cross-sectional study. Cureus 12(11) Reda AS, Hashem DA, Khashoggi K, Abukhodair F (2020) Clinicians' behavior toward radiology reports: a cross-sectional study. Cureus 12(11)
5.
Zurück zum Zitat Zhang Y, Ding DY, Qian T, Manning CD, Langlotz CP (2018) Learning to summarize radiology findings. arXiv preprint arXiv:1809.04698 Zhang Y, Ding DY, Qian T, Manning CD, Langlotz CP (2018) Learning to summarize radiology findings. arXiv preprint arXiv:1809.04698
6.
Zurück zum Zitat MacAvaney S, Sotudeh S, Cohan A, Goharian N, Talati I, Filice RW (2019) Ontology-aware clinical abstractive summarization. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1013–1016) MacAvaney S, Sotudeh S, Cohan A, Goharian N, Talati I, Filice RW (2019) Ontology-aware clinical abstractive summarization. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 1013–1016)
7.
Zurück zum Zitat Zhang Y, Merck D, Tsai EB, Manning CD, Langlotz CP (2019) Optimizing the factual correctness of a summary: A study of summarizing radiology reports. arXiv preprint arXiv:1911.02541 Zhang Y, Merck D, Tsai EB, Manning CD, Langlotz CP (2019) Optimizing the factual correctness of a summary: A study of summarizing radiology reports. arXiv preprint arXiv:1911.02541
8.
Zurück zum Zitat López-Úbeda P, Martín-Noguerol T, Juluru K, Luna A (2022) Natural language processing in radiology: update on clinical applications. J Am Coll Radiol 19(11):1271–1285CrossRefPubMed López-Úbeda P, Martín-Noguerol T, Juluru K, Luna A (2022) Natural language processing in radiology: update on clinical applications. J Am Coll Radiol 19(11):1271–1285CrossRefPubMed
9.
Zurück zum Zitat Hassanpour S, Langlotz CP (2016) Information extraction from multi-institutional radiology reports. Artif Intell Med 66:29–39CrossRefPubMed Hassanpour S, Langlotz CP (2016) Information extraction from multi-institutional radiology reports. Artif Intell Med 66:29–39CrossRefPubMed
10.
Zurück zum Zitat Goff DJ, Loehfelm TW (2018) Automated radiology report summarization using an open-source natural language processing pipeline. J Digit Imaging 31:185–192CrossRefPubMed Goff DJ, Loehfelm TW (2018) Automated radiology report summarization using an open-source natural language processing pipeline. J Digit Imaging 31:185–192CrossRefPubMed
11.
Zurück zum Zitat Hou L, Hu P, Bei C (2018) Abstractive document summarization via neural model with joint attention. In Natural Language Processing and Chinese Computing: 6th CCF International Conference, NLPCC 2017, Dalian, China, November 8–12, 2017, Proceedings 6 (pp. 329–338). Springer International Publishing Hou L, Hu P, Bei C (2018) Abstractive document summarization via neural model with joint attention. In Natural Language Processing and Chinese Computing: 6th CCF International Conference, NLPCC 2017, Dalian, China, November 8–12, 2017, Proceedings 6 (pp. 329–338). Springer International Publishing
12.
Zurück zum Zitat Lin H, Ng V (2019) Abstractive summarization: A survey of the state of the art. In: Proceedings of the AAAI conference on artificial intelligence 33(01):9815–9822 Lin H, Ng V (2019) Abstractive summarization: A survey of the state of the art. In: Proceedings of the AAAI conference on artificial intelligence 33(01):9815–9822
13.
Zurück zum Zitat Rush AM, Chopra S, Weston J (2015) A neural attention model for abstractive sentence summarization. arXiv preprint arXiv:1509.00685 Rush AM, Chopra S, Weston J (2015) A neural attention model for abstractive sentence summarization. arXiv preprint arXiv:1509.00685
14.
Zurück zum Zitat Chopra S, Auli M, Rush AM (2016) Abstractive sentence summarization with attentive recurrent neural networks. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies (pp. 93–98) Chopra S, Auli M, Rush AM (2016) Abstractive sentence summarization with attentive recurrent neural networks. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies (pp. 93–98)
15.
Zurück zum Zitat Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Łukasz K, Polosukhin I (2017) Attention is all you need. Advances in neural information processing systems, 30 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Łukasz K, Polosukhin I (2017) Attention is all you need. Advances in neural information processing systems, 30
16.
Zurück zum Zitat Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L (2019) Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461 Lewis M, Liu Y, Goyal N, Ghazvininejad M, Mohamed A, Levy O, Stoyanov V, Zettlemoyer L (2019) Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. arXiv preprint arXiv:1910.13461
17.
Zurück zum Zitat Zhang J, Zhao Y, Saleh M, Liu P (2020) PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization. In: Proceedings of the 37th International Conference on Machine Learning, in Proceedings of Machine Learning Research 119:11328–11339 Zhang J, Zhao Y, Saleh M, Liu P (2020) PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization. In: Proceedings of the 37th International Conference on Machine Learning, in Proceedings of Machine Learning Research 119:11328–11339
18.
Zurück zum Zitat Raffel C, Shazeer N, Roberts A et al (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res 21:1–67MathSciNet Raffel C, Shazeer N, Roberts A et al (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res 21:1–67MathSciNet
19.
Zurück zum Zitat Rothe S, Narayan S, Severyn A (2020) Leveraging pre-trained checkpoints for sequence generation tasks. Trans Assoc Comput Linguist 8:264–280CrossRef Rothe S, Narayan S, Severyn A (2020) Leveraging pre-trained checkpoints for sequence generation tasks. Trans Assoc Comput Linguist 8:264–280CrossRef
20.
Zurück zum Zitat Gao Y, Miller T, Xu D, Dligach D, Churpek MM, Afshar M (2022) Summarizing patients’ problems from hospital progress notes using pre-trained sequence-to-sequence models. In: Proceedings of COLING. International Conference on Computational Linguistics 2022:2979–2991 Gao Y, Miller T, Xu D, Dligach D, Churpek MM, Afshar M (2022) Summarizing patients’ problems from hospital progress notes using pre-trained sequence-to-sequence models. In: Proceedings of COLING. International Conference on Computational Linguistics 2022:2979–2991
21.
Zurück zum Zitat Zolotareva E, Tashu TM, Horváth T (2020) Abstractive Text Summarization using Transfer Learning. In: Information technologies Applications and Theory Conference 2718:75–80. Zolotareva E, Tashu TM, Horváth T (2020) Abstractive Text Summarization using Transfer Learning. In: Information technologies Applications and Theory Conference 2718:75–80.
22.
Zurück zum Zitat Phan LN, Anibal JT, Tran H, Chanana S, Bahadroglu E, Peltekian A, Altan-Bonnet G (2021) Scifive: a text-to-text transformer model for biomedical literature. arXiv preprint arXiv:2106.03598 Phan LN, Anibal JT, Tran H, Chanana S, Bahadroglu E, Peltekian A, Altan-Bonnet G (2021) Scifive: a text-to-text transformer model for biomedical literature. arXiv preprint arXiv:2106.03598
23.
Zurück zum Zitat Nagoudi EMB, Elmadany A, Abdul-Mageed M (2021) Arat5: Text-to-text transformers for arabic language understanding and generation. arXiv preprint arXiv:2109.12068 Nagoudi EMB, Elmadany A, Abdul-Mageed M (2021) Arat5: Text-to-text transformers for arabic language understanding and generation. arXiv preprint arXiv:2109.12068
24.
Zurück zum Zitat Okpor MD (2014) Machine translation approaches: issues and challenges. Int J Comp Sci Iss (IJCSI) 11:159 Okpor MD (2014) Machine translation approaches: issues and challenges. Int J Comp Sci Iss (IJCSI) 11:159
25.
Zurück zum Zitat Xue L, Constant N, Roberts A, Kale M, Al-Rfou R, Siddhant A, Barua A, Raffel C (2020) mT5: A massively multilingual pre-trained text-to-text transformer. arXiv preprint arXiv:2010.11934 Xue L, Constant N, Roberts A, Kale M, Al-Rfou R, Siddhant A, Barua A, Raffel C (2020) mT5: A massively multilingual pre-trained text-to-text transformer. arXiv preprint arXiv:2010.11934
26.
Zurück zum Zitat Abdaoui A, Pradel C, Sigel G (2020) Load what you need: Smaller versions of multilingual bert. arXiv preprint arXiv:2010.05609 Abdaoui A, Pradel C, Sigel G (2020) Load what you need: Smaller versions of multilingual bert. arXiv preprint arXiv:2010.05609
27.
Zurück zum Zitat Papineni K, Roukos S, Ward T, Zhu WJ (2002) Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the Association for Computational Linguistics (pp. 311–318) Papineni K, Roukos S, Ward T, Zhu WJ (2002) Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the Association for Computational Linguistics (pp. 311–318)
28.
Zurück zum Zitat Banerjee S, Lavie A (2005) METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization (pp. 65–72) Banerjee S, Lavie A (2005) METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization (pp. 65–72)
29.
Zurück zum Zitat Chin-Yew L (2004) Rouge: A package for automatic evaluation of summaries. In: Proceedings of the Workshop on Text Summarization Branches Out (WAS 2004), 2004:74–81 Chin-Yew L (2004) Rouge: A package for automatic evaluation of summaries. In: Proceedings of the Workshop on Text Summarization Branches Out (WAS 2004), 2004:74–81
30.
Zurück zum Zitat Vedantam R, Lawrence Zitnick C, Parikh D (2015) Cider: Consensus-based image description evaluation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 4566–4575 Vedantam R, Lawrence Zitnick C, Parikh D (2015) Cider: Consensus-based image description evaluation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 4566–4575
31.
Zurück zum Zitat Liu Y (2019) Fine-tune BERT for extractive summarization. arXiv preprint arXiv:1903.10318 Liu Y (2019) Fine-tune BERT for extractive summarization. arXiv preprint arXiv:1903.10318
32.
Zurück zum Zitat Wang Z, Chen X, Gong S et al (2021) Predicting doctor’s impression for radiology reports with abstractive text summarization. Stanford CS224N Natural Language Processing with Deep Learning Wang Z, Chen X, Gong S et al (2021) Predicting doctor’s impression for radiology reports with abstractive text summarization. Stanford CS224N Natural Language Processing with Deep Learning
33.
Zurück zum Zitat Johnson AEW, Pollard TJ, Berkowitz SJ et al (2019) MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data 6:1–8CrossRef Johnson AEW, Pollard TJ, Berkowitz SJ et al (2019) MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data 6:1–8CrossRef
34.
Zurück zum Zitat Nishio M, Matsunaga T, Matsuo H, Nogami M, Kurata Y, Fujimoto K, Sugiyama O, Akashi T, Aoki S, Murakami T, Murakami T (2023) Fully automatic summarization of radiology reports using natural language processing with language models. medRxiv 2023–12 Nishio M, Matsunaga T, Matsuo H, Nogami M, Kurata Y, Fujimoto K, Sugiyama O, Akashi T, Aoki S, Murakami T, Murakami T (2023) Fully automatic summarization of radiology reports using natural language processing with language models. medRxiv 2023–12
35.
Zurück zum Zitat Lourenco AP, Baird GL (2020) Optimizing radiology reports for patients and referring physicians: mitigating the curse of knowledge. Acad Radiol 27:436–439CrossRefPubMed Lourenco AP, Baird GL (2020) Optimizing radiology reports for patients and referring physicians: mitigating the curse of knowledge. Acad Radiol 27:436–439CrossRefPubMed
36.
Zurück zum Zitat Uçar MK, Nour M, Sindi H, Polat K (2020) The effect of training and testing process on machine learning in biomedical datasets. Math Probl Eng 2020:1–17CrossRef Uçar MK, Nour M, Sindi H, Polat K (2020) The effect of training and testing process on machine learning in biomedical datasets. Math Probl Eng 2020:1–17CrossRef
37.
Zurück zum Zitat European Society of Radiology (ESR) (2011) Good practice for radiological reporting. Guidelines from the European Society of Radiology (ESR). Insights Into Imaging 2(2):93–96 European Society of Radiology (ESR) (2011) Good practice for radiological reporting. Guidelines from the European Society of Radiology (ESR). Insights Into Imaging 2(2):93–96
38.
Zurück zum Zitat Simon AF, Holmes JH, Schwartz ES (2020) Decreasing radiologist burnout through informatics-based solutions. Clin Imaging 59:167–171CrossRefPubMed Simon AF, Holmes JH, Schwartz ES (2020) Decreasing radiologist burnout through informatics-based solutions. Clin Imaging 59:167–171CrossRefPubMed
Metadaten
Titel
Automatic generation of conclusions from neuroradiology MRI reports through natural language processing
verfasst von
Pilar López-Úbeda
Teodoro Martín-Noguerol
Jorge Escartín
Antonio Luna
Publikationsdatum
21.02.2024
Verlag
Springer Berlin Heidelberg
Erschienen in
Neuroradiology / Ausgabe 4/2024
Print ISSN: 0028-3940
Elektronische ISSN: 1432-1920
DOI
https://doi.org/10.1007/s00234-024-03312-3

Weitere Artikel der Ausgabe 4/2024

Neuroradiology 4/2024 Zur Ausgabe

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Demenzkranke durch Antipsychotika vielfach gefährdet

Demenz Nachrichten

Der Einsatz von Antipsychotika gegen psychische und Verhaltenssymptome in Zusammenhang mit Demenzerkrankungen erfordert eine sorgfältige Nutzen-Risiken-Abwägung. Neuen Erkenntnissen zufolge sind auf der Risikoseite weitere schwerwiegende Ereignisse zu berücksichtigen.

Nicht Creutzfeldt Jakob, sondern Abführtee-Vergiftung

29.05.2024 Hyponatriämie Nachrichten

Eine ältere Frau trinkt regelmäßig Sennesblättertee gegen ihre Verstopfung. Der scheint plötzlich gut zu wirken. Auf Durchfall und Erbrechen folgt allerdings eine Hyponatriämie. Nach deren Korrektur kommt es plötzlich zu progredienten Kognitions- und Verhaltensstörungen.

Schutz der Synapsen bei Alzheimer

29.05.2024 Morbus Alzheimer Nachrichten

Mit einem Neurotrophin-Rezeptor-Modulator lässt sich möglicherweise eine bestehende Alzheimerdemenz etwas abschwächen: Erste Phase-2-Daten deuten auf einen verbesserten Synapsenschutz.

Sozialer Aufstieg verringert Demenzgefahr

24.05.2024 Demenz Nachrichten

Ein hohes soziales Niveau ist mit die beste Versicherung gegen eine Demenz. Noch geringer ist das Demenzrisiko für Menschen, die sozial aufsteigen: Sie gewinnen fast zwei demenzfreie Lebensjahre. Umgekehrt steigt die Demenzgefahr beim sozialen Abstieg.

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.