Skip to main content

Advertisement

Springer Nature Link
Log in

Content-based medical image retrieval system for lung diseases using deep CNNs

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

Content-based image retrieval (CBIR) systems are designed to retrieve images that are relevant, based on detailed analysis of latent image characteristics, thus eliminating the dependency of natural language tags, text descriptions, or keywords associated with the images. A CBIR system maintains high-level image visuals in the form of feature vectors, which the retrieval engine leverages for similarity-based matching and ranking for a given query image. In this paper, a CBIR system is proposed for the retrieval of medical images (CBMIR) for enabling the early detection and classification of lung diseases based on lung X-ray images. The proposed CBMIR system is built on the predictive power of deep neural models for the identification and classification of disease-specific features using transfer learning based models trained on standard COVID-19 Chest X-ray image datasets. Experimental evaluation on the standard dataset revealed that the proposed approach achieved an improvement of 49.71% in terms of precision, averaging across various distance metrics. Also, an improvement of 26.55% was observed in the area under precision-recall curve (AUPRC) values across all subclasses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

Notes

  1. Available online. https://github.com/ieee8023/covid-chestxray-dataset which contains data collected from open sources.

References

  1. Gudivada VN, Raghavan VV (1995) Content based image retrieval systems. Computer 28(9):18–22

    Article  Google Scholar 

  2. Qayyum A, Anwar SM, Awais M, Majid M (2017) Medical image retrieval using deep convolutional neural network. Neurocomputing, 266, pp.8-20.

    Article  Google Scholar 

  3. Mane PP, Bawane NG (2016) An effective technique for the content based image retrieval to reduce the semantic gap based on an optimal classifier technique. Pattern Recognition and Image Analysis, 26(3), pp.597-607.

  4. Selvarajah S, Kodituwakku S (2011) Analysis and comparison of texture features for content based image retrieval. Energy, 1(1), pp.108-113.

  5. Karthik K, Kamath S (2021) Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation. Biomedical Physics & Engineering Express, 8(1), p.015011.

  6. Liu Y, Zhang D, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. Pattern recognition, 40(1), pp.262-282.

  7. Hwang KH, Lee H, Choi D (2012) Medical image retrieval: past and present. Healthc Inform Res 18(1):3–9

    Article  Google Scholar 

  8. Mizotin M, Benois-Pineau J, Allard M, Catheline G (2012) Feature-based brain mri retrieval for Alzheimer disease diagnosis. In: 2012 19th IEEE intl. conf. on image processing. IEEE

  9. Mayya V, Kamath Shevgoor S, Kulkarni U, Hazarika M, Barua PD, Acharya UR (2021) Multi-scale convolutional neural network for accurate corneal segmentation in early detection of fungal keratitis. J Fungi 7(10):850

    Article  Google Scholar 

  10. Pilevar A (2011) Cbmir: content-based image retrieval algorithm for medical image databases. J Med Signals Sens 1:12–8

    Article  Google Scholar 

  11. Jiji W, Raj PD (2014) Content-based image retrieval in dermatology using intelligent technique. IET Image Proc 9(4):306–317

    Article  Google Scholar 

  12. Ponciano-Silva M, Souza J et al (2013) Does a cbir system really impact decisions of physicians in a clinical environment? In: 26th IEEE intl. symposium on computer-based medical systems. IEEE

  13. Rahman M, Antani SK, Thoma GR (2011) A learning-based similarity fusion and filtering approach for biomedical image retrieval using svm classification and relevance feedback. IEEE Trans Inf Technol Biomed 15(4):640–646

    Article  Google Scholar 

  14. Deng L, Yu D (2014) Deep learning: methods and applications. Found Trends Signal Process 7(3–4):197–387

    Article  MathSciNet  MATH  Google Scholar 

  15. Marcus G (2018) Deep learning: a critical appraisal. arXiv:1801.00631

  16. Vikram M, Anantharaman A, Suhas B (2019) An approach for multimodal medical image retrieval using latent Dirichlet allocation. In: ACM India intl. conf. on data science and management of data, pp 44–51

  17. Karthik K, Kamath SS (2021) A deep neural network model for content-based medical image retrieval with multi-view classification. Vis Comput 37(7):1837–1850

    Article  Google Scholar 

  18. Nedumkunnel I, George L, Rosh N (2021) Explainable deep neural models for covid-19 prediction from chest x-rays with region of interest visualization. In: 2021 intl. conf. on secure cyber computing. IEEE

  19. Dalia Y, Bharath A, Mayya V (2021) DeepOA: clinical decision support system for early detection and severity grading of knee osteoarthritis. In: 2021 intl. conf. on computer, communication and signal processing. IEEE

  20. Hu S, Gao Y, Niu Z, Jiang Y et al (2020) Weakly supervised deep learning for covid-19 infection detection and classification from ct images. IEEE Access, 8, pp.118869-118883.

  21. Wang L, Lin ZQ, Wong A (2020) Covid-net: a tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images. Sci Rep 10(1):1–12

    Google Scholar 

  22. Horry MJ, Chakraborty S et al (2020) COVID-19 detection through transfer learning using multimodal imaging data. Ieee Access, 8, pp.149808-149824.

  23. Banerjee A, Ray S, Vorselaars B et al (2020) Use of machine learning and artificial intelligence to predict sars-cov-2 infection from full blood counts in a population. Int Immunopharmacol 86:106705

    Article  Google Scholar 

  24. Pineda AL, Ye Y, Visweswaran S (2015) Comparison of machine learning classifiers for influenza detection from emergency department free-text reports. Journal of biomedical informatics, 58, pp.60-69.

  25. Serener A, Serte S (2020) Deep learning for mycoplasma pneumonia discrimination from pneumonias like covid-19. In: 2020 4th intl. symposium on multidisciplinary studies and innovative technologies. IEEE

  26. Lanera C, Berchialla P, Baldi I (2020) Use of Machine Learning Techniques for Case-Detection of Varicella Zoster Using Routinely Collected Textual Ambulatory Records: Pilot Observational Study. JMIR Medical Informatics, 8(5), p.e14330.

  27. Kamal K, Yin Z, Wu M, Wu Z (2021) Evaluation of deep learning-based approaches for COVID-19 classification based on chest X-ray images. Signal, image and video processing, 15(5), pp.959-966.

  28. Sahinbas K, Catak FO (2021) Transfer learning-based convolutional neural network for covid-19 detection with x-ray images. In: Data science for COVID-19. Elsevier, pp 451–466

  29. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  30. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition

  31. Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE

Download references

Author information

Author notes

  1. Shubham Agrawal, Aastha Chowdhary and Saurabh Agarwala have contributed equally to this work.

Authors and Affiliations

  1. Healthcare Analytics and Language Engineering (HALE) Lab, Department of Information Technology, National Institute of Technology Karnataka, Surathkal, Mangalore, Karnataka, 575025, India

    Shubham Agrawal, Aastha Chowdhary, Saurabh Agarwala, Veena Mayya & Sowmya Kamath S.

  2. Department of Information and Communication Technology, Manipal Institute of Technology, Manipal Academy of Higher Education (MAHE), Manipal, Karnataka, 576104, India

    Veena Mayya

Authors
  1. Shubham Agrawal
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Aastha Chowdhary
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Saurabh Agarwala
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Veena Mayya
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Sowmya Kamath S.
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding authors

Correspondence to Shubham Agrawal or Veena Mayya.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Agrawal, S., Chowdhary, A., Agarwala, S. et al. Content-based medical image retrieval system for lung diseases using deep CNNs. Int. j. inf. tecnol. 14, 3619–3627 (2022). https://doi.org/10.1007/s41870-022-01007-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-022-01007-7

Keywords

Profiles

  1. Veena Mayya View author profile