Education, Science, Technology, Innovation and Life
Open Access
Sign In

Auto-outlier Fusion Technique for Chest X-ray Classification with Multi-head Attention Mechanism

Download as PDF

DOI: 10.23977/jipta.2023.060101 | Downloads: 7 | Views: 585


Yuru Jing 1, Zixuan Li 2


1 University College London, Gower Street, London, WC1E 6BT, UK
2 University of Sheffield, Western Bank, Sheffield, S10 2TN, UK

Corresponding Author

Yuru Jing


A chest X-ray is one of the most widely available radiological examinations for diagnosing and detecting various lung illnesses. The National Institutes of Health (NIH) provides an extensive database, ChestX-ray8 and ChestXray14, to help establish a deep learning community for analysing and predicting lung diseases. ChestX-ray14 consists of 112,120 frontal-view X-ray images of 30,805 distinct patients with text-mined fourteen disease image labels, where each image has multiple labels and has been utilised in numerous research in the past. To our current knowledge, no previous study has investigated outliers and multi-label impact for a single X-ray image during the preprocessing stage. The effect of outliers is mitigated in this paper by our proposed auto-outlier fusion technique. The image label is regenerated by concentrating on a particular factor in one image. The final cleaned dataset will be used to compare the mechanisms of multi-head self-attention and multi-head attention with generalised max-pooling.


Auto-outlier Fusion Technique, Chest X-ray classification, Generalized max-pooling, Self-attention, multi-head attention, Deep learning


Yuru Jing, Zixuan Li, Auto-outlier Fusion Technique for Chest X-ray Classification with Multi-head Attention Mechanism. Journal of Image Processing Theory and Applications (2023) Vol. 6: 1-10. DOI:


[1] Smith-Bindman, R., Miglioretti, D. L., Johnson, E., Lee, C., Feigelson, H. S., Flynn, M., Greenlee, R. T., Kruger, R. L., Hornbrook, M. C., Roblin, D., et al.. "Use of diagnostic imaging studies and associated radiation exposure for patients enrolled in large integrated health care systems, 1996-2010," Jama 307(22), 2400–2409 (2012).
[2] Gazda, M., Plavka, J., Gazda, J., and Drotar, P.. "Self-supervised deep convolutional neural network for chest x-ray classification," IEEE Access 9, 151972–151982 (2021).
[3] Davenport, T. and Kalakota, R.. "The potential for artificial intelligence in healthcare," Future healthcare journal 6(2), 94 (2019).
[4] Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., Van Der Laak, J. A., Van Ginneken, B., and S´anchez, C. I.. "A survey on deep learning in medical image analysis," Medical image analysis 42, 60–88 (2017).
[5] Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.. "Chestx-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases," in [2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)], 3462–3471 (2017).
[6] Callı, E., Sogancioglu, E., van Ginneken, B., van Leeuwen, K. G., and Murphy, K.. "Deep learning for chest x-ray analysis: A survey," Medical Image Analysis 72, 102125 (2021).
[7] Owais, M., Arsalan, M., Mahmood, T., Kim, Y. H., Park, K. R., et al.. "Comprehensive computer-aided decision support framework to diagnose tuberculosis from chest x-ray images: data mining study," JMIR medical informatics 8(12), e21790 (2020).
[8] Oh, Y., Park, S., and Ye, J. C. “Deep learning covid-19 features on cxr using limited training data sets,” IEEE transactions on medical imaging 39(8), 2688–2700 (2020).
[9] Yoo, H., Kim, K. H., Singh, R., Digumarthy, S. R., and Kalra, M. K. "Validation of a deep learning algorithm for the detection of malignant pulmonary nodules in chest radiographs," JAMA network open 3(9), e2017135–e2017135 (2020).
[10] Kusakunniran, W., Karnjanapreechakorn, S., Siriapisith, T., Borwarnginn, P., Sutassananon, K., Tongdee, T., and Saiviroonporn, P.. "Covid-19 detection and heatmap generation in chest x-ray images," Journal of Medical Imaging 8(S1), 014001 (2021).
[11] Niu, Z., Zhong, G., and Yu, H.. "A review on the attention mechanism of deep learning," Neurocomputing 452, 48–62 (2021).
[12] Baltruschat, I. M., Nickisch, H., Grass, M., Knopp, T., and Saalbach, A.. "Comparison of deep learning approaches for multi-label chest x-ray classification," Scientific reports 9(1), 1–10 (2019).
[13] Wang, H., Jia, H., Lu, L., and Xia, Y.. "Thorax-net: an attention regularized deep neural network for classification of thoracic diseases on chest radiography," IEEE journal of biomedical and health informatics 24(2), 475–485 (2019).
[14] Wang, H., Wang, S., Qin, Z., Zhang, Y., Li, R., and Xia, Y.. "Triple attention learning for classification of 14 thoracic diseases using chest radiography," Medical Image Analysis 67, 101846 (2021).
[15] Agarwal, A. and Gupta, N.. "Comparison of outlier detection techniques for structured data," arXiv preprint arXiv:2106.08779 (2021).
[16] Bakar, Z. A., Mohemad, R., Ahmad, A., and Deris, M. M.. "A comparative study for outlier detection techniques in data mining," in [2006 IEEE conference on cybernetics and intelligent systems], 1–6, IEEE (2006).
[17] Vinutha, H., Poornima, B., and Sagar, B.. "Detection of outliers using interquartile range technique from intrusion dataset," in [Information and decision sciences], 511–518, Springer (2018).
[18] Breunig, M. M., Kriegel, H.-P., Ng, R. T., and Sander, J.. "Lof: identifying density-based local outliers," in [Proceedings of the 2000 ACM SIGMOD international conference on Management of data], 93–104 (2000).
[19] Liu, F. T., Ting, K. M., and Zhou, Z.-H.. "Isolation forest," in [2008 eighth ieee international conference on data mining], 413–422, IEEE (2008).
[20] Bounsiar, A. and Madden, M. G.. "One-class support vector machines revisited," in [2014 International Conference on Information Science & Applications (ICISA)], 1–4, IEEE (2014).
[21] Hoyle, B., Rau, M. M., Paech, K., Bonnett, C., Seitz, S., and Weller, J.. "Anomaly detection for machine learning redshifts applied to sdss galaxies," Monthly Notices of the Royal Astronomical Society 452(4), 4183–4194 (2015).
[22] Chawsheen, A. H., Subhi Latif, I., et al.. "Detection and treatment of outliers in data sets," IRAQI JOURNAL OF STATISTICAL SCIENCES 6(9), 58–74 (2006).
[23] Mowbray, F. I., Fox-Wasylyshyn, S. M., and El-Masri, M. M.. "Univariate outliers: a conceptual overview for the nurse researcher," Canadian Journal of Nursing Research 51(1), 31–37 (2019).
[24] Christlein, V., Spranger, L., Seuret, M., Nicolaou, A., Kr´al, P., and Maier, A.. "Deep generalized max pooling," in [2019 International conference on document analysis and recognition (ICDAR)], 1090–1096, IEEE (2019).
[25] Murray, N., J´egou, H., Perronnin, F., and Zisserman, A. "Interferences in match kernels," IEEE transactions on pattern analysis and machine intelligence 39(9), 1797–1810 (2016).
[26] Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll´ar, P.. "Focal loss for dense object detection," in [Proceedings of the IEEE international conference on computer vision], 2980–2988 (2017).
[27] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L ., and Polosukhin, I.. "Attention is all you need," Advances in neural information processing systems 30 (2017).
[28] Woo, S., Park, J., Lee, J.-Y., and Kweon, I. S.. "Cbam: Convolutional block attention module," in [Proceedings of the European conference on computer vision (ECCV)], 3–19 (2018).
[29] Hou, Q., Zhou, D., and Feng, J.. "Coordinate attention for efficient mobile network design," in [Proceedings of the IEEE/CVF conference on computer vision and pattern recognition], 13713–13722 (2021).
[30] Hossin, M. and Sulaiman, M. N.. "A review on evaluation metrics for data classification evaluations," International journal of data mining & knowledge management process 5(2), 1 (2015).

Downloads: 1138
Visits: 99213

Sponsors, Associates, and Links

All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.