RESEARCH/R&D

Image Processing

Malaria Screener

Research Area: Image Processing

Researchers: Stefan Jaeger, Hang Yu, Sameer Antani, Sivaramakrishnan Rajaraman, Feng Yang

malaria screener project iconMalaria is caused by parasites that are transmitted through the bites of infected mosquitoes. With about 200 million cases worldwide, and about 400,000 deaths per year, malaria is a major burden on global health. Most deaths occur among children in Africa, where a child dies almost every minute from malaria, and where malaria is a leading cause of childhood neuro-disability. Typical symptoms of malaria include fever, fatigue, headaches, and in severe cases seizures, coma, and death.

While existing drugs make malaria a curable disease, inadequate diagnostics and emerging drug resistance are major barriers to successful mortality reduction. The development of a fast and reliable diagnostic test is therefore one of the most promising ways of fighting malaria, together with better treatment, development of new malaria vaccines, and mosquito control.

The current standard method for malaria diagnosis in the field is light microscopy of blood films. About 170 million blood films are examined every year for malaria, which involves manual counting of parasites.

Accurate parasite counts are essential to diagnosing malaria correctly, testing for drug-resistance, measuring drug-effectiveness, and classifying disease severity. However, microscopic diagnostics is not standardized and depends heavily on the experience and skill of the microscopist. It is common for microscopists in low-resource settings to work in isolation, with no rigorous system in place that can ensure the maintenance of their skills and thus diagnostic quality. This leads to incorrect diagnostic decisions in the field. For false negative cases, this means unnecessary use of antibiotics, a second consultation, lost days of work, and in some cases progression into severe malaria. For false positive cases, a misdiagnosis entails unnecessary use of anti-malaria drugs and suffering from their potential side-effects, such as nausea, abdominal pain, diarrhea, and sometimes severe complications.

To improve malaria diagnostics, the Lister Hill National Center for Biomedical Communications, an R&D division of the US National Library of Medicine, in collaboration with NIH’s National Institute of Allergy and Infectious Diseases (NIAID) and Mahidol-Oxford University, is developing a fully-automated system for parasite detection and counting in blood films.

Automatic parasite counting has several advantages compared to manual counting:

  • It provides a more reliable and standardized interpretation of blood films.
  • It allows more patients to be served by reducing the workload of the malaria field workers.
  • And, it reduces diagnostic costs.

To count parasites automatically, the system uses image processing methods to find parasites in digitized images of blood films. The system first learns the typical shape and visual appearance of parasites based on manually-annotated training images. Machine learning methods then detect whether parasites are present, perform the counting, and discriminate between infected and uninfected cells. The system uses digital images acquired on standard light microscopy equipment, which makes it well-suited for resource-poor settings. The goal is to use inexpensive and highly portable smartphone technology to acquire blood film images in the field and to run the automated diagnostic system on these images. To achieve this goal, the HHS Ventures Fund is supporting the porting of our software to a smartphone platform. The Ventures Fund is a highly competitive effort that provides growth-stage funding, 15 months of mentoring, and management tools to support teams seeking to move their proven concepts to scale and create sustainable business models for their applications.

Extramural researchers on this project are Abhisheka Bansal (Jawaharlal Nehru University, India), Kamolrat Silamut (Mahidol University, Thailand), Richard Maude (University of Oxford, UK), Kannappan Palaniappan (University of Missouri), and Ilker Ersoy (University of Missouri). Datasets associated with this project are here.

Malaria Screener datasheet Details of datasets and download links

Malaria Screener App Download our smartphone-based software "Malaria Screener"


In a separate project, we are developing a software application to automate parasitemia measurements in rodent malaria models for the preclinical testing of antimalarial drugs and vaccines.

Publications

Yu H, Mohammed FO, Hamid MA, Yang F, Kassim YM, Mohamed AO, Maude RJ, Ding XC, Owusu ED, Yerlikaya S, Dittrich S, Jaeger S . Patient-level performance evaluation of a smartphone-based malaria diagnostic application. Malar J 22, 33 (2023). https://doi.org/10.1186/s12936-023-04446-0.

Ufuktepe DK, Yang F, Kassim YM, Yu H, Maude RJ, Palaniappan K, Jaeger S. Deep Learning-Based Cell Detection and Extraction in Thin Blood Smears for Malaria Diagnosis. 50th Annual IEEE AIPR 2021, held virtually October 12-14, 2021.

Kassim YM, Yang F, Yu H, Maude RJ, Jaeger S. Diagnosing Malaria Patients with Plasmodium falciparum and vivax Using Deep Learning for Thick Smear Images. Diagnostics (Basel). 2021 Oct 27;11(11):1994. doi: 10.3390/diagnostics11111994. PMID: 34829341; PMCID: PMC8621537.

Kassim YM, Palaniappan K, Yang F, Poostchi M, Palaniappan N, Maude RJ, Antani S, Jaeger S. Clustering-Based Dual Deep Learning Architecture for Detecting Red Blood Cells in Malaria Diagnostic Smears. IEEE J Biomed Health Inform. 2021 May;25(5):1735-1746. doi: 10.1109/JBHI.2020.3034863. Epub 2021 May 11.

Yu H, Yang F, Rajaraman S, Ersoy I, Moallem G, Poostchi M, Palaniappan K, Antani S, Maude RJ, Jaeger S. Malaria Screener: a smartphone application for automated malaria screening. BMC Infect Dis. 2020 Nov 11;20(1):825. doi: 10.1186/s12879-020-05453-1.

Yang F, Quizon N, Silamut K, Maude RJ, Jaeger S, Antani SK. Cascading YOLO: Automated Malaria Parasite Detection for Plasmodium Vivax in Thin Blood Smears. Proc. SPIE 11314, Medical Imaging 2020: Computer-Aided Diagnosis, 113141Q (16 March 2020); https://doi.org/10.1117/12.2549701.

Yu H, Yang F, Silamut R, Maude S, Jaeger S, Antani SK. Automatic Blood Smear Analysis with Artificial Intelligence and Smartphones [Poster]. ASTMH 68th Annual Meeting, Washington DC, Nov. 20-24, 2019.

Rajaraman S, Jaeger S, Antani SK. Performance evaluation of deep neural ensembles toward malaria parasite detection in thin-blood smear images. PeerJ. doi: 10.7717/peerj.6977.

Yang F, Poostchi M, Silamut K, Maude RJ, Jaeger S, Thoma G. Automated Parasite Classification of Malaria on Thick Blood Smears [Poster]. ASTMH 67th Annual Meeting, New Orleans, LA, Oct. 28 – Nov. 1, 2018.

Yang F, Yu H, Silamut K, Maude RJ, Jaeger S, Antani SK. Parasite Detection in Thick Blood Smears Based on Customized Faster-RCNN. Proceedings of AIPR2019, Washington DC, USA, Oct 15-17, 2019.

Yang F, Yu H, Silamut K, Maude R, Jaeger S, Antani SK. Smartphone-Supported Malaria Diagnosis Based on Deep Learning. Proceedings of 10th Workshop on Machine Learning in Medical Imaging (MLMI 2019) in conjunction with MICCAI, Shenzhen, China, Oct 13-17, 2019.

Yang F, Poostchi M, Yu H, Zhou Z, Silamut K, Yu J, Maude RJ, Jaeger S, Antani S. . Deep learning for smartphone-based malaria parasite detection in thick blood smears. IEEE J Biomed Health Inform. 2020 May;24(5):1427-1438. doi: 10.1109/JBHI.2019.2939121. Epub 2019 Sep 23.

Rajaraman S, Jaeger S, Antani SK. Performance evaluation of deep neural ensembles toward malaria parasite detection in thin-blood smear images. PeerJ 7:e6977

Yang F, Yu H, Poostchi M, Silamut K, Maude RJ, Jaeger S. Smartphone-Supported Automated Malaria Parasite Detection. SIIM conference on Machine Intelligence in Medical Imaging, 2018.

Jaeger S, Antani SK, Rajaraman S, Yang F, Yu H. Malaria Screening: Research into Image Analysis and Deep Learning. Report to the Board of Scientific Counselors September 2018.

Rajaraman S, Silamut K, Hossain MA, Ersoy I, Maude RJ, Jaeger S, Thoma GR, Antani SK. Understanding the learned behavior of customized convolutional neural networks toward malaria parasite detection in thin blood smear images. J Med Imaging (Bellingham). 2018 Jul;5(3):034501. doi: 10.1117/1.JMI.5.3.034501. Epub 2018 Jul 18.

Rajaraman S, Antani SK, Poostchi Mohammadabadi M, Silamut K, Hossain MA, Maude RJ, Jaeger S, Thoma GR. Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images. PeerJ. 2018 Apr 16;6:e4568. doi: 10.7717/peerj.4568. eCollection 2018.

Poostchi M, Silamut K, Maude RJ, Jaeger S, Thoma GR. Image analysis and machine learning for detecting malaria. Transl Res. 2018 Apr;194:36-55. doi: 10.1016/j.trsl.2017.12.004. Epub 2018 Jan 12.

Rajaraman S, Antani SK, Jaeger S. Visualizing Deep Learning Activations for Improved Malaria Cell Classification. Proceedings of The First Workshop in Medical Informatics and Healthcare (MIH 2017), Proceedings of Machine Learning Research (PMLR), v. 69, p. 40-47.

Rajaraman S, Antani SK, Poostchi M, Silamut K, Hossain MA, Maude RJ, Jaeger S, Thoma GR. Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images. PeerJ. 2018 Apr 16;6:e4568. doi: 10.7717/peerj.4568. PMID: 29682411; PMCID: PMC5907772.

Liang Z, Powell A, Ersoy I, Poostchi M, Silamut K, Palaniappan K, Guo P, Hossain M, Antani SK, Maude R, Huang J, Jaeger S, Thoma GR. CNN-Based Image Analysis for Malaria Diagnosis. IEEE International Conference on Bioinformatics & Biomedicine (BIBM), Shenzhen, China, 2016.

Gordon, E, Ersoy, I, Jaeger S, Waisberg, M, Pena, M, Thoma GR, Antani SK, Pierce, S, Palaniappan, K. Retinal Microcirculation Dynamics During an Active Malarial Infection [Poster]. Annual Meeting of the American Society of Tropical Medicine and Hygiene (ASTMH), 2014.

Gordon E, Waisberg M, Ersoy I, Pena M, Jaeger S, Pierce S. The eye as a window to investigate the CNS microvasculature during a dynamic malaria infection [Abstract]. Third Annual Seminar on Molecular Imaging of Infectious Diseases, September 23, 2013.