You are here


Screen detail of OpenI Web page
Project information

The Open-ism (pronounced “open eye”) experimental multimedia search engine retrieves and displays structured MEDLINE citations augmented by image-related text and concepts and linked to images based on image features.

The Open-i project provides novel information retrieval services for biomedical articles from the full text collections such as PubMed Central. It is unique in its ability to index both the text and images in the articles. The article retrieval is powered by the LHNCBC-built search engine Essie.

The Open-I biomedical image search engine lets users retrieve not only the MEDLINE citation information, but also the outcome statements in the article and the most relevant figure from it. Further, it is possible to use the figure as a query component to find other relevant images or other visually similar images. Future stages aim to provide image region-of-interest (ROI) based querying. The initial number of images is projected to be around 600,000 and will scale to millions. The extensive image analysis and indexing and deep text analysis and indexing require distributed computing. Future plans include making the image computation services available as a NLM service.

Long LR, Antani SK, Thoma GR, Deserno TM. Content-based Image Retrieval For Advancing Medical Diagnostics, Treatment, and Education New Technologies for Advancing Healthcare and Clinical Practices. June 2011:1-17.
Xue Z, Long LR, Antani SK, Thoma GR. Pathology-based vertebral image retrieval. Proceedings of the 8th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, ISBI 2011, March 30 - April 2, 2011, Chicago, Illinois, USA. pages 1893-1896, IEEE, 2011. doi: 10.1109/ISBI.2011.5872778.
Cheng B, Antani SK, Stanley J, Demner-Fushman D, Thoma GR. Automatic segmentation of subfigure image panels for multimodal biomedical document retrieval. Proceeding of: Document Recognition and Retrieval XVIII - DRR 2011, 18th Document Recognition and Retrieval Conference, part of the IS&T-SPIE Electronic Imaging Symposium, San Jose, CA, USA, January 24-29, 2011, Proceedings.
You D, Antani SK, Demner-Fushman D, Rahman MM, Govindaraju V, Thoma GR. Automatic identification of ROI in figure images toward improving hybrid (text and image) biomedical document retrieval. Proceedings of SPIE Electronic Imaging Science and Technology, Document Retrieval and Recognition XVIII. San Francisco, CA. January 2011;7874:78740K.
Simpson M, Demner-Fushman D, Thoma GR. Evaluating the Importance of Image-related Text for Ad-hoc and Case-based Biomedical Article Retrieval. AMIA Annu Symp Proc. 2010 Nov 13;2010:752-6.
Demner-Fushman D, Antani SA, Simpson M, Rahman MM. Combining Text and Visual Features for Biomedical Information Retrieval and Ontologies. September 2010 Technical Report to the LHNCBC Board of Scientific Counselors.
Rahman MM, Antani SK, Thoma GR. Biomedical Image Retrieval In a Fuzzy Feature Space With Affine Region Detection and Vector Quantization of a Scale-Invariant Descriptor. 6th International Symposium on Visual Computing (ISVC) 2010. Las Vegas, NV. November 2010.
Rahman MM, Antani SK, Thoma GR. Bag of Keypoints-Based Biomedical Image Search With Affine Covariant Region Detection and Correlation-Enhanced Similarity Matching. 23rd IEEE International Symposium on Computer-Based Medical Systems (CBMS ) 2010. Perth, Australia. October 2010:261-6.
Rahman MM, Antani S, Long LR, Demner-Fushman D, Thoma GR. Multi-Modal Query Expansion Based on Local Analysis for Medical Image Retrieval. Lecture Notes in Computer Science. First MICCAI International Workshop on Medical Content-Based Retrieval for Clinical Decision Support (MCBR-CDS 2009); part of the 12th International Conference on Medical Image Computing and Computer Assisted Interventio February 2010;5853/2010(doi: 10.1007/978-3-642-11769-5):110-9..
You D, Antani S, Demner-Fushman D, Rahman MM, Govindarju V, Thoma GR. Biomedical Article Retrieval Using Multimodal Features and Image Annotations In Region-based CBIR. Document Recognition and Retrieval XVII. Edited by Likforman-Sulem, Laurence; Agam, Gady. Proceedings of the SPIE. San Jose, CA. January 2010;7534:75340V-75340V-12.