Superimposed Image Description and Retrieval

Superimposed Image Description and Retrieval


 

About

SuperIDR is a superimposed image description and retrieval tool, which combines text and visual content-based image description and retrieval. It allows users to select and mark parts of images and associate them with text annotations. Annotations can be entered using either a pen-based or keypad-based input. Later, users can retrieve information through text- and content-based search on textual descriptions, annotations, images, and parts of images. Users can also retrieve information through browsing. We developed this tool as an aid to species identification for the fisheries domain, working with freshwater fishes of Virginia. We also adapted the tool to work with parasites images and descriptions. We tested both versions in fisheries and biology classes at Virginia Tech and UNICAMP. For details of the tool and the studies, please go through the publications. 

People

Virginia Tech UNICAMP
Edward Fox
Uma Murthy
Eric Hallerman
Yinlin Chen
Ricardo Torres
Nadia Kozievitch
Evandro Ramos
Thiago Falcao
Felipe Andrade

Links

Publications

  1. Kozievitch, N.P., Torres, R. S., Allegretti, S. M., et al., Evaluation of a Tablet PC image annotation and retrieval tool in the parasitology domain. Technical report submitted to the Institute of Computing, UNICAMP, Brazil, 2009. PDF.

  2. Murthy, U., Fox, E. A., Chen, Y., Hallerman, E., Torres, R., Ramos, E., and Falcao, T. Superimposed image description and retrieval for fish species identification. To appear in ECDL '09: Proc. of the 13th European Conference on Research and Advanced Technology for Digital Libraries, Corfu, Greece, 2009. Paper

  3. Murthy, U., Fox, E. A., Chen, Y., Hallerman, E., Torres, R., Ramos, E., and Falcao, T. Species Identification: Fish Images with CBIR and Annotations. In Proc. of the 9th ACM/IEEE Joint Conference on Digital Libraries, Austin, Texas, USA, 2009, p. 435. Paper, Poster
  4. (Demo) Murthy, U., Torres, R., Fox, E.A., Yang, S. and Venkatachalam, L. From Concepts to Implementation and Visualization: Tools from a Team-Based Approach to IR. In Proc. of SIGIR 2008, Singapore, 2008, p. 889. Paper
  5. Kozievitch, N. P. ; Falcao. R. C. ; Torres R. da S. . A .Net Implementation of a Content-Based Image Search Component. In: V Sessao de Demos, 2008, Campinas. XXIII Simposio Brasileiro de Banco de Dados, 2008.
  6. (Demo) Murthy, U., Torres, R.d.S. and Fox, E.A., A Superimposed Application for Enhanced Image Description and Retrieval. In Lecture Notes in Computer Science: Research and Advanced Technology for Digital Libraries, 2006, 540-543. Paper

  7. Murthy, U., Torres, R.d.S. and Fox, E.A. Integrated Support for Superimposed Applications in Biomedical Information Systems, Virginia Tech, 2006 (White paper submitted to the National Library of Medicine) Paper

Acknowledgments

This is a collaborative project between Virginia Tech and University of Campinas, Brazil (UNICAMP). Part of this project was funded by Microsoft Research under the Tablet PC Technology and Higher Education program (2007-2008).

 


Digital Library Research Laboratory

Computer Science Department

Virginia Tech

 Last updated: June 26, 2009