Measures of Similarity

Ranjith Unnikrishnan and Martial Hebert
Seventh IEEE Workshop on Applications of Computer Vision, January, 2005, pp. 394-400.


Download
  • Adobe portable document format (pdf) (504KB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
Quantitative evaluation and comparison of image segmentation algorithms is now feasible owing to the recent availability of collections of hand-labeled images. However, little attention has been paid to the design of measures to compare one segmentation result to one or more manual segmentations of the same image. Existing measures in statistics and computer vision literature suffer either from intolerance to labeling refinement, making them unsuitable for image segmentation, or from the existence of degenerate cases, making the process of training algorithms using the measures to be prone to failure. This paper surveys previous work on measures of similarity and illustrates scenarios where they are applicable for performance evaluation in computer vision. For the image segmentation problem, we propose a measure that addresses the above concerns and has desirable properties such as accommodation of labeling errors at segment boundaries, region sensitive refinement, and compensation for differences in segment ambiguity between images.

Keywords
image segmentation, performance evaluation

Notes
Sponsor: DARPA MARS 2020
Grant ID: NBCH1020014
Number of pages: 7

Text Reference
Ranjith Unnikrishnan and Martial Hebert, "Measures of Similarity," Seventh IEEE Workshop on Applications of Computer Vision, January, 2005, pp. 394-400.

BibTeX Reference
@inproceedings{Unnikrishnan_2005_4874,
   author = "Ranjith Unnikrishnan and Martial Hebert",
   title = "Measures of Similarity",
   booktitle = "Seventh IEEE Workshop on Applications of Computer Vision",
   pages = "394-400",
   month = "January",
   year = "2005",
}