Posted by
jni on
Nov 05, 2014; 1:55pm
URL: http://imagej.273.s1.nabble.com/Measure-Unit-for-Goodness-of-Segmentation-tp5010313p5010314.html
Hi Jacob,
This is a large and fertile research topic. =) Your ideal evaluation method strongly depends on what you're segmenting and why. For roundish objects where you want to get the shape mostly right, Luis Pedro Coelho recommends Hausdorff distance or his own normalised sum of distances (NSD) metric, and I tend to agree with his assessment:
https://metarabbit.wordpress.com/2013/09/11/nuclear-segmentation-in-microscope-cell-images/http://metarabbit.wordpress.com/2013/09/16/why-pixel-counting-is-not-adequate-for-evaluating-segmentation/For neurons or other complex objects, boundary-based metrics can be a bit more problematic, but the less said about the popular Rand Index, the better. I've advocated for the Variation of Information before, for a few reasons, but most compellingly: it's measured in bits and easily interpretable, and it decomposes very naturally into oversegmentation (false splits) and undersegmentation (false merges). See discussion here, under "Results/Evaluation", including Fig 4:
http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0071715#s3Sorry for the #shamelessselfpromotion, but since I've written extensively on the topic I'd rather not repeat myself. ;)
As I mentioned, this is a deep field and others may weigh in with different opinions. Hope this helps!
Juan.
On Thu, Nov 6, 2014 at 12:36 AM, Rebecca Keller <
[hidden email]>
wrote:
> Dear Fellow Imagers,
> Has anyone come across a reliable method for quantifying the goodness of
> segmentation, or at least a discussion addressing this issue? I realize
> there are about a billion ways to segment an image, and all segmentation
> problems have their unique issues, but it seems to me that it would be good
> to have a way to quantify or benchmark various methods objectively. I
> improvised recently a sort of z-score of the segmented ROIs versus
> background, but I am pretty sure this would not work for all cases. Any
> thoughts about this?
> All the best,
> Jacob Keller
> --
> ImageJ mailing list:
http://imagej.nih.gov/ij/list.html--
ImageJ mailing list:
http://imagej.nih.gov/ij/list.html