Computing That Serves

Performance Evaluation in (Document) Image Interpretation ... an Undecidable Problem


Monday, February 9, 2015 - 3:00pm


Bart Lamiroy


Eric Ringger

Colloquium presented by Bart Lamiroy
Monday, February 9, 2015 at 3:00 PM
Location: 112 TMCB
​<<< Note Special Day & Location for This Colloquium >>>


A significant amount of research in Document Image Analysis, and Machine Perception in general, relies on the extraction and analysis of signal cues with the goal of interpreting them into higher level information.
This talk will give a high-level overview on how this interpretation process is usually considered, and how the research communities proceed in evaluating existing approaches and methods developed for realizing these processes. Evaluation being an essential part to measuring the quality of research and assessing the progress of the state-of-the art, our work aims at showing that classical evaluation methods are not necessarily well suited for interpretation problems, or, at least, that they introduce a strong bias, not necessarily visible at first sight, and that new ways of comparing methods and measuring performance are necessary. It also shows that the infamous Semantic Gap seems to be an inherent and unavoidable part of the general interpretation process, especially when considered within the framework of traditional evaluation.


Bart Lamiroy is an Associate Professor at the Universite de Lorraine and Loria research lab, in Nancy, France, since 2000. He was a visiting scientist at Lehigh University from January 2010 to July 2011. He has a broad experience in Machine Perception. Over the years, his research topics have ranged from Content Based Image Retrieval over Visual Servoing to Document Analysis. From 2007 to 2009, he was chair of the Computer Science and IT Department at the Ecole des Mines de Nancy, France.
Before that he was a research contractor at INRIA, after having obtained his Ph.D. in computer vision at the Institut National Polytechnique de Grenoble, France in 1998. He received his bachelor’s degree in applied mathematics in 1993.

He is also involved in the International Association for Pattern Recognition (IAPR) where he serves as chair of the Publicity and Publications Committee, is IAPR TC-10 Committee Dataset Curator, and is treasurer of the French IAPR chapter: AFRIF.