TY - GEN
T1 - Overview of the ImageCLEFmed 2008 medical image retrieval task
AU - Müller, Henning
AU - Kalpathy-Cramer, Jayashree
AU - Kahn, Charles E.
AU - Hatt, William
AU - Bedrick, Steven
AU - Hersh, William
PY - 2009
Y1 - 2009
N2 - The medical image retrieval task of ImageCLEF is in its fifth year and participation continues to increase to a total of 37 registered research groups. About half the registered groups finally submit results. Main change in 2008 was the use of a new databases containing images of the medical scientific literature (articles from the Journals Radiology and Radiographics). Besides the images, the figure captions and the part of the caption referring to a particular sub-figure were supplied as well as access to the full text articles in html. All texts were in English and the topics were supplied in German, French, and English. 30 topics were made available, ten of each of the categories visual, mixed, semantic. Most groups concentrated on fully automatic retrieval. Only three groups submitted a total of six manual or interactive runs not showing an increase of performance over automatic approaches. In previous years, multi-modal combinations were the most frequent submissions but in 2008 text only runs were clearly higher. Only very few fully visual runs were submitted and non of the fully visual runs had an extremely good performance. Part of these tendencies might be due to semantic topics and the extremely well annotated database. Best results regarding MAP were similar for textual and multi-modal approaches whereas early precision was better for some multi-modal approaches.
AB - The medical image retrieval task of ImageCLEF is in its fifth year and participation continues to increase to a total of 37 registered research groups. About half the registered groups finally submit results. Main change in 2008 was the use of a new databases containing images of the medical scientific literature (articles from the Journals Radiology and Radiographics). Besides the images, the figure captions and the part of the caption referring to a particular sub-figure were supplied as well as access to the full text articles in html. All texts were in English and the topics were supplied in German, French, and English. 30 topics were made available, ten of each of the categories visual, mixed, semantic. Most groups concentrated on fully automatic retrieval. Only three groups submitted a total of six manual or interactive runs not showing an increase of performance over automatic approaches. In previous years, multi-modal combinations were the most frequent submissions but in 2008 text only runs were clearly higher. Only very few fully visual runs were submitted and non of the fully visual runs had an extremely good performance. Part of these tendencies might be due to semantic topics and the extremely well annotated database. Best results regarding MAP were similar for textual and multi-modal approaches whereas early precision was better for some multi-modal approaches.
UR - http://www.scopus.com/inward/record.url?scp=70649103896&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=70649103896&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-04447-2_63
DO - 10.1007/978-3-642-04447-2_63
M3 - Conference contribution
AN - SCOPUS:70649103896
SN - 3642044468
SN - 9783642044465
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 512
EP - 522
BT - Evaluating Systems for Multilingual and Multimodal Information Access - 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008, Revised Selected Papers
T2 - 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008
Y2 - 17 September 2008 through 19 September 2008
ER -