Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks

Henning Müller, Thomas Deselaers, Thomas M. Deserno, Jayashree Kalpathy-Cramer, Eugene Kim, William (Bill) Hersh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

43 Citations (Scopus)

Abstract

This paper describes the medical image retrieval and medical image annotation tasks of ImageCLEF 2007. Separate sections describe each of the two tasks, with the participation and an evaluation of major findings from the results of each given. A total of 13 groups participated in the medical retrieval task and 10 in the medical annotation task. The medical retrieval task added two new data sets for a total of over 66'000 images. Topics were derived from a log file of the Pubmed biomedical literature search system, creating realistic information needs with a clear user model. The medical annotation task was in 2007 organized in a new format as a hierarchical classification had to be performed and classification could be stopped at any hierarchy level. This required algorithms to change significantly and to integrate a confidence level into their decisions to be able to judge where to stop classification to avoid making mistakes in the hierarchy. Scoring took into account errors and unclassified parts.

Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages472-491
Number of pages20
Volume5152 LNCS
DOIs
StatePublished - 2008
Event8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007 - Budapest, Hungary
Duration: Sep 19 2007Sep 21 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5152 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007
CountryHungary
CityBudapest
Period9/19/079/21/07

Fingerprint

Medical Image
Annotation
Retrieval
Hierarchical Classification
Image Annotation
User Model
Confidence Level
Image Retrieval
Scoring
Integrate
Image retrieval
Evaluation
Hierarchy
Participation

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Müller, H., Deselaers, T., Deserno, T. M., Kalpathy-Cramer, J., Kim, E., & Hersh, W. B. (2008). Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5152 LNCS, pp. 472-491). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5152 LNCS). https://doi.org/10.1007/978-3-540-85760-0-59

Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks. / Müller, Henning; Deselaers, Thomas; Deserno, Thomas M.; Kalpathy-Cramer, Jayashree; Kim, Eugene; Hersh, William (Bill).

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5152 LNCS 2008. p. 472-491 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5152 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Müller, H, Deselaers, T, Deserno, TM, Kalpathy-Cramer, J, Kim, E & Hersh, WB 2008, Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5152 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5152 LNCS, pp. 472-491, 8th Workshop of the Cross-Language Evaluation Forum, CLEF 2007, Budapest, Hungary, 9/19/07. https://doi.org/10.1007/978-3-540-85760-0-59
Müller H, Deselaers T, Deserno TM, Kalpathy-Cramer J, Kim E, Hersh WB. Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5152 LNCS. 2008. p. 472-491. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-540-85760-0-59
Müller, Henning ; Deselaers, Thomas ; Deserno, Thomas M. ; Kalpathy-Cramer, Jayashree ; Kim, Eugene ; Hersh, William (Bill). / Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5152 LNCS 2008. pp. 472-491 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{0cb470a5b39f49c1a4200c5ca281c29d,
title = "Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks",
abstract = "This paper describes the medical image retrieval and medical image annotation tasks of ImageCLEF 2007. Separate sections describe each of the two tasks, with the participation and an evaluation of major findings from the results of each given. A total of 13 groups participated in the medical retrieval task and 10 in the medical annotation task. The medical retrieval task added two new data sets for a total of over 66'000 images. Topics were derived from a log file of the Pubmed biomedical literature search system, creating realistic information needs with a clear user model. The medical annotation task was in 2007 organized in a new format as a hierarchical classification had to be performed and classification could be stopped at any hierarchy level. This required algorithms to change significantly and to integrate a confidence level into their decisions to be able to judge where to stop classification to avoid making mistakes in the hierarchy. Scoring took into account errors and unclassified parts.",
author = "Henning M{\"u}ller and Thomas Deselaers and Deserno, {Thomas M.} and Jayashree Kalpathy-Cramer and Eugene Kim and Hersh, {William (Bill)}",
year = "2008",
doi = "10.1007/978-3-540-85760-0-59",
language = "English (US)",
isbn = "3540857591",
volume = "5152 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "472--491",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Overview of the ImageCLEFmed 2007 medical retrieval and medical annotation tasks

AU - Müller, Henning

AU - Deselaers, Thomas

AU - Deserno, Thomas M.

AU - Kalpathy-Cramer, Jayashree

AU - Kim, Eugene

AU - Hersh, William (Bill)

PY - 2008

Y1 - 2008

N2 - This paper describes the medical image retrieval and medical image annotation tasks of ImageCLEF 2007. Separate sections describe each of the two tasks, with the participation and an evaluation of major findings from the results of each given. A total of 13 groups participated in the medical retrieval task and 10 in the medical annotation task. The medical retrieval task added two new data sets for a total of over 66'000 images. Topics were derived from a log file of the Pubmed biomedical literature search system, creating realistic information needs with a clear user model. The medical annotation task was in 2007 organized in a new format as a hierarchical classification had to be performed and classification could be stopped at any hierarchy level. This required algorithms to change significantly and to integrate a confidence level into their decisions to be able to judge where to stop classification to avoid making mistakes in the hierarchy. Scoring took into account errors and unclassified parts.

AB - This paper describes the medical image retrieval and medical image annotation tasks of ImageCLEF 2007. Separate sections describe each of the two tasks, with the participation and an evaluation of major findings from the results of each given. A total of 13 groups participated in the medical retrieval task and 10 in the medical annotation task. The medical retrieval task added two new data sets for a total of over 66'000 images. Topics were derived from a log file of the Pubmed biomedical literature search system, creating realistic information needs with a clear user model. The medical annotation task was in 2007 organized in a new format as a hierarchical classification had to be performed and classification could be stopped at any hierarchy level. This required algorithms to change significantly and to integrate a confidence level into their decisions to be able to judge where to stop classification to avoid making mistakes in the hierarchy. Scoring took into account errors and unclassified parts.

UR - http://www.scopus.com/inward/record.url?scp=70349828890&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349828890&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-85760-0-59

DO - 10.1007/978-3-540-85760-0-59

M3 - Conference contribution

AN - SCOPUS:70349828890

SN - 3540857591

SN - 9783540857594

VL - 5152 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 472

EP - 491

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -