My da|ra Login

Detailed view

metadata language: English

Evaluation measures for ontology matchers in supervised matching scenarios

Version
1
Resource Type
Dataset
Creator
  • Ritze, Dominique
  • Paulheim, Heiko
  • Eckert, Kai
Publication Date
2013-05-07
Description
  • Abstract

    Precision and Recall, as well as their combination in terms of FMeasure, are widely used measures in computer science and generally used to evaluate the overall performance of ontology matchers in fully automatic, unsupervised scenarios. In this paper, we investigate the case of supervised matching,where automatically created ontology alignments are verified by an expert. We motivate and describe this use case and its characteristics and discuss why traditional, F-measure based evaluation measures are not suitable to choose the best matching system for this task. Therefore, we investigate several alternative evaluation measures and propose the use of Precision@N curves as a means to assess different matching systems for supervised matching. We compare the ranking of ontology matchers from the last OAEI campaign using Precision@N curves to the traditional F-measure based ranking, and discuss means to combine matchers in a way that optimizes the user support in supervised ontology matching.

Data and File Information
  • Unit Type: Other
    Number of Units: 1
    • File Name: RScriptsData.zip
      File Format: application/zip
      File Size: 5715795
      Data Fingerprint: 1ddb32c19a6164481cd057ac445f47ce
      Method Fingerprint: MD5
    • File Name: src.zip
      File Format: application/zip
      File Size: 17869
      Data Fingerprint: 962afab5fc8807bccd016dc6e8ed0df6
      Method Fingerprint: MD5
    • File Name: Application.zip
      File Format: application/zip
      File Size: 12807718
      Data Fingerprint: ce5ec2765c153629e424983af562e405
      Method Fingerprint: MD5
    • File Name: README.txt
      File Format: text/plain
      File Size: 1759
      Data Fingerprint: bed2b10822467e2d0d682b20a618186d
      Method Fingerprint: MD5
Availability
Download

Update Metadata: 2018-03-02 | Issue Number: 8 | Registration Date: 2013-05-08

Ritze, Dominique; Paulheim, Heiko; Eckert, Kai (2013): Evaluation measures for ontology matchers in supervised matching scenarios. Version: 1. Universitätsbibliothek Mannheim. Dataset. https://doi.org/10.7801/23