Linköping University and the Swedish e-Science Research Centre, Sweden, e-mails: huanyu.li@liu.se, patrick.lambrix@liu.se"/> Gulbenkian Science Institute, Portugal, e-mail: dfaria@igc.gulbenkian.pt"/> RISE Research Institutes of Sweden, e-mail: valentina.ivanova@ri.se"/>
MAP  >  The Knowledge Engineering Review
2019 Volume 34
Article Contents
Next Previous
ORIGINAL RESEARCH   Open Access    

User validation in ontology alignment: functional assessment and impact

  • Linköping University and the Swedish e-Science Research Centre, Sweden, e-mails: huanyu.li@liu.se, patrick.lambrix@liu.se

  • Sectra, Linköping

  • Gulbenkian Science Institute, Portugal, e-mail: dfaria@igc.gulbenkian.pt

  • RISE Research Institutes of Sweden, e-mail: valentina.ivanova@ri.se

  • City

  • London

  • Department of Informatics

  • LaSIGE, Faculdade de Ciências

More Information
  • Abstract: User validation is one of the challenges facing the ontology alignment community, as there are limits to the quality of the alignments produced by automated alignment algorithms. In this paper, we present a broad study on user validation of ontology alignments that encompasses three distinct but inter-related aspects: the profile of the user, the services of the alignment system, and its user interface. We discuss key issues pertaining to the alignment validation process under each of these aspects and provide an overview of how current systems address them. Finally, we use experiments from the Interactive Matching track of the Ontology Alignment Evaluation Initiative 2015–2018 to assess the impact of errors in alignment validation, and how systems cope with them as function of their services.
  • 加载中
  • Abu Helou , M. & Palmonari , M. 2017. Multi-user feedback for large-scale cross-lingual ontology matching. In 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, 57–66.

    Google Scholar

    Aumüller , D., Do , H. H., Maßmann , S. & Rahm , E. 2005. Schema and ontology matching with COMA++. In ACM SIGMOD International Conference on Management of Data, 906–908.

    Google Scholar

    Aurisano , J., Nanavaty , A. & Cruz , I. F. 2015. Visual Analytics for Ontology Matching Using Multi-linked Views. In International Workshop on Visualizations and User Interfaces for Ontologies and Linked Data, CEUR 1456, 25–36.

    Google Scholar

    Beisswanger , E. & Hahn , U. 2012. Towards valid and reusable reference alignments-ten basic quality checks for ontology alignments and their application to three different reference data sets. Journal of Biomedical Semantics 3(S-1), S4:1–S4:14.

    Google Scholar

    Conroy , C., Brennan , R., O’Sullivan , D. & Lewis , D. 2009. User evaluation study of a tagging approach to semantic mapping. In The Semantic Web: Research and Applications – 6th European Semantic Web Conference, ESWC 2009, Heraklion, Crete, Greece, May 31–June 4, 2009, Proceedings, LNCS 5554, 623–637.

    Google Scholar

    Cruz , I. F., Antonelli , F. & Stroe , C. 2009. AgreementMaker: efficient matching for large real-world schemas and ontologies. Proceedings of the VLDB Endowment 2(2), 1586–1589.

    Google Scholar

    Cruz , I. F., Palmonari , M., Loprete , F., Stroe , C. & Taheri , A. 2016. Quality-based model for effective and robust multi-user pay-as-you-go ontology matching. Semantic Web 7(4), 463–479.

    Google Scholar

    Cruz , I. F., Stroe , C. & Palmonari , M. 2012. Interactive user feedback in ontology matching using signature vectors. In 28th IEEE International Conference on Data Engineering, 1321–1324.

    Google Scholar

    Cruz , I. F., Sunna , W., Makar , N. & Bathala , S. 2007. A visual tool for ontology alignment to enable geospatial interoperability. Journal of Visual Languages & Computing 18(3), 230–254.

    Google Scholar

    Curino , C., Orsi , G. & Tanca , L. 2007. X-SOM: A flexible ontology mapper. In 18th International Workshop on Database and Expert Systems Applications, 424–428.

    Google Scholar

    Dabrowski , J. & Munson , E. 2011. 40 years of searching for the best computer system response time. Interacting with Computers 23(5), 555–564.

    Google Scholar

    da Silva , J., Revoredo , K. & Baiao , F. 2018a. ALIN results for OAEI 2018. In 13th International Workshop on Ontology Matching, CEUR 2288, 117–124.

    Google Scholar

    da Silva , J., Revoredo , K., Baiao , F. & Euzenat , J. 2018b. Interactive ontology matching: using expert feedback to select attribute mappings. In 13th International Workshop on Ontology Matching, CEUR 2288, 25–36.

    Google Scholar

    Dhamankar , R., Lee , Y., Doan , A., Halevy , A. & Domingos , P. 2004. iMAP: discovering complex semantic matches between database schemas. In ACM SIGMOD International Conference on Management of Data, 383–394.

    Google Scholar

    Diallo , G. 2014. An effective method of large scale ontology matching. Journal of Biomedical Semantics 5, 44:1–44:19.

    Google Scholar

    Djeddi , W. E., Ben Yahia , S. & Khadir , M. T. 2018. XMap: Results for OAEI 2018. In 13th International Workshop on Ontology Matching, CEUR 2288, 210–215.

    Google Scholar

    Djeddi , W. E. & Khadir , M. T. 2014. A novel approach using context-based measure for matching large scale ontologies. In 16th International Conference on Data Warehousing and Knowledge Discovery, LNCS 8646, 320–331.

    Google Scholar

    Dragisic , Z., Ivanova , V., Lambrix , P., Faria , D., Jiménez-Ruiz , E. & Pesquita , C. 2016. User validation in ontology alignment, The Semantic Web – ISWC 2016 – 15th International Semantic Web Conference, Kobe, Japan, October 17–21, 2016, Proceedings, Part I, LNCS 9981, 200–217.

    Google Scholar

    Dragisic , Z., Ivanova , V., Li , H. & Lambrix , P. 2017. Experiences from the anatomy track in the ontology alignment evaluation initiative. Journal of Biomedical Semantics 8(1), 56:1–56:28.

    Google Scholar

    Duan , S., Fokoue , A. & Srinivas , K. 2010. One size does not fit all: Customizing ontology alignment using user feedback. In The Semantic Web – ISWC 2010 – 9th International Semantic Web Conference, ISWC 2010, Shanghai, China, November 7-11, 2010, Revised Selected Papers, Part I, LNCS 6496, 177–192.

    Google Scholar

    Dudas , M., Lohmann , S., Svatek , V. & Pavlov , D. 2018. Ontology visualization methods and tools: a survey of the state of the art. The Knowledge Engineering Review 33, e10:1–e10:39.

    Google Scholar

    Ehrig , M. & Sure , Y. 2005. Foam – framework for ontology alignment and mapping – results of the ontology alignment evaluation initiative. In Proceedings of the K-CAP 2005 Workshop on Integrating Ontologies, CEUR 156, 72–76.

    Google Scholar

    Euzenat , J., Meilicke , C., Shvaiko , P., Stuckenschmidt , H. & Trojahn , C. 2011. Ontology alignment evaluation initiative: six years of experience. Journal on Data Semantics XV, 158–192.

    Google Scholar

    Euzenat , J. & Shvaiko , P. 2013. User Involvement. Ontology Matching, 353–375.

    Google Scholar

    Euzenat , J. 2017. Interaction-based ontology alignment repair with expansion and relaxation. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI), 185–191.

    Google Scholar

    Falconer , S. & Noy , N. 2011. Interactive techniques to support ontology matching. Schema Matching and Mapping, 29–51.

    Google Scholar

    Falconer , S., Noy , N. & Storey , M.-A. 2006. Towards understanding the needs of cognitive support for ontology mapping. In First International Workshop on Ontology Matching, CEUR 225.

    Google Scholar

    Falconer , S., Noy , N. & Storey , M.-A. 2007. Ontology mapping – a user survey. In 2nd International Workshop on Ontology Matching, CEUR 304, 49–60.

    Google Scholar

    Falconer , S. & Storey , M.-A. 2007. A cognitive support framework for ontology mapping. In The Semantic Web. 6th International Semantic Web Conference – 2nd Asian Semantic Web Conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11–15, 2007. Proceedings, LNCS 4825, 114–127.

    Google Scholar

    Faria , D., Pesquita , C., Santos , E., Palmonari , M., Cruz , I. F. & Couto , F. M. 2013. The AgreementMakerLight ontology matching system. In OTM 2013 Conferences, LNCS 8185, 527–541.

    Google Scholar

    Faria , D., Martins , C., Nanavaty , A., Oliveira , D., Sowkarthiga , B., Taheri , A., Pesquita , C., Couto , F. M. & Cruz , I. F. 2015. AML results for OAEI 2015. In 10th International Workshop on Ontology Matching, CEUR 1545, 116–123.

    Google Scholar

    Fu , B., Noy , N. & Storey , M.-A. 2017. Eye tracking the user experience – an evaluation of ontology visualization techniques. Semantic Web 8(1), 23–41.

    Google Scholar

    Gennari , J. H., Musen , M. A., Fergerson , R. W., Grosso , W. E., Crubézy , M., Eriksson , H., Noy , N. & Tu , S. W. 2003. The evolution of Protégé: an environment for knowledge-based systems development. International Journal on Human-Computer Studies 58(1), 89–123.

    Google Scholar

    Granitzer , M., Sabol , V., Onn , K. W., Luckose , D. & Tochtermann , K. 2010. Ontology alignment – a survey with focus on visually supported semi-automatic techniques. Future Internet 2(3), 238–258.

    Google Scholar

    Guedes , A., Baiao , F. A. & Revoredo , K. 2014. On the identification and representation of ontology correspondence antipatterns. In 8th International Workshop on Modular Ontologies, CEUR 1248.

    Google Scholar

    Hamdi , F., Safar , B., Niraula , N. & Reynaud , C. 2009. TaxoMap in the OAEI 2009 alignment contest. In 4th International Workshop on Ontology Matching, CEUR 551, 230–237.

    Google Scholar

    Hamdi , F., Reynaud , C. & Safar , B. 2010. Pattern-based mapping refinement. In 17th International Conference on Knowledge Engineering and Management, LNCS 6317, 1–15.

    Google Scholar

    Harrow , I., Balakrishnan , R., Jimenez-Ruiz , E., Jupp , S., Lomax , J., Reed , J., Romacker , M., Senger , C., Splendiani ,A., Wilson , J. & Woollard , P. 2019. Ontology mapping for semantically enabled applications. Drug Discovery Today.

    Google Scholar

    Hu , W. & Qu , Y. 2008. Falcon-AO: A practical ontology matching system. Journal of Web Semantics 6(3), 237–239.

    Google Scholar

    Hu , W., Qu , Y. & Cheng , G. 2008. Matching large ontologies: a divide-and-conquer approach. Data & Knowledge Engineering 67, 140–160.

    Google Scholar

    Ivanova , V., Bach , B., Pietriga , E. & Lambrix , P. 2017. Alignment cubes: towards interactive visual exploration and evaluation of multiple ontology alignments. The Semantic Web – ISWC 2017 – 16th International Semantic Web Conference, Vienna, Austria, October 21–25, 2017, Proceedings, Part I, LNCS 10587, 400–417.

    Google Scholar

    Ivanova , V., Bergman , J. L., Hammerling , U. & Lambrix , P. 2012. Debugging taxonomies and their alignments: the ToxOntology-MeSH use case. In First International Workshop on Debugging Ontologies and Ontology Mappings, 25–36.

    Google Scholar

    Ivanova , V. & Lambrix , P. 2013. A unified approach for aligning taxonomies and debugging taxonomies and their alignments. In The Semantic Web: Semantics and Big Data – 10th International Conference, ESWC 2013, Montpellier, France, May 26-30, 2013. Proceedings, LNCS 7882, 1–15.

    Google Scholar

    Ivanova , V., Lambrix , P. & Åberg , J. 2015. Requirements for and evaluation of user support for large-scale ontology alignment. In The Semantic Web. Latest Advances and New Domains – 12th European Semantic Web Conference, ESWC 2015, Portoroz, Slovenia, May 31–June 4, 2015. Proceedings, LNCS 9088, 3–20.

    Google Scholar

    Ivanova , V., Lambrix , P., Lohmann , S. & Pesquita , C. 2019. Visualization and interaction for ontologies and linked data – editorial. Journal of Web Semantics 55, 145–149.

    Google Scholar

    Jean-Mary , Y. R., Shironoshita , E. P. & Kabuka , M. R. 2009. Ontology matching with semantic verification. Journal of Web Semantics 7(3), 235–251.

    Google Scholar

    Jiménez-Ruiz , E., Cuenca Grau , B., Horrocks , I. & Berlanga , R. 2009. Ontology integration using mappings: towards getting the right logical consequences. The Semantic Web: Research and Applications. ESWC 2009, LNCS 5554, 173–187.

    Google Scholar

    Jiménez-Ruiz , E., Cuenca Grau , B., Horrocks , I. & Berlanga , R. 2011. Logic-based assessment of the compatibility of UMLS ontology sources. Journal of Biomedical Semantics 2(S-1), S2:1–S2:16.

    Google Scholar

    Jiménez-Ruiz , E. & Cuenca Grau , B. 2011. LogMap: Logic-based and scalable ontology matching. The Semantic Web – ISWC 2011 - 10th International Semantic Web Conference. LNCS 7031 pp 273–288.

    Google Scholar

    Jiménez-Ruiz , E., Cuenca Grau , B., Zhou , Y. & Horrocks , I. 2012. Large-scale interactive ontology matching: algorithms and implementation. In 20th European Conference on Artificial Intelligence (ECAI), 444–449.

    Google Scholar

    Jiménez-Ruiz , E., Payne , T. R., Solimando , A. & Tamma , V. 2016. Limiting logical violations in ontology alignnment through negotiation. In Principles of Knowledge Representation and Reasoning (KR), 217–226.

    Google Scholar

    Jiménez-Ruiz , E., Agibetov , A., Samwald , M. & Cross , V. 2018. Breaking-down the ontology alignment task with a lexical index and neural Embeddings. arXiv1805.12402.

    Google Scholar

    Jirkovský , V. & Ichise , R. 2013. MAPSOM: user involvement in ontology matching. In Semantic Technology. Third Joint International Conference, JIST 2013, Seoul, South Korea, November 28–30, 2013, Revised Selected Papers, LNCS 8388, 348–363.

    Google Scholar

    Kachroudi , M., Diallo , G. & Ben Yahia , S. 2017. OAEI 2017 results of KEPLER. In 12th International Workshop on Ontology Matching, CEUR 2032, 138–145.

    Google Scholar

    Katifori , A., Halatsis , C., Lepouras , G., Vassilakis , C. & Giannopoulou , E. G. 2007. Ontology visualization methods – a survey. ACM Computing Surveys 39(4), 10:1–10:43.

    Google Scholar

    Kensche , D., Quix , C., Li , X. & Li , Y. 2007. Geromesuite: A system for holistic generic model management. In 33rd International Conference on Very Large Data Bases, 1322–1325.

    Google Scholar

    Kheder , N. & Diallo , G. 2015. ServOMBI at OAEI 2015. In 10th International Workshop on Ontology Matching, CEUR 1545, 200–207.

    Google Scholar

    Kirsten , T., Groß , A., Hartung , M. & Rahm , E. 2011. GOMMA: a component-based infrastructure for managing and analyzing life science ontologies and their evolution. Journal of Biomedical Semantics 2, 6:1–6:24.

    Google Scholar

    Laadhar , A., Ghozzi , F., Megdiche , I., Ravat , F., Teste , O. & Gargouri , F. 2018. OAEI 2018 results of POMap++. In 13th International Workshop on Ontology Matching, CEUR 2288, 192–196.

    Google Scholar

    Laera , L., Tamma , V., Euzenat , J., Bench-Capon , T. & Payne , T. 2006. Reaching Agreement over Ontology Alignments. In The Semantic Web - ISWC 2006, 5th International Semantic Web Conference, ISWC 2006, Athens, GA, USA, November 5–9, 2006, Proceedings, LNCS 4273, 371–384.

    Google Scholar

    Laera , L., Blacoe , I., Tamma , V., Payne , T., Euzenat , J. & Bench-Capon , T. 2007. Argumentation over Ontology Correspondences in MAS. In 6th International Joint Conference on Autonomous Agents and Multiagent Systems, 228:1–228:8.

    Google Scholar

    Lambrix , P., Dragisic , Z. & Ivanova , V. 2012. Get my pizza right: Repairing missing is-a relations in ALC ontologies. Semantic Technology. Second Joint International Conference, JIST 2012, Nara, Japan, December 2–4, 2012. Proceedings, LNCS 7774, 17–32.

    Google Scholar

    Lambrix , P. & Edberg , A. 2003. Evaluation of ontology merging tools in bioinformatics. In Pacific Symposium on Biocomputing, 589–600.

    Google Scholar

    Lambrix , P. & Kaliyaperumal , R. 2017. A session-based ontology alignment approach enabling user involvement. Semantic Web 8(2), 225–251.

    Google Scholar

    Lambrix , P. & Liu , Q. 2009. Using partial reference alignments to align ontologies. In The Semantic Web: Research and Applications, 6th European Semantic Web Conference, ESWC 2009, Heraklion, Crete, Greece, May 31–June 4, 2009, Proceedings, LNCS 5554, 188–202.

    Google Scholar

    Lambrix , P. & Tan , H. 2006. SAMBO - a system for aligning and merging biomedical ontologies. Journal of Web Semantics 4(3), 196–206

    Google Scholar

    Lambrix , P. & Tan , H. 2007. A tool for evaluating ontology alignment strategies. Journal Data Semantics VIII, 182–202.

    Google Scholar

    Lanzenberger , M., Sampson , J. & Rester , M. 2010. Ontology visualization: tools and techniques for visual representation of semi-structured meta-data. Journal of Universal Computer Science 16(7), 1036–1054.

    Google Scholar

    Lanzenberger , M., Sampson , J., Rester , M., Naudet , Y. & Latour , T. 2008. Visual ontology alignment for knowledge sharing and reuse. Journal of Knowledge Management 12(6), 102–120.

    Google Scholar

    Li , J., Tang , J., Li , Y. & Luo , Q. 2009. Rimom: A dynamic multistrategy ontology alignment framework. IEEE Transactions on Knowledge and Data Engineering 21(8), 1218–1232.

    Google Scholar

    Li , Y., Stroe , C. & Cruz , I. F. 2015. Interactive visualization of large ontology matching results. In International Workshop on Visualizations and User Interfaces for Ontologies and Linked Data, CEUR 1456, 37–48.

    Google Scholar

    Massmann , S., Raunich , S., Aumüller , D., Arnold , P. & Rahm , E. 2011. Evolution of the COMA match system. In 6th International Workshop on Ontology Matching, CEUR 814, 49–60.

    Google Scholar

    McCann , R., Shen , W. & Doan , A. 2008. Matching schemas in online communities: a web 2.0 approach. In 2008 IEEE 24th International Conference on Data Engineering, 110–119.

    Google Scholar

    Meilicke , C., Stuckenschmidt , H. & Tamilin , A. 2008. Supporting manual mapping revision using logical reasoning. In 23rd AAAI Conference on Artificial Intelligence, 1213–1218.

    Google Scholar

    Melnik , S., Garcia-Molina , H., & Rahm , E. 2002. Similarity flooding: a versatile graph matching algorithm and its application to schema matching. In Proceedings 18th IEEE International Conference on Data Engineering, 117–128.

    Google Scholar

    Nagy , M., Vargas-Vera , M. & Stolarski , P. 2009. DSSim results for OAEI 2009. In 4th International Workshop on Ontology Matching, CEUR 551, 160–169.

    Google Scholar

    Ngo , D. & Bellahsene , Z. 2016. Overview of YAM++ - (not) Yet Another Matcher for ontology alignment task. Journal of Web Semantics 41, 30–49.

    Google Scholar

    Nielsen , J. 1993. Usability Engineering, Morgan Kaufmann.

    Google Scholar

    Noy , N. F., Mortensen , J., Alexander , P. & Musen , M. 2013. Mechanical Turk as an ontology engineer? ACM Web Science, 262–271.

    Google Scholar

    Noy , N. & Musen , M. 2000. Algorithm & tool for automated ontology merging and alignment. In 17th AAAI Conference on Artificial Intelligence, 450–455.

    Google Scholar

    Otero-Cerdeira , L., Rodríguez-Martínez , F. J. & Gómez-Rodríguez , A. 2015. Ontology matching: a literature review. Expert Systems with Applications 42(2), 949–971.

    Google Scholar

    Patterson , R. E., Blaha , L. M., Grinstein , G. G., Liggett , K. K., Kaveney , D. E., Sheldon , K. C., Havig , P. R. & Moore , J. A. 2014. A human cognition framework for information visualization. Computers & Graphics 42, 42–58.

    Google Scholar

    Paulheim , H., Hertling , S. & Ritze , D. 2013. Towards evaluating interactive ontology matching tools. In The Semantic Web: Semantics and Big Data, 10th International Conference, ESWC 2013, Montpellier, France, May 26–30, 2013. Proceedings, LNCS 7882, 31–45.

    Google Scholar

    Pesquita , C., Ivanova , V., Lohmann , S. & Lambrix , P. 2018. A framework to conduct and report on empirical user studies in semantic web contexts. In Knowledge Engineering and Knowledge Management. 21st International Conference, EKAW 2018, Nancy, France, November 12–16, 2018, Proceedings, LNCS 11313, 567–583.

    Google Scholar

    Pesquita , C., Faria , D., Santos , E., Neefs , J. & Couto , F. M. 2014. Towards visualizing the alignment of large biomedical ontologies. In Data Integration in the Life Sciences. 10th International Conference, DILS 2014, Lisbon, Portugal, July 17–18, 2014. Proceedings, LNBI 8574, 104–111.

    Google Scholar

    Quix , C., Geisler , S., Kensche , D. & Li , X. 2008. Results of GeRoMeSuite for OAEI 2008. 3rd International Workshop on Ontology Matching, CEUR 431, 160–166.

    Google Scholar

    Reul , Q. & Pan , J. Z. 2010. KOSIMap: Use of description logic reasoning to align heterogeneous ontologies. In 23rd International Workshop on Description Logics, CEUR 573, 497–508.

    Google Scholar

    Ritze , D. & Paulheim , H. 2011. Towards an automatic parameterization of ontology matching tools based on example mappings. In 6th International Workshop on Ontology Matching, CEUR 814, 37–48.

    Google Scholar

    Sarasua , C., Simperl , E. & Noy , N. F. 2012. Crowdmap: Crowdsourcing ontology alignment with microtasks. The Semantic Web – ISWC 2012 – 11th International Semantic Web Conference, Boston, MA, USA, November 11–15, 2012, Proceedings, Part I, LNCS 7649, 525–541.

    Google Scholar

    Schwichtenberg , S. & Engels , G. 2015. RSDL workbench results for OAEI 2015. In 10th International Workshop on Ontology Matching, CEUR 1545, 192–199.

    Google Scholar

    Shneiderman , B. 1996. The eyes have it: a task by data type taxonomy for information visualizations. IEEE Symposium on Visual Languages, 336–343.

    Google Scholar

    Shi , F., Li , J., Tang , J., Xie , G. & Li , H. 2009. Actively Learning Ontology Matching via User Interaction. In The Semantic Web - ISWC 2009, 8th International Semantic Web Conference, ISWC 2009, Chantilly, VA, USA, October 25–29, 2009. Proceedings, LNCS 5823, 585–600.

    Google Scholar

    Shvaiko , P. & Euzenat , J. 2013. Ontology matching: state of the art and future challenges. In Knowledge and Data Engineering 25(1), 158–176.

    Google Scholar

    Shvaiko , P., Giunchiglia , F., Da Silva , P. & McGuinness , D. 2005. Web explanations for semantic heterogeneity discovery. In The Semantic Web: Research and Applications, Second European Semantic Web Conference, ESWC 2005, Heraklion, Crete, Greece, May 29–June 1, 2005, Proceedings, LNCS 3532, 303–317.

    Google Scholar

    Smith , E. & Kosslyn , S. 2013. Cognitive Psychology: Mind and Brain, Pearson.

    Google Scholar

    Solimando , A., Jiménez-Ruiz , E. & Guerrini , G. 2017. Minimizing conservativity violations in ontology alignments: algorithms and evaluation. Knowledge and Information Systems 51(3), 775–819.

    Google Scholar

    Tan , H. & Lambrix , P. 2007. A method for recommending ontology alignment strategies. The Semantic Web. 6th International Semantic Web Conference, 2nd Asian Semantic Web Conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11–15, 2007. Proceedings, LNCS 4825, 494–507.

    Google Scholar

    Wang , P. & Xu , B. 2008. Debugging ontology mappings: a static approach. Computing and Informatics 27(1), 21–36.

    Google Scholar

    Wang , P. & Xu , B. 2009. An effective similarity propagation method for matching ontologies without sufficient or regular linguistic information. In The Semantic Web. Fourth Asian Conference, ASWC 2009, Shanghai, China, December 6–9, 2009. Proceedings, LNCS 5926, 105–119.

    Google Scholar

    Wang , P., Zhou , Y. & Xu , B. 2011. Matching large ontologies based on reduction anchors. 22nd International Joint Conference on Artificial Intelligence, 2343–2348.

    Google Scholar

    Wei-Kleiner , F., Dragisic , Z. & Lambrix , P. 2014. Abduction framework for repairing incomplete ELontologies: complexity results and algorithms. In 28th AAAI Conference on Artificial Intelligence, 1120–1127.

    Google Scholar

  • Cite this article

    Huanyu Li, Zlatan Dragisic, Daniel Faria, Valentina Ivanova, Ernesto Jiménez-Ruiz, Patrick Lambrix, Catia Pesquita. 2019. User validation in ontology alignment: functional assessment and impact. The Knowledge Engineering Review. 34: doi: 10.1017/S0269888919000080
    Huanyu Li, Zlatan Dragisic, Daniel Faria, Valentina Ivanova, Ernesto Jiménez-Ruiz, Patrick Lambrix, Catia Pesquita. 2019. User validation in ontology alignment: functional assessment and impact. The Knowledge Engineering Review. 34: doi: 10.1017/S0269888919000080
    shu
Download PDF

Article Metrics

Article views(16) PDF downloads(487)

Other Articles By Authors

ORIGINAL RESEARCH   Open Access    

User validation in ontology alignment: functional assessment and impact

  • Linköping University and the Swedish e-Science Research Centre, Sweden, e-mails: huanyu.li@liu.se, patrick.lambrix@liu.se

  • Sectra, Linköping

  • Gulbenkian Science Institute, Portugal, e-mail: dfaria@igc.gulbenkian.pt

  • RISE Research Institutes of Sweden, e-mail: valentina.ivanova@ri.se

  • City

  • London

  • Department of Informatics

  • LaSIGE, Faculdade de Ciências

  • Received: 21 December 2018
  • Revised: 01 August 2019
  • Accepted: 24 August 2019
The Knowledge Engineering Review  34,  Article number: e15  (2019)  |  Cite this article

Abstract: Abstract: User validation is one of the challenges facing the ontology alignment community, as there are limits to the quality of the alignments produced by automated alignment algorithms. In this paper, we present a broad study on user validation of ontology alignments that encompasses three distinct but inter-related aspects: the profile of the user, the services of the alignment system, and its user interface. We discuss key issues pertaining to the alignment validation process under each of these aspects and provide an overview of how current systems address them. Finally, we use experiments from the Interactive Matching track of the Ontology Alignment Evaluation Initiative 2015–2018 to assess the impact of errors in alignment validation, and how systems cope with them as function of their services.

    HTML

    Acknowledgments

    • This work has been financially supported by the Fundação para a Ciência e Tecnologia through the funding of the LaSIGE research unit (ref.UID/CEC/00408/2013) and project PTDC/EEI-ESS/4633/2014, the Swedish e-Science Research Centre (SeRC), the Swedish Research Council (Vetenskapsrådet, dnr 2018-04147), the Swedish National Graduate School in Computer Science (CUGS), the AIDA project (UK Government’s Defence & Security Programme in support of the Alan Turing Institute), The Alan Turing Institute under the EPSRC grant EP/N510129/1, the SIRIUS Centre for Scalable Data Access (Research Council of Norway, project 237889), the BIGMED project (IKT 259055), the ELIXIR-EXCELERATE project (INFRADEV-3-2015), and EUs Horizon 2020 research and innovation program (grant no.786993).

    • This is an extended version of Dragisic et al. (2016). We have extended the literature review taking into account all systems participating in the Ontology Alignment Evaluation Initiative 2007–2018, added a detailed account of the qualitative evaluation and added three more years of results for the experiments.

    • Note: The sub-sections are organized by Domain, with instances of Scope highlighted in bold in the text and instances of Category italicized.

    • http://sws.ifi.uio.no/oaei/interactive/survey/

    • Other versions of RepOSE deal with slightly more expressive ontologies, but focus more on the debugging phase, for example, Lambrix et al. (2012), Wei-Kleiner et al. (2014).

    • http://www.seals-project.eu

    • http://www.informatics.jax.org/expression.shtml

    • https://ncit.nci.nih.gov/ncitbrowser/

    • http://sig.biostr.washington.edu/projects/fm/AboutFM.html

    • https://sourceforge.net/projects/jarvis-om/

    • http://sws.ifi.uio.no/oaei/interactive/

    Rights and permissions
    • This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
References (101)
  • About this article
    Cite this article
    Huanyu Li, Zlatan Dragisic, Daniel Faria, Valentina Ivanova, Ernesto Jiménez-Ruiz, Patrick Lambrix, Catia Pesquita. 2019. User validation in ontology alignment: functional assessment and impact. The Knowledge Engineering Review. 34: doi: 10.1017/S0269888919000080
    Huanyu Li, Zlatan Dragisic, Daniel Faria, Valentina Ivanova, Ernesto Jiménez-Ruiz, Patrick Lambrix, Catia Pesquita. 2019. User validation in ontology alignment: functional assessment and impact. The Knowledge Engineering Review. 34: doi: 10.1017/S0269888919000080
    shu

    • Catalog

      Return