W05-03: Modulated Evaluation Metrics for Drug-Based Ontologies

TitleW05-03: Modulated Evaluation Metrics for Drug-Based Ontologies
Publication TypeConference Paper
Year of Publication2016
AuthorsAmith M, Tao C
Conference NameInternational Conference on Biomedical Ontology and BioCreative (ICBO BioCreative 2016)
Date Published11/30/16
PublisherCEUR-ws.org Volume 1747
Other NumbersVol-1747|urn:nbn:de:0074-1747-1

Our review of randomly selected biomedical ontologies from the National Center for Biomedical Ontology Bioportal showed that majority of the ontologies hosted did not have any documented evidence of formal ontology evaluation. The review points to the need to address this gap, if the ontology research community were to continually produce and maintain high-quality datasets for a wide-range of applications and research endeavors. As a result, this research presents a method to accurately evaluate specific domain ontologies using a semiotic framework that is delineated by the following parts – syntactic, semantic, pragmatic, and social. Thusly, we propose the following, 1) whether a semiotic-based approach for ontology evaluation can provide meaningful assessment for biomedical ontologies and 2) if this approach can provide a more accurate assessment of the overall quality of an ontology. We applied this evaluation framework on drug-based ontologies and tailored the metric suite based on features of the drug ontologies. The results of our effort produced a customized metric for drug based ontologies, and also revelations specific to drug ontologies that may offer prescriptions for improvement – better selection, consistency, and expressiveness of terms and labels. While ontology evaluation may be a neglected sub-field in ontology research, this study can offer a feasible direction for further research for biomedical ontologies.