De Villiers, Johan PFocke, Richard WPavlin, GJousselme, A-LDragos, VLaskey, KBCosta, PCBlasch, E2018-05-112018-05-112017-08De Villiers, J.P. et al. 2017. Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria. 20th International Conference on Information Fusion, Xi'an, China, 10-13 July 2017978-1-5090-4582-2978-0-9964-5270-0DOI: 10.23919/ICIF.2017.8009879http://ieeexplore.ieee.org/document/8009879/http://hdl.handle.net/10204/10186Copyright: 2017 IEEE. Due to copyright restrictions, the attached PDF file only contains the abstract of the full text item. For access to the full text item, please consult the publisher's website.The International Society of Information Fusion (ISIF) Evaluation Techniques for Uncertainty Representation Working Group (ETURWG) investigates the quantification and evaluation of all types of uncertainty regarding the inputs, reasoning and outputs of the information fusion process. The ETURWG is developing an Uncertainty Representation and Reasoning Framework (URREF) ontology for this purpose. This paper outlines a start towards the process of defining metrics for the URREF data criteria, which will align the URREF ontology with practical application. A criterion can be evaluated according to several metrics, and a metric can be applied to several criteria. As such, the ontology would have to reflect the nature of a many-to-many mapping between criteria and metrics. The main findings and suggestions of the paper advancing the use of URREF are: 1) The Weight of Information (WoI) is dependent on data criteria, which in turn depend on source criteria. 2) Criteria and metrics that apply to evidence (typically an input of the fusion system), could equally apply to the fusion system outputs or internal information, which in turn could form the inputs of another system. As such the word “Evidence” in the terms “Piece of Evidence” and “Weight of Evidence” should be replaced by the word “Information”. 3) Accuracy and precision and associated metrics are ubiquitous in the URREF ontology and can evaluate many parts of the fusion system. 4) The weight of information also assumes an important position in the ontology, as it depends on several source and data criteria.enOntologyUncertainty Representation and Reasoning FrameworkURREFConference PresentationDe Villiers, J. P., Focke, R. W., Pavlin, G., Jousselme, A., Dragos, V., Laskey, K., ... Blasch, E. (2017). Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria. IEEE. http://hdl.handle.net/10204/10186De Villiers, Johan P, Richard W Focke, G Pavlin, A-L Jousselme, V Dragos, KB Laskey, PC Costa, and E Blasch. "Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria." (2017): http://hdl.handle.net/10204/10186De Villiers JP, Focke RW, Pavlin G, Jousselme A, Dragos V, Laskey K, et al, Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria; IEEE; 2017. http://hdl.handle.net/10204/10186 .TY - Conference Presentation AU - De Villiers, Johan P AU - Focke, Richard W AU - Pavlin, G AU - Jousselme, A-L AU - Dragos, V AU - Laskey, KB AU - Costa, PC AU - Blasch, E AB - The International Society of Information Fusion (ISIF) Evaluation Techniques for Uncertainty Representation Working Group (ETURWG) investigates the quantification and evaluation of all types of uncertainty regarding the inputs, reasoning and outputs of the information fusion process. The ETURWG is developing an Uncertainty Representation and Reasoning Framework (URREF) ontology for this purpose. This paper outlines a start towards the process of defining metrics for the URREF data criteria, which will align the URREF ontology with practical application. A criterion can be evaluated according to several metrics, and a metric can be applied to several criteria. As such, the ontology would have to reflect the nature of a many-to-many mapping between criteria and metrics. The main findings and suggestions of the paper advancing the use of URREF are: 1) The Weight of Information (WoI) is dependent on data criteria, which in turn depend on source criteria. 2) Criteria and metrics that apply to evidence (typically an input of the fusion system), could equally apply to the fusion system outputs or internal information, which in turn could form the inputs of another system. As such the word “Evidence” in the terms “Piece of Evidence” and “Weight of Evidence” should be replaced by the word “Information”. 3) Accuracy and precision and associated metrics are ubiquitous in the URREF ontology and can evaluate many parts of the fusion system. 4) The weight of information also assumes an important position in the ontology, as it depends on several source and data criteria. DA - 2017-08 DB - ResearchSpace DP - CSIR KW - Ontology KW - Uncertainty Representation and Reasoning Framework KW - URREF LK - https://researchspace.csir.co.za PY - 2017 SM - 978-1-5090-4582-2 SM - 978-0-9964-5270-0 T1 - Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria TI - Evaluation metrics for the practical application of URREF ontology: An illustration on data criteria UR - http://hdl.handle.net/10204/10186 ER -