Van Schalkwyk, AGrobbelaar, SVermeulen, EHerselman, Martha E2023-03-242023-03-242022-06Van Schalkwyk, A., Grobbelaar, S., Vermeulen, E. & Herselman, M.E. 2022. Contributing to monitoring and evaluation practices by conceptualizing a Valuable Insights from Log Analysis (VILA) Framework. http://hdl.handle.net/10204/12699 .978-1-6654-8816-7DOI: 10.1109/ICE/ITMC-IAMOT55089.2022.10033267http://hdl.handle.net/10204/12699Log analyses are proposed in response to the evidence base required for log-generating Apps. This article presents the VILA (Valuable Insights from Log Analysis) Framework, a conceptual framework that structures how valuable insights can be generated from log analysis to support Monitoring and Evaluation (M&E) practices. The design, development, and evaluation process is centered in the pragmatic research paradigm and follows the Design Science Research (DSR) methodology. Existing literature was reviewed to formulate building blocks and design requirements for the VILA Framework. The VILA Framework was evaluated and applied through expert reviews and an industry case study. Relevance cycles assessed and refined the VILA Framework. This article presents the main concepts, categories, and sub-concepts to derive valuable insights towards potential improvements of log-generating Apps. The VILA Framework focused on the quantitative log data concepts; however, it acknowledges the essential qualitative concepts needed to derive value from the log data. Despite its limitations, the VILA Framework provides a starting point for researchers to structure and implement log analyses beyond descriptive statistics towards increased or improved M&E practices.AbstractenConceptual frameworkDesign Science ResearchLog analysisMonitoring and evaluationVILA FrameworkConference PresentationVan Schalkwyk, A., Grobbelaar, S., Vermeulen, E., & Herselman, M. E. (2022). Contributing to monitoring and evaluation practices by conceptualizing a Valuable Insights from Log Analysis (VILA) Framework. http://hdl.handle.net/10204/12699Van Schalkwyk, A, S Grobbelaar, E Vermeulen, and Martha E Herselman. "Contributing to monitoring and evaluation practices by conceptualizing a Valuable Insights from Log Analysis (VILA) Framework." <i>IEEE 28th ICE/ITMC & 31st IAMOT Joint Conference in Nancy, France, 19-23 June 2022</i> (2022): http://hdl.handle.net/10204/12699Van Schalkwyk A, Grobbelaar S, Vermeulen E, Herselman ME, Contributing to monitoring and evaluation practices by conceptualizing a Valuable Insights from Log Analysis (VILA) Framework; 2022. http://hdl.handle.net/10204/12699 .TY - Conference Presentation AU - Van Schalkwyk, A AU - Grobbelaar, S AU - Vermeulen, E AU - Herselman, Martha E AB - Log analyses are proposed in response to the evidence base required for log-generating Apps. This article presents the VILA (Valuable Insights from Log Analysis) Framework, a conceptual framework that structures how valuable insights can be generated from log analysis to support Monitoring and Evaluation (M&E) practices. The design, development, and evaluation process is centered in the pragmatic research paradigm and follows the Design Science Research (DSR) methodology. Existing literature was reviewed to formulate building blocks and design requirements for the VILA Framework. The VILA Framework was evaluated and applied through expert reviews and an industry case study. Relevance cycles assessed and refined the VILA Framework. This article presents the main concepts, categories, and sub-concepts to derive valuable insights towards potential improvements of log-generating Apps. The VILA Framework focused on the quantitative log data concepts; however, it acknowledges the essential qualitative concepts needed to derive value from the log data. Despite its limitations, the VILA Framework provides a starting point for researchers to structure and implement log analyses beyond descriptive statistics towards increased or improved M&E practices. DA - 2022-06 DB - ResearchSpace DP - CSIR J1 - IEEE 28th ICE/ITMC & 31st IAMOT Joint Conference in Nancy, France, 19-23 June 2022 KW - Conceptual framework KW - Design Science Research KW - Log analysis KW - Monitoring and evaluation KW - VILA Framework LK - https://researchspace.csir.co.za PY - 2022 SM - 978-1-6654-8816-7 T1 - Contributing to monitoring and evaluation practices by conceptualizing a Valuable Insights from Log Analysis (VILA) Framework TI - Contributing to monitoring and evaluation practices by conceptualizing a Valuable Insights from Log Analysis (VILA) Framework UR - http://hdl.handle.net/10204/12699 ER -26001