Visual Analytics Evaluation Process: Practice Guidelines For Complex Domain

Ya’acob, Suraya and Mohamad Ali, Nazlena and Mat Nayan, Norshita and Liang, Haining and Ahmad, Ibrahim and Ibrahim, Roslina and Abu Bakar, Nur Azaliah (2019) Visual Analytics Evaluation Process: Practice Guidelines For Complex Domain. Malaysian Journal of Computer Science, 2019 (1). pp. 118-134. ISSN 0127-9084

[img] Text
MJCS 2019 [IBRAHIM AHMAD].PDF

Download (520kB)

Abstract

Visual analytics fundamentally influences the analytical process. Without proper guidance, the use of visual analytics in complex domain can become an obstacle that hides the usefulness of analytical data. Since evaluation is the only way to identify the effectiveness of visual analytics to represent analytical outcomes, misconception of the evaluation process will bury the relevancy of visualization to support valuable decision. Recently, the nature domain of data has changed and we are now dealing with data that is massive, ambiguous, and dynamic, is often processed in real time. Hence, the data is more complex and cognitive activities that visual analytics facilitates are also getting more complex. Thus, this research revisits the way to evaluate visual analytics in complex cognitive conditions that are natural, uncertain and context dependent. Governed by the Design Science Research Methodology (DSRM), there are three phases involve during the evaluation process; i). demonstration, ii). evaluation and iii). communication. The design process is embedded with the human-activity centered design approach to gain better understanding on the visual analytics users and the complex cognitive activities involved. Thus, the research proposes Focus Group Observation method in conducting the evaluation in authentic setting. By offering a set of evaluation recommendations, this research aims to enhance visual analytics among users. It also recommends the evaluation criteria, sampling strategy and participation, focus group tasks and settings and data management and analysis that are suitable for complex domain in visual analytics.

Item Type: Article
Uncontrolled Keywords: Complex cognitive activities, Complex domain, Evaluation process, Human-activity centered design, Visual analytics
Divisions: Faculty of Information and Communication Technology
Depositing User: Sabariah Ismail
Date Deposited: 03 Dec 2020 16:11
Last Modified: 03 Dec 2020 16:11
URI: http://eprints.utem.edu.my/id/eprint/24460
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item