Evaluation of response quality for heterogeneous question answering systems

Wong, W. and Sahib, S. and Goh, Ong Sing (2005) Evaluation of response quality for heterogeneous question answering systems. In: The 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05), 19-22 Sept. 2005, France.

Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf - Submitted Version

Download (60kB)


The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems.

Item Type: Conference or Workshop Item (Paper)
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Information and Communication Technology > Department of Industrial Computing
Depositing User: Assoc. Prof. Dr. Ong Sing Goh
Date Deposited: 05 Nov 2014 11:23
Last Modified: 28 May 2015 04:24
URI: http://eprints.utem.edu.my/id/eprint/12398
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item