Evaluation of response quality for heterogeneous question answering systems
The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the chal...
Saved in:
Main Authors: | , , |
---|---|
Format: | Conference or Workshop Item |
Language: | English |
Published: |
IEEE
2005
|
Subjects: | |
Online Access: | http://eprints.utem.edu.my/id/eprint/12398/1/Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf http://eprints.utem.edu.my/id/eprint/12398/ http://researchrepository.murdoch.edu.au/14622/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.utem.eprints.12398 |
---|---|
record_format |
eprints |
spelling |
my.utem.eprints.123982015-05-28T04:24:43Z http://eprints.utem.edu.my/id/eprint/12398/ Evaluation of response quality for heterogeneous question answering systems Wong, W. Sahib, S. Goh, Ong Sing QA75 Electronic computers. Computer science The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems. IEEE 2005 Conference or Workshop Item PeerReviewed application/pdf en http://eprints.utem.edu.my/id/eprint/12398/1/Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf Wong, W. and Sahib, S. and Goh, Ong Sing (2005) Evaluation of response quality for heterogeneous question answering systems. In: The 2005 IEEE/WIC/ACM International Conference on Web Intelligence (WI'05), 19-22 Sept. 2005, France. http://researchrepository.murdoch.edu.au/14622/ |
institution |
Universiti Teknikal Malaysia Melaka |
building |
UTEM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Teknikal Malaysia Melaka |
content_source |
UTEM Institutional Repository |
url_provider |
http://eprints.utem.edu.my/ |
language |
English |
topic |
QA75 Electronic computers. Computer science |
spellingShingle |
QA75 Electronic computers. Computer science Wong, W. Sahib, S. Goh, Ong Sing Evaluation of response quality for heterogeneous question answering systems |
description |
The research in this paper makes explicit why existing measures for response quality evaluation is not suitable for the ever-evolving field of question answering and following that, a short-term solution for evaluating response quality of heterogeneous systems is put forward. To demonstrate the challenges in evaluating systems of different nature, this research presents a black-box approach using a classification scheme and scoring mechanism to assess and rank three example systems. |
format |
Conference or Workshop Item |
author |
Wong, W. Sahib, S. Goh, Ong Sing |
author_facet |
Wong, W. Sahib, S. Goh, Ong Sing |
author_sort |
Wong, W. |
title |
Evaluation of response quality for heterogeneous question answering systems |
title_short |
Evaluation of response quality for heterogeneous question answering systems |
title_full |
Evaluation of response quality for heterogeneous question answering systems |
title_fullStr |
Evaluation of response quality for heterogeneous question answering systems |
title_full_unstemmed |
Evaluation of response quality for heterogeneous question answering systems |
title_sort |
evaluation of response quality for heterogeneous question answering systems |
publisher |
IEEE |
publishDate |
2005 |
url |
http://eprints.utem.edu.my/id/eprint/12398/1/Evaluation_of_response_quality_for_heterogeneous_question_answering_systems_page_1-2.pdf http://eprints.utem.edu.my/id/eprint/12398/ http://researchrepository.murdoch.edu.au/14622/ |
_version_ |
1665905499419181056 |
score |
13.209306 |