Building a malay-english code-switching subjectivity corpus for sentiment analysis

• Main Authors: Kasmuri, Emaliana, Basiron, Halizah
• Format: Article
• Language: English
• Published: International Center for Scientific Research and Studies 2019
• Online Access: http://eprints.utem.edu.my/id/eprint/24469/2/ARTICLE-IJASCA2019-BUILDING-A-MALAY-ENGLISH-CODE-SWITCHING-SUBJECTIVITY-CORPUS-FOR-SENTIMENT-ANALYSIS.PDF; http://eprints.utem.edu.my/id/eprint/24469/; http://home.ijasca.com/data/documents/8_page-112-130_Building-a-Malay-English-Code-Switching-Subjectivity-Corpus-for-Sentiment-Analysis.pdf

Combining of local and foreign language in single utterance has become a norm in multi-ethnic region. This phenomenon is known as code-switching. Code-switching has become a new challenge in sentiment analysis when the Internet users express their opinion in blogs, reviews and social network sites. The resources to process code-switching text in sentiment analysis is scarce especially annotated corpus. This paper develops a guideline to build a code-switching subjectivity corpus for a mix of Malay and English language known as MY-EN-CS. The guideline is suitable for any code-switching textual document. This paper built a new MY-EN-CS to demonstrate the guideline. The corpus consists of opinionated and factual sentences that are constructed from combination of words from these the languages. The sentences were retrieved from blogs and MY-EN-CS sentences are identified and annotated either as opinionated or factual. The annotated task yields 0.83 Kappa value rate that indicates the reliability of this corpus.