Categorization of Malay documents using latent semantic indexing

Document categorization is a widely researched area of information retrieval. A popular approach to categorize documents is the Vector Space Model (VSM), which represents texts with feature vectors. The categorizing based on the VSM suffers from noise caused by synonymy and polysemy. Thus, an approa...

Full description

Saved in:
Bibliographic Details
Main Authors: Ab Samat, Nordianah, Azmi Murad, Masrah Azrifah, Atan, Rodziah, Abdullah, Muhamad Taufik
Format: Conference or Workshop Item
Language:English
Published: Universiti Utara Malaysia 2008
Online Access:http://psasir.upm.edu.my/id/eprint/59725/1/87-91-CR74.pdf
http://psasir.upm.edu.my/id/eprint/59725/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Document categorization is a widely researched area of information retrieval. A popular approach to categorize documents is the Vector Space Model (VSM), which represents texts with feature vectors. The categorizing based on the VSM suffers from noise caused by synonymy and polysemy. Thus, an approach for the clustering of Malay documents based on semantic relations between words is proposed in this paper. The method is based on the model first formulated in the context of information retrieval, called Latent Semantic Indexing (LSI). This model leads to a vector representation of each document using Singular Value Decomposition (SVD), where familiar clustering techniques can be applied in this space. LSI produced good document clustering by obtaining relevant subjects appearing in a cluster.