Language identifications of Arabic script web documents using independent component analysis

• Main Authors: Selamat, Ali, Lee, Zhi-Sam
• Format: Book Section
• Published: Institute of Electrical and Electronics Engineers 2008
• Subjects: QA75 Electronic computers. Computer science
• Online Access: http://eprints.utm.my/id/eprint/12612/; http://dx.doi.org/10.1109/AMS.2008.46

We analyze the language identification algorithms used to identify the Arabic script web documents such as Arabic, Jawi, Persian and Urdu using independent component analysis (ICA). We have used a combination of Entropy term weighting scheme and class based feature (CPBF) vectors as feature selectio...