Recognition of Radar-Based Deaf Sign Language Using Convolution Neural Network

• Main Authors: Malik M.D.H.D., Mansor W., Rashid N.E.A., Rahman M.Z.U.
• Other Authors: 57204590565
• Format: Article
• Published: Penerbit UTHM 2024
• Subjects: classification; deep learning; gestures; Radar; Short-Time Fourier Transform (STFT)

The difficulties in the communication between the deaf and normal people through sign language can be overcome by implementing deep learning in the gestures signal recognition. The use of the Convolution Neural Network (CNN) in distinguishing radar-based gesture signals of deaf sign language has not been investigated. This paper describes the recognition of gestures of deaf sign language using radar and CNN. Six gestures of deaf sign language were acquired from normal subjects using a radar system and processed. Short-time Fourier Transform was performed to extract the gestures features and the classification was performed using CNN. The performance of CNN was examined using two types of inputs