Audio visual tracking of a speaker based on FFT and Kalman filter

In this paper a simple audio visual information based speaker tracking technique is proposed for indoor environment. Specifically, a Kalman filter based image processing technique is used to extract visual information, and Fast Fourier Transform (FFT) based approach is used to extract audio informat...

Full description

Saved in:
Bibliographic Details
Main Authors: Muzammel, M., Yusoff, M.Y., Saad, M.N.M., Malik, A.S.
Format: Article
Published: Asian Research Publishing Network 2016
Online Access:https://www.scopus.com/inward/record.uri?eid=2-s2.0-84979205098&partnerID=40&md5=96cfaf1dea309b9b5c1d19991c3747a4
http://eprints.utp.edu.my/25500/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper a simple audio visual information based speaker tracking technique is proposed for indoor environment. Specifically, a Kalman filter based image processing technique is used to extract visual information, and Fast Fourier Transform (FFT) based approach is used to extract audio information for speaker tracking. Finally, a decision tree has been used to estimate the location of the speaker based on audio and visual information. One of the main advantages of the proposed technique is the use of a built-in microphone of the tracking camera; which makes this technique cost effective and simple. We have examined our method with case studies from the online SPEVI database. The proposed technique shows the best detection and works properly even when the speaker is not visible. © 2006-2016 Asian Research Publishing Network (ARPN).