Extrapolation detection and novelty-based node insertion for sequential growing multi-experts network

Artificial neural networks (ANNs) have been used to construct empirical nonlinear models of process data. Because networks are not based on physical theory and contain nonlinearities, their predictions are suspect when extrapolating beyond the range of original training data. Standard networks give...

Full description

Saved in:
Bibliographic Details
Main Authors: Chu Kiong, L., Rajeswari, M., Rao, M.V.C.
Format: Article
Published: 2003
Subjects:
Online Access:http://eprints.um.edu.my/5161/
http://www.sciencedirect.com/science/article/pii/S1568494603000115
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Artificial neural networks (ANNs) have been used to construct empirical nonlinear models of process data. Because networks are not based on physical theory and contain nonlinearities, their predictions are suspect when extrapolating beyond the range of original training data. Standard networks give no indication of possible errors due to extrapolation. This paper describes a sequential supervised learning scheme for the recently formalized Growing multi-experts network (GMN). It is shown that certainty factor can be generated by GMN that can be taken as extrapolation detector for GMN. On-line GMN identification algorithm is presented and its performance is evaluated. The capability of the GMN to extrapolate is also indicated. Four benchmark experiments are dealt with to demonstrate the effectiveness and utility of GMN as a universal function approximator.