Proving the Efficacy of Complementary Inputs for Multilayer Neural Networks
Document Type
Conference Proceeding
Publication Date
7-31-2011
DOI
https://doi.org/10.1109/IJCNN.2011.6033480
Abstract
This paper proposes and discusses a backpropagation-based training approach for multilayer networks that counteracts the tendency that typical backpropagation-based training algorithms have to “favor” examples that have large input feature values. This problem can occur in any real valued input space, and can create a surprising degree of skew in the learned decision surface even with relatively simple training sets. The proposed method involves modifying the original input feature vectors in the training set by appending complementary inputs, which essentially doubles the number of inputs to the network. This paper proves that this modification does not increase the network complexity, by showing that it is possible to map the network with complimentary inputs back into the original feature space.
Publication Information
Andersen, T. L.. (2011). "Proving the Efficacy of Complementary Inputs for Multilayer Neural Networks". The 2011 International Joint Conference on Neural Networks (IJCNN), 2062-2066.