Research Article
Sensitivity based selection of inputs and delays for NARX models
@ARTICLE{10.4108/eai.3-12-2015.2262480, author={Martin Macas and Fabio Moretti}, title={Sensitivity based selection of inputs and delays for NARX models}, journal={EAI Endorsed Transactions on Self-Adaptive Systems}, volume={2}, number={5}, publisher={ACM}, journal_a={SAS}, year={2016}, month={5}, keywords={time series prediction;neural network;feature selection;pruning}, doi={10.4108/eai.3-12-2015.2262480} }- Martin Macas
Fabio Moretti
Year: 2016
Sensitivity based selection of inputs and delays for NARX models
SAS
EAI
DOI: 10.4108/eai.3-12-2015.2262480
Abstract
In this paper, an extension of sensitivity based pruning (SBP) method for Nonlinear AutoRegressive models with eXogenous inputs (NARX) model is presented. Besides the inputs, input and output delays are simultaneously pruned in terms of the backward elimination. The concept is based on replacement of some regressors by their mean value, which corresponds to the removal of influence of the particular regressors from the network. The method is demonstrated on two datasets. Firstly, one artificial generator is used to test if the method is able to find an optimal set of inputs and delays. Further, the method is used for prediction of gas consumption of a simulated heating for an office building. It is shown that the SBP significantly reduces the complexity of the NARX network without any significant performance degradation. Moreover, it is hypothesized than SBP can be more important for NARX than for simple feedforward neural network, because NARX is more prone to overfitting and has problems with stability.
Copyright © 2015 M. Macas and F. Moretti, licensed to EAI. This is an open access article distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/3.0/), which permits unlimited use, distribution and reproduction in any medium so long as the original work is properly cited.