학술논문

A New Approach to Variable Selection Using the TLS Approach
Document Type
Periodical
Source
IEEE Transactions on Signal Processing IEEE Trans. Signal Process. Signal Processing, IEEE Transactions on. 55(1):10-19 Jan, 2007
Subject
Signal Processing and Analysis
Communication, Networking and Broadcast Technologies
Computing and Processing
Input variables
Context modeling
Linear regression
Least squares methods
Vectors
Gaussian noise
Testing
Measurement errors
Statistics
Least squares (LS) problem
matrix perturbation
stepwise regression
Student test
subset selection
total least squares (TLS) problem
Language
ISSN
1053-587X
1941-0476
Abstract
The problem of variable selection is one of the most important model selection problems in statistical applications. It is also known as the subset selection problem and arises when one wants to explain the observations or data adequately by a subset of possible explanatory variables. The objective is to identify factors of importance and to include only variables that contribute significantly to the reduction of the prediction error. Numerous selection procedures have been proposed in the classical multiple linear regression model. We extend one of the most popular methods developed in this context, the backward selection procedure, to a more general class of models. In the basic linear regression model, errors are present on the observations only, if errors are present on the regressors as well, one gets the errors-in-variables model which for Gaussian noise becomes the total-least-squares (TLS) model, this is the context considered here.