Select menu: Stats | Regression Analysis | All Subsets Regression | Linear Models
Use this to search through linear regression models. There are various methods for choosing a regression model when there are many candidate model terms. The Change model button on the Linear Regression dialog provides forward selection, backward elimination and stepwise regression. However these methods result in only one model and alternative models, with an equivalent or even better fit, are easily overlooked.
- After you have imported your data, from the menu select
Stats | Regression Analysis | All Subsets Regression | Linear Models. - Fill in the fields as required then click Run.
You can set additional Options then after running, you can save the results by clicking Save.
Especially in observational studies with many non-orthogonal terms there are frequently a number of alternative models, and then selection of just one well-fitting model is unsatisfactory and possibly misleading. A preferable method is to fit all possible regression models, and to evaluate these according to some criterion. In this way a number of best regression models can be selected. However the fitting of all possible regression models is very computer intensive. It should also be used with caution, because models can be selected which appear to have a lot of explanatory power, but contain noise variables only. This may occur particularly when the number of parameters is large in comparison with the number of units. Terms should therefore not be selected on the basis of a statistical analysis alone. Use this to perform these model selection methods.
Available data
This lists data structures appropriate to the current input field. The contents will change as you move from one field to the next. You can double-click a name to copy it to the current input field or type it in.
Response variate
Specify a response variate containing the data.
Model formula of list of explanatory data
Specifies the model candidate terms in the fitted model, which may be set using a model formula or using a list of terms separated by commas.
Terms always included in the model
It is sometimes desirable to include specific terms in every model. Such terms may be specified by in this box, which may be set using a model formula or using a list of terms separated by commas.
Operators
This provides a quick way of entering operators in the Model terms formula. Double-click on the required symbol to copy it to the current input field. You can also type in operators directly. See model formula for a description of each.
Factorial limit on model terms
You can control the factorial limit on model terms to be generated when you use in model-formula operators like ‘*’.
Method
Specifies the model selection methods to be used.
Accumulated | An accumulated analysis of deviance in which all model terms are added one by one to the model in the given order |
Pooled | An accumulated analysis of deviance in which terms with the same number of identifiers, e.g. main effects or two-factor interactions, are pooled |
Forward selection | an accumulated analysis of deviance resulting from forward selection |
Backwards elimination | An accumulated analysis of deviance resulting from backward elimination |
Forward stepwise | An accumulated analysis of deviance resulting from stepwise regression starting with no candidate terms in the model |
Backward stepwise | An accumulated analysis of deviance resulting from stepwise regression starting with all candidate terms in the model |
All possible | Summary statistics for a number of best models among all possible models |
See also
- All Subsets Regression – Linear Models Options
- All Subsets Regression Save Options
- All Subsets Regression – Generalized Linear Models for model selection for Generalized Linear Models
- RSEARCH procedure in command mode