Aim for a simple model
The more terms in a model, the greater its flexibility and ability to describe patterns in the experimental data. However when terms are added, the model also becomes harder to interpret.
We therefore want to find the simplest model that is consistent with the data.
Analysis of variance is again used to find the simplest model.
Analysis of variance (anova) table
A column of mean sums of squares (sums of squares divided by their degrees of freedom) is added to the sum of squares table. The mean explained sums of squares are compared to the mean residual sum of squares with F ratios.
Large explained sums of squares correspond to significant terms.
A p-value for each term shows whether its F ratio is larger than could be expected by chance.
The p-values are used to decide which terms are unimportant and can be dropped from the full model.
Note however that we should only consider hierarchical models, so terms must not be dropped if higher-order interactions involving them are still in the model.
Water uptake by toads and frogs
The diagram below initially shows the best-fitting model with all interactions for the water uptake data.
The 3-factor interaction term has a high p-value and is not significant so it can be dropped from the model. (Click the checkbox to the left of the term to delete it.)
There is similarly no evidence of interactions between Moisture and the other two factors, so drop them from the full model too. The interaction between Animal and Injection has p-value 0.0609, so the evidence for these factors interacting is weak but we will leave the term in the model.
This leaves a model with all main effects (all factors affect mean Water uptake) and an interaction between Animal and Injection.
This is the simplest model that is consistent with the data.
Click the y-x rotation button. The purple lines show the mean Water uptake for animals getting no hormone and the green lines are similar for those getting the hormone.
The difference between the water uptake of toads and frogs is much greater for animals getting the injection than for those in the control group.
Wear of coated fabrics
An experiment was conducted to assess the durability of coated fabric subjected to standard abrasive tests. A factorial experiment was conducted with two different fillers (F1 and F2) in three different proportions (25%, 50% and 75%), either with or without surface treatment of the fabric. Two replicate fabric specimens were tested for each of the 12 treatment combinations in a completely randomised design. The response is the weight loss (mg) of the fabric specimens in the abrasion test.
For this data set, neither the 3-factor interaction nor the 2-factor interaction between Surface treatment and Percentage filler are significant. Use the checkboxes to delete these two terms from the model.
This is the simplest model that is consistent with the data — all remaining terms are significant.
This model has two 2-factor interaction terms so it is a little harder to understand than the best model for the soft drink data. Click the y-x rotation button to help understand the nature of this model.
For each filler type, surface treatment and percent filler have no interaction. (The two green lines are parallel and the two purple lines are parallel.)
(Also try clicking the y-z rotation button.) To interpret the model, we must therefore separately explain it for the two filler types:
For filler 1,
For filler 2,