11.6 Practice problems
Problem 11.6.1. For each experiment, say whether each factor is fixed or random, and give the hypotheses tested.
- (a)
- Five varieties of maize, the only ones the seed company sells, are compared on plots at four farms chosen at random from a district.
- (b)
- A laboratory checks its measurement process: three technicians, chosen from the twenty it employs, each measure ten parts chosen from a day’s production, twice.
- (c)
- The effect of three temperatures (\(150\), \(175\) and \(200\,^\circ \)C) on yield is studied, using two batches of raw material from each of three suppliers selected from a list of approved suppliers.
Show solution
Solution. (a) Varieties are fixed (all of interest, the same in any repeat); farms are random (a sample from the district, and inference is meant to apply to the district). Mixed model: \(H_0 : \tau _1 = \dots = \tau _5 = 0\) for varieties, \(H_0 : \sigma ^2_\beta = 0\) for farms, \(H_0 : \sigma ^2_{\tau \beta } = 0\) for the interaction.
(b) Technicians and parts are both random: nobody cares about technician \(2\) in particular; the question is how much of the measurement variation is due to technicians (reproducibility) and to repeat measurements (repeatability). All hypotheses concern variance components. This is the usual gauge study.
(c) Temperature is fixed. Suppliers are random. Batches are random too, but each batch belongs to one supplier, so batches are nested in suppliers rather than crossed with them; nested factors are treated in the next section.
Problem 11.6.2. In the one-way random effects model with \(n_i\) observations on level \(i\) and \(N = \sum n_i\), show that \(E(MSE) = \sigma ^2\) and \(E(MS_{\mathrm {Treatments}}) = \sigma ^2 + n_0\sigma ^2_\tau \), where \(n_0 = \bigl (N - \sum _in_i^2/N\bigr )/(t - 1)\). Show that \(n_0 \le \bar n = N/t\), with equality only for equal \(n_i\).
Show solution
Solution. Now \(y_{i\cdot } = n_i\mu + n_i\tau _i + \varepsilon _{i\cdot }\) and \(y_{\cdot \cdot } = N\mu + \sum _in_i\tau _i + \varepsilon _{\cdot \cdot }\), so \begin {align*} E(y_{i\cdot }^2) &= n_i^2\mu ^2 + n_i^2\sigma ^2_\tau + n_i\sigma ^2 , \\ E(y_{\cdot \cdot }^2) &= N^2\mu ^2 + \textstyle \sum _in_i^2\sigma ^2_\tau + N\sigma ^2 . \end {align*}
Then \begin {align*} E(SS_{\mathrm {Treatments}}) &= \sum _i\frac {E(y_{i\cdot }^2)}{n_i} - \frac {E(y_{\cdot \cdot }^2)}N \\ &= (N\mu ^2 + N\sigma ^2_\tau + t\sigma ^2) - \Bigl (N\mu ^2 + \frac {\sum _in_i^2}N\sigma ^2_\tau + \sigma ^2\Bigr ) \\ &= (t - 1)\sigma ^2 + \Bigl (N - \frac {\sum _in_i^2}N\Bigr )\sigma ^2_\tau , \end {align*}
and dividing by \(t - 1\) gives the result. \(E(SSE) = \sum _{i,j}E(y_{ij}^2) - \sum _iE(y_{i\cdot }^2)/n_i = N\sigma ^2 - t\sigma ^2\), so \(E(MSE) = \sigma ^2\). By the Cauchy–Schwarz inequality \(\sum n_i^2 \ge N^2/t\), so \[ (t - 1)n_0 \le N - N/t = (t - 1)N/t , \] with equality only when all \(n_i\) are equal. Imbalance reduces the effective number of observations per level.
Problem 11.6.3. Let the \(w_{ij}\) be independent \(N(0, \sigma ^2_{\tau \beta })\) and \((\tau \beta )_{ij} = w_{ij} - \bar w_{\cdot j}\). Show that \(\Var \bigl ((\tau \beta )_{ij}\bigr ) = \frac {a - 1}a\sigma ^2_{\tau \beta }\) and, for \(i \ne i'\), \(\Cov \bigl ((\tau \beta )_{ij}, (\tau \beta )_{i'j}\bigr ) = -\sigma ^2_{\tau \beta }/a\). Interpret the negative covariance.
Show solution
Solution. \(\Cov (w_{ij}, \bar w_{\cdot j}) = \sigma ^2_{\tau \beta }/a\) and \(\Var (\bar w_{\cdot j}) = \sigma ^2_{\tau \beta }/a\), so \begin {align*} \Var \bigl ((\tau \beta )_{ij}\bigr ) &= \sigma ^2_{\tau \beta } - 2\sigma ^2_{\tau \beta }/a + \sigma ^2_{\tau \beta }/a = \tfrac {a - 1}a\sigma ^2_{\tau \beta } , \\ \Cov \bigl ((\tau \beta )_{ij}, (\tau \beta )_{i'j}\bigr ) &= 0 - \sigma ^2_{\tau \beta }/a - \sigma ^2_{\tau \beta }/a + \sigma ^2_{\tau \beta }/a = -\sigma ^2_{\tau \beta }/a . \end {align*}
The interactions in one column must sum to zero, so if one fixed level does unusually well with a given random level, the others must do worse on average: they are negatively correlated. Interactions in different columns are independent.
Problem 11.6.4. Reanalyse the data of Example 11.4.3 supposing that the four operators had also been chosen at random from a large workforce. Which conclusions change, and why?
Show solution
Solution. Both factors are now random, and Theorem 11.3.2 applies. The sums of squares and mean squares are unchanged. The interaction is still tested against error (\(F_0 = 1.49\), not significant). Both main effects are now tested against \(MS_{AB} = 0.2762\) on \(6\) degrees of freedom: \begin {align*} \text {operators: } F_0 &= 3.4393/0.2762 = 12.45 > F_{0.05, 3, 6} = 4.76 , \\ \text {filters: } F_0 &= 2.3169/0.2762 = 8.39 > F_{0.05, 2, 6} = 5.14 \quad (P = 0.018) . \end {align*}
Both are still significant, but the evidence on filters is weaker than in the restricted mixed model (\(P = 0.0002\)), because the denominator has larger expectation and fewer degrees of freedom. The estimates are now variance components for both factors: \[ \hat \sigma ^2_\tau = \frac {3.4393 - 0.2762}9 = 0.351 , \qquad \hat \sigma ^2_\beta = \frac {2.3169 - 0.2762}{12} = 0.170 , \] with \(\hat \sigma ^2_{\tau \beta } = 0.030\) and \(\hat \sigma ^2 = 0.185\). What changes is the question: instead of asking which of these four operators differ, the analysis now says that operators in general are the largest source of variability, so training or standardising the procedure is where to start.
Problem 11.6.5. A one-way random effects experiment is planned with \(r = 4\) observations per level, to detect a variance component as large as half the error variance (\(\theta = \sigma ^2_\tau /\sigma ^2 = 0.5\)) with power at least \(0.8\) at \(\alpha = 0.05\). How many levels are needed? For a fixed total of \(N = 24\) observations, compare the designs \((t, r) = (4, 6)\), \((6, 4)\), \((8, 3)\) and \((12, 2)\) for detecting \(\theta = 1\).
Show solution
Solution. The power is \(P\bigl (F_{t-1, 3t} > F_{0.05, t-1, 3t}/(1 + 4\times 0.5)\bigr ) = P\bigl (F_{t-1, 3t} > F_{0.05, t-1, 3t}/3\bigr )\). Evaluating it,
| \(t\) | \(6\) | \(10\) | \(13\) | \(14\) | \(15\) |
| power | \(0.49\) | \(0.67\) | \(0.77\) | \(0.79\) | \(0.82\) |
so \(t = 15\) levels (60 observations) are needed. For \(N = 24\) and \(\theta = 1\) the powers are \(0.73\), \(0.73\), \(0.70\) and \(0.56\). Few levels with many replicates loses error degrees of freedom little but leaves \(t - 1\) small; many levels with \(r = 2\) makes \(1 + r\theta \) small. Here \(t = 4\) to \(6\) is best for testing, but for estimating \(\sigma ^2_\tau \) the number of levels matters most, as Example 11.2.4 showed.
Problem 11.6.6. In a balanced three-factor experiment with \(A\) fixed (\(a = 3\)), \(B\) and \(C\) random (\(b = 4\), \(c = 2\)) and \(n = 2\), the mean squares included \(MS_A = 95.0\), \(MS_{AB} = 12.4\), \(MS_{AC} = 15.8\) and \(MS_{ABC} = 4.6\). Test \(H_0 : \tau _1 = \tau _2 = \tau _3 = 0\) at the \(5\%\) level using the restricted model. What would the (incorrect) test against \(MS_{AB}\) alone conclude?
Show solution
Solution. The denominator is \(MS_{AB} + MS_{AC} - MS_{ABC} = 12.4 + 15.8 - 4.6 = 23.6\), with degrees of freedom \(6\), \(2\) and \(6\) for the three mean squares. So \[ F_0 = \frac {95.0}{23.6} = 4.03 , \qquad \hat \nu = \frac {23.6^2}{12.4^2/6 + 15.8^2/2 + 4.6^2/6} = 3.6 . \] Since \(F_{0.05, 2, 3.6} = 7.67\) (\(P = 0.12\)), \(H_0\) is not rejected. The alternative statistic gives the same conclusion: \[ F_0' = \frac {95.0 + 4.6}{12.4 + 15.8} = 3.53 , \] on \(2.2\) and \(5.3\) degrees of freedom, with \(P = 0.10\). Testing against \(MS_{AB}\) alone would give \(F_0 = 95.0/12.4 = 7.66 > F_{0.05, 2, 6} = 5.14\), a spurious rejection: it ignores the contribution \(bn\sigma ^2_{\tau \gamma }\) of the \(AC\) interaction to \(E(MS_A)\).
Questions on this section
Stuck on something here? Ask below and it stays attached to this topic.