6.3 Balanced incomplete block designs
Sometimes a block cannot hold every treatment: a batch of material is enough for only three runs, a day has room for only four, a litter has only so many animals. A design in which each block contains \(k < t\) of the \(t\) treatments is an incomplete block design. Among these the balanced designs are the simplest to analyse.
Definition 6.3.1. A balanced incomplete block design (BIBD) has \(t\) treatments in \(b\) blocks of \(k < t\) units, such that
- (i)
- each block contains \(k\) different treatments;
- (ii)
- each treatment occurs in \(r\) blocks;
- (iii)
- each pair of treatments occurs together in exactly \(\lambda \) blocks.
Proposition 6.3.2. The parameters of a BIBD satisfy \[ bk = tr , \qquad \lambda (t - 1) = r(k - 1) , \qquad b \ge t . \]
Proof. Both \(bk\) and \(tr\) count the units in the design, by blocks and by treatments. For the second, fix a treatment \(i\) and count the pairs (unit with a treatment \(l \ne i\), block) in which the block also contains \(i\). Treatment \(i\) is in \(r\) blocks, each with \(k - 1\) other units, giving \(r(k - 1)\); each of the \(t - 1\) other treatments meets \(i\) in \(\lambda \) blocks, giving \(\lambda (t - 1)\).
For the third (Fisher’s inequality), let \(N\) be the \(t \times b\) incidence matrix, \(n_{ij} = 1\) if treatment \(i\) is in block \(j\). Then \(NN^\top \) has diagonal entries \(r\) and off-diagonal entries \(\lambda \), so \(NN^\top = (r - \lambda )I + \lambda J\). Its eigenvalues are \(r - \lambda + \lambda t = rk\) (on the vector of ones, using the second identity) and \(r - \lambda \), with multiplicity \(t - 1\). Since \(k < t\), the second identity gives \(r > \lambda \), so \(NN^\top \) is non-singular and has rank \(t\). But its rank is at most the rank of \(N\), which is at most \(b\). □
A BIBD always exists with \(b = \binom tk\), by taking every set of \(k\) treatments as a block, but this is usually far too many blocks, and much of the theory of design is about smaller ones. The parameters must satisfy Proposition 6.3.2, which rules out many combinations, though satisfying it does not guarantee existence.
Example 6.3.3. Four catalysts are to be compared, but each batch of raw material suffices for only three runs. With \(t = 4\), \(k = 3\), all \(\binom 43 = 4\) sets of three give a BIBD with \(b = 4\), \(r = 3\) and \(\lambda = 2\); check: \(bk = 12 = tr\) and \(\lambda (t - 1) = 6 = r(k - 1)\). The yields (%) were
| batch | catalyst \(1\) | catalyst \(2\) | catalyst \(3\) | catalyst \(4\) | \(y_{\cdot j}\) |
| \(1\) | \(61.7\) | \(64.6\) | \(66.3\) | – | \(192.6\) |
| \(2\) | \(59.3\) | \(60.9\) | – | \(59.6\) | \(179.8\) |
| \(3\) | \(60.2\) | – | \(63.2\) | \(61.1\) | \(184.5\) |
| \(4\) | – | \(60.3\) | \(60.9\) | \(59.1\) | \(180.3\) |
| \(y_{i\cdot }\) | \(181.2\) | \(185.8\) | \(190.4\) | \(179.8\) | \(737.2\) |
with \(\sum y^2 = 45342.40\).
The intrablock analysis
The model is \(y_{ij} = \mu + \tau _i + \beta _j + \varepsilon _{ij}\) for the pairs \((i, j)\) that occur. Because not every treatment is in every block, a treatment total \(y_{i\cdot }\) is affected by the effects of the blocks it happens to be in, and the raw treatment means are biased comparisons. The correction is to subtract from each treatment total the average of the totals of its blocks.
Theorem 6.3.4. Define the adjusted treatment totals \[ Q_i = y_{i\cdot } - \frac 1k\sum _{j=1}^bn_{ij}y_{\cdot j} , \qquad i = 1, \dots , t . \] With \(\sum \tau _i = 0\):
- (i)
- \(E(Q_i) = \lambda t\tau _i/k\), so \(\hat \tau _i = kQ_i/(\lambda t)\) is unbiased for \(\tau _i\), and it is the least squares estimate;
- (ii)
- \(\Var (\hat \tau _i - \hat \tau _l) = 2k\sigma ^2/(\lambda t)\) for \(i \ne l\);
- (iii)
- the treatment sum of squares adjusted for blocks is \(SS_{\mathrm {Treatments(adj)}} = k\sum _iQ_i^2/(\lambda t)\), on \(t - 1\) degrees of freedom, and \[ SST = SS_{\mathrm {Blocks}} + SS_{\mathrm {Treatments(adj)}} + SSE , \] where \(SS_{\mathrm {Blocks}} = \sum _jy_{\cdot j}^2/k - y_{\cdot \cdot }^2/(tr)\) is unadjusted and \(SSE\), found by subtraction, has \(tr - t - b + 1\) degrees of freedom.
Proof. (i) \(E(y_{i\cdot }) = r\mu + r\tau _i + \sum _jn_{ij}\beta _j\) and \(E(y_{\cdot j}) = k\mu + \sum _ln_{lj}\tau _l + k\beta _j\). Hence \[ \frac 1k\sum _jn_{ij}E(y_{\cdot j}) = r\mu + \frac 1k\sum _l\Bigl (\sum _jn_{ij}n_{lj}\Bigr )\tau _l + \sum _jn_{ij}\beta _j . \] The inner sum is the number of blocks containing both \(i\) and \(l\): \(r\) if \(l = i\) and \(\lambda \) otherwise. So the middle term is \(\frac 1k\bigl (r\tau _i + \lambda \sum _{l\ne i}\tau _l\bigr ) = \frac {(r - \lambda )\tau _i}{k}\), using \(\sum \tau _l = 0\), and \[ E(Q_i) = r\tau _i - \frac {(r - \lambda )\tau _i}{k} = \frac {r(k - 1) + \lambda }{k}\tau _i = \frac {\lambda (t - 1) + \lambda }{k}\tau _i = \frac {\lambda t}{k}\tau _i . \] The block effects have cancelled. Eliminating \(\mu \) and the \(\beta _j\) from the normal equations gives the reduced normal equations \(C\hat {\boldsymbol \tau } = \mathbf Q\) with \(C = rI - NN^\top /k = (\lambda t/k)(I - J/t)\), by the form of \(NN^\top \) found in Proposition 6.3.2; under \(\sum \hat \tau _i = 0\) their solution is \(\hat \tau _i = kQ_i/(\lambda t)\).
(ii) Using \(\Var (y_{i\cdot }) = r\sigma ^2\), \(\Cov (y_{i\cdot }, y_{\cdot j}) = n_{ij}\sigma ^2\), \(\Var (y_{\cdot j}) = k\sigma ^2\) and independence of different blocks, one finds \(\Cov (\mathbf Q) = \sigma ^2C\). Hence \[ \Var (\hat \tau _i - \hat \tau _l) = \Bigl (\frac {k}{\lambda t}\Bigr )^2\sigma ^2(C_{ii} + C_{ll} - 2C_{il}) = \Bigl (\frac {k}{\lambda t}\Bigr )^2\sigma ^2\cdot \frac {2\lambda t}{k} = \frac {2k\sigma ^2}{\lambda t} . \]
(iii) The reduction in the residual sum of squares from adding treatments to a model that already contains blocks is \(\hat {\boldsymbol \tau }^\top \mathbf Q = k\sum Q_i^2/(\lambda t)\), by the standard result that the extra regression sum of squares equals the estimate times the right-hand side of the reduced normal equations. □
In an RCBD with the same \(r\), the variance of a treatment difference would be \(2\sigma ^2/r\). The ratio \[ E = \frac {2\sigma ^2/r}{2k\sigma ^2/(\lambda t)} = \frac {\lambda t}{rk} \] is the efficiency factor of the BIBD. It is less than \(1\) because some information about treatments is lost in the block totals. For the catalyst design \(E = 8/9\). If the smaller blocks have a smaller \(\sigma ^2\), as is the reason for using them, the BIBD can still be the more precise design.
Example 6.3.5. For the catalyst data, the correction factor is \(737.2^2/12 = 45288.6533\), \(SST = 53.7467\) and \(SS_{\mathrm {Blocks}} = (192.6^2 + 179.8^2 + 184.5^2 + 180.3^2)/3 - 45288.6533 = 35.0600\). The adjusted totals are \begin {align*} Q_1 &= 181.2 - \tfrac 13(192.6 + 179.8 + 184.5) = -4.4333 , \\ Q_2 &= 185.8 - \tfrac 13(192.6 + 179.8 + 180.3) = 1.5667 , \\ Q_3 &= 190.4 - \tfrac 13(192.6 + 184.5 + 180.3) = 4.6000 , \\ Q_4 &= 179.8 - \tfrac 13(179.8 + 184.5 + 180.3) = -1.7333 , \end {align*}
which sum to zero, and \(SS_{\mathrm {Treatments(adj)}} = 3(4.4333^2 + 1.5667^2 + 4.6^2 + 1.7333^2)/8 = 17.3525\).
| source | SS | df | MS | \(F_0\) |
| catalysts (adjusted) | \(17.3525\) | \(3\) | \(5.7842\) | \(21.68\) |
| batches | \(35.0600\) | \(3\) | ||
| error | \(1.3342\) | \(5\) | \(0.2668\) | |
| total | \(53.7467\) | \(11\) |
With \(F_{0.05,3,5} = 5.41\), the catalysts differ (\(p = 0.003\)). The estimated effects are \(\hat \tau _i = 3Q_i/8\): \(-1.66\), \(0.59\), \(1.73\), \(-0.65\), and the adjusted means \(\bar y_{\cdot \cdot } + \hat \tau _i\) are \(59.77\), \(62.02\), \(63.16\) and \(60.78\). The standard error of a difference is \(\sqrt {2(3)(0.2668)/8} = 0.447\).
The adjustment matters. The raw means are \(60.40\), \(61.93\), \(63.47\) and \(59.93\), which put catalyst \(1\) above catalyst \(4\); the adjusted means reverse the order. Catalyst \(4\) was the one left out of batch \(1\), the best batch, and catalyst \(1\) benefited from being in it. The raw means compare the catalysts and the batches they happened to meet; the adjusted means compare the catalysts alone.
Remark. The intrablock analysis uses only comparisons within blocks. When the block effects can be regarded as random, the block totals carry some further information about the treatments, and the recovery of interblock information combines the two estimates. The gain is small unless the blocks vary little; the intrablock analysis is always valid.
Questions on this section
Stuck on something here? Ask below and it stays attached to this topic.