3.4 Joint Moment Generating Function

Definition 3.4.1. Let \(X\) and \(Y\) have a joint probability function \(f_{X,Y}(x,y)\) then the joint moment generating function of \(X\) and \(Y\) denoted by \[M_{X,Y}(t_1,t_2)=E\left (e^{t_1X +t_2Y}\right )\] given by \[E\left (e^{\displaystyle {t_1X + t_2Y}}\right )= \begin {cases} \sum \limits _X\sum \limits _Ye^{\displaystyle {t_1X + t_2Y}}\quad P (X=x,Y=y) & \text {discrete}\\[1ex] \int \limits _X\int \limits _Ye^{\displaystyle {t_1X + t_2Y}}\quad f_{X,Y}(x,y)\, dx\, dy & \text {continuous} \end {cases} \]

Remark 3.4.2.

1.
If \(M(t_1,t_2)\) exists then the m.g.f of \(X\) is given by \[M_X(t_1) = E\left (e^{t_1X}\right ) = M(t_1,0)\] and the m.g.f of \(Y\) is given by \[M_Y(t_2) = E\left (e^{t_2Y}\right ) = M(0,t_2).\]
2.
If \(X\) and \(Y\) are independent the \(M_{X,Y}(t_1,t_2)=M_X(t_1)M_Y(t_2)\).

Proof. If \(X\) and \(Y\) are independent then \(f_{X,Y}(x,y)=f_X(x)f_Y(y)\). \begin {align*} E\left (e^{t_1X + t_2Y}\right ) & = \int \limits _X\int \limits _Ye^{t_1X}e^{t_2Y}f_X(x)f_Y(y)dxdy\\ & = \int \limits _Xe^{t_1X}f_X(x)dx\int \limits _Ye^{t_2Y}f_Y(y)\,dy\\ & = M_X(t_1)\, M_Y(t_2). \end {align*} □

Example 3.4.3. Find the joint moment generating function for \(X\) and \(Y\) with joint p.d.f. \[f_{X,Y}(x,y)=\frac {x+y}{3},\quad 0<x<1,\quad 0<y<2.\]

Solution.

The density is a sum of products of a function of \(x\) and a function of \(y\), so the double integral splits into single integrals. With \(t_1, t_2\ne 0\), integration by parts gives \[\int _0^1e^{xt_1}\,dx = \frac {e^{t_1} - 1}{t_1},\qquad \int _0^1xe^{xt_1}\,dx = \frac {(t_1 - 1)e^{t_1} + 1}{t_1^2},\] \[\int _0^2e^{yt_2}\,dy = \frac {e^{2t_2} - 1}{t_2},\qquad \int _0^2ye^{yt_2}\,dy = \frac {(2t_2 - 1)e^{2t_2} + 1}{t_2^2} .\] Hence \begin {align*} M_{X,Y}(t_1,t_2) & = \frac 13\int ^2_0\int ^1_0e^{xt_1+yt_2}(x+y)\, dx\, dy\\ & = \frac 13\left [\int _0^1xe^{xt_1}\,dx\int _0^2e^{yt_2}\,dy + \int _0^1e^{xt_1}\,dx\int _0^2ye^{yt_2}\,dy\right ]\\ & = \frac 13\left [\frac {(t_1 - 1)e^{t_1} + 1}{t_1^2}\cdot \frac {e^{2t_2} - 1}{t_2} + \frac {e^{t_1} - 1}{t_1}\cdot \frac {(2t_2 - 1)e^{2t_2} + 1}{t_2^2}\right ], \end {align*}

with the value at \(t_1 = 0\) or \(t_2 = 0\) given by the limit. The marginal m.g.f.s are \(M_X(t_1) = \lim _{t_2\to 0}M_{X,Y}(t_1, t_2)\) and \(M_Y(t_2) = \lim _{t_1\to 0}M_{X,Y}(t_1, t_2)\); for example, since \(\frac {e^{2t_2} - 1}{t_2}\to 2\) and \(\frac {(2t_2 - 1)e^{2t_2} + 1}{t_2^2}\to 2\), \[M_X(t_1) = \frac 23\left [\frac {(t_1 - 1)e^{t_1} + 1}{t_1^2} + \frac {e^{t_1} - 1}{t_1}\right ].\] □

Further reading

1.
Galton, F. (1886), Regression towards mediocrity in hereditary stature, Journal of the Anthropological Institute, 15, 246–263.
2.
Pearson, K. (1896), Mathematical contributions to the theory of evolution III: regression, heredity and panmixia, Philosophical Transactions of the Royal Society A, 187, 253–318.

Questions on this section

Stuck on something here? Ask below and it stays attached to this topic.