3.4 Joint Moment Generating Function
Definition 3.4.1. Let \(X\) and \(Y\) have a joint probability function \(f_{X,Y}(x,y)\) then the joint moment generating function of \(X\) and \(Y\) denoted by \[M_{X,Y}(t_1,t_2)=E\left (e^{t_1X +t_2Y}\right )\] given by \[E\left (e^{\displaystyle {t_1X + t_2Y}}\right )= \begin {cases} \sum \limits _X\sum \limits _Ye^{\displaystyle {t_1X + t_2Y}}\quad P (X=x,Y=y) & \text {discrete}\\[1ex] \int \limits _X\int \limits _Ye^{\displaystyle {t_1X + t_2Y}}\quad f_{X,Y}(x,y)\, dx\, dy & \text {continuous} \end {cases} \]
- 1.
- If \(M(t_1,t_2)\) exists then the m.g.f of \(X\) is given by \[M_X(t_1) = E\left (e^{t_1X}\right ) = M(t_1,0)\] and the m.g.f of \(Y\) is given by \[M_Y(t_2) = E\left (e^{t_2Y}\right ) = M(0,t_2).\]
- 2.
- If \(X\) and \(Y\) are independent the \(M_{X,Y}(t_1,t_2)=M_X(t_1)M_Y(t_2)\).
Proof. If \(X\) and \(Y\) are independent then \(f_{X,Y}(x,y)=f_X(x)f_Y(y)\). \begin {align*} E\left (e^{t_1X + t_2Y}\right ) & = \int \limits _X\int \limits _Ye^{t_1X}e^{t_2Y}f_X(x)f_Y(y)dxdy\\ & = \int \limits _Xe^{t_1X}f_X(x)dx\int \limits _Ye^{t_2Y}f_Y(y)\,dy\\ & = M_X(t_1)\, M_Y(t_2). \end {align*} □
Example 3.4.3. Find the joint moment generating function for \(X\) and \(Y\) with joint p.d.f. \[f_{X,Y}(x,y)=\frac {x+y}{3},\quad 0<x<1,\quad 0<y<2.\]
Solution.
The density is a sum of products of a function of \(x\) and a function of \(y\), so the double integral splits into single integrals. With \(t_1, t_2\ne 0\), integration by parts gives \[\int _0^1e^{xt_1}\,dx = \frac {e^{t_1} - 1}{t_1},\qquad \int _0^1xe^{xt_1}\,dx = \frac {(t_1 - 1)e^{t_1} + 1}{t_1^2},\] \[\int _0^2e^{yt_2}\,dy = \frac {e^{2t_2} - 1}{t_2},\qquad \int _0^2ye^{yt_2}\,dy = \frac {(2t_2 - 1)e^{2t_2} + 1}{t_2^2} .\] Hence \begin {align*} M_{X,Y}(t_1,t_2) & = \frac 13\int ^2_0\int ^1_0e^{xt_1+yt_2}(x+y)\, dx\, dy\\ & = \frac 13\left [\int _0^1xe^{xt_1}\,dx\int _0^2e^{yt_2}\,dy + \int _0^1e^{xt_1}\,dx\int _0^2ye^{yt_2}\,dy\right ]\\ & = \frac 13\left [\frac {(t_1 - 1)e^{t_1} + 1}{t_1^2}\cdot \frac {e^{2t_2} - 1}{t_2} + \frac {e^{t_1} - 1}{t_1}\cdot \frac {(2t_2 - 1)e^{2t_2} + 1}{t_2^2}\right ], \end {align*}
with the value at \(t_1 = 0\) or \(t_2 = 0\) given by the limit. The marginal m.g.f.s are \(M_X(t_1) = \lim _{t_2\to 0}M_{X,Y}(t_1, t_2)\) and \(M_Y(t_2) = \lim _{t_1\to 0}M_{X,Y}(t_1, t_2)\); for example, since \(\frac {e^{2t_2} - 1}{t_2}\to 2\) and \(\frac {(2t_2 - 1)e^{2t_2} + 1}{t_2^2}\to 2\), \[M_X(t_1) = \frac 23\left [\frac {(t_1 - 1)e^{t_1} + 1}{t_1^2} + \frac {e^{t_1} - 1}{t_1}\right ].\] □
Further reading
- 1.
- Galton, F. (1886), Regression towards mediocrity in hereditary stature, Journal of the Anthropological Institute, 15, 246–263.
- 2.
- Pearson, K. (1896), Mathematical contributions to the theory of evolution III: regression, heredity and panmixia, Philosophical Transactions of the Royal Society A, 187, 253–318.
Questions on this section
Stuck on something here? Ask below and it stays attached to this topic.