二项分布的期望方差证明

您所在的位置:网站首页 皮蛋的家常吃法 二项分布的期望方差证明

二项分布的期望方差证明

2024-01-15 15:34| 来源: 网络整理| 查看: 265

(好久没写知乎文章了,又不知道该写什么,就随便水一水吧)

二项分布:

equation?tex=n 次试验,每次试验有

equation?tex=p 的概率出现目标事件,记

equation?tex=x

equation?tex=n 次试验后出现目标事件的次数;

负二项分布:若干次试验,每次试验有

equation?tex=p 的概率出现目标事件,记

equation?tex=x 为出现

equation?tex=r 次目标事件所需要的总试验次数。

首先我们先用最暴力的方法来直接推导它们的期望和方差。

直接算E(X)和Var(X)

二项分布的pmf:

equation?tex=f%28x%29%3D+%5Cleft%28+%5Cbegin%7Bmatrix%7D+n+%5C%5Cx+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Ex%281-p%29%5E%7Bn-x%7D

那么:

equation?tex=%5Cbegin%7Balign%7D+E%28X%29%26%3D%5Csum_%7Bx%3D1%7D%5En+xf%28x%29+%5C%5C%26%3D%5Csum_%7Bx%3D1%7D%5En+x%5Cleft%28+%5Cbegin%7Bmatrix%7D+n+%5C%5Cx+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Ex%281-p%29%5E%7Bn-x%7D+%5C%5C%26%3D%5Csum_%7Bx%3D1%7D%5Ennp+%5Cleft%28+%5Cbegin%7Bmatrix%7D+n-1+%5C%5Cx-1+%5Cend%7Bmatrix%7D+%5Cright%29p%5E%7Bx-1%7D%281-p%29%5E%7Bn-x%7D+%5Cend%7Balign%7D

equation?tex=np 提出来,容易观察得出剩下那一部分也是一个二项分布的pmf,只不过

equation?tex=n 变成了

equation?tex=n-1

equation?tex=x 变成了

equation?tex=x-1 ,那么它求和后结果为1.

因此:

equation?tex=%5Cbegin%7Balign%7D++E%28X%29%26%3Dnp%5Csum_%7Bx%3D1%7D%5En+%5Cleft%28+%5Cbegin%7Bmatrix%7D+n-1+%5C%5Cx-1+%5Cend%7Bmatrix%7D+%5Cright%29p%5E%7Bx-1%7D%281-p%29%5E%7Bn-x%7D+%5C%5C%26%3Dnp++%5Cend%7Balign%7D

为计算

equation?tex=Var%28X%29 ,我们先计算

equation?tex=E%28X%5E2%29

equation?tex=%5Cbegin%7Balign%7D+E%28X%5E2%29%26%3D%5Csum_%7Bx%3D1%7D%5En+x%5E2%5Cleft%28+%5Cbegin%7Bmatrix%7D+n+%5C%5Cx+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Ex%281-p%29%5E%7Bn-x%7D+%5C%5C%26%3D%5Csum_%7Bx%3D1%7D%5Ennp+%5Cleft%28+%5Cbegin%7Bmatrix%7D+n-1+%5C%5Cx-1+%5Cend%7Bmatrix%7D+%5Cright%29xp%5E%7Bx-1%7D%281-p%29%5E%7Bn-x%7D+%5C%5C%26%3Dnp%5Cleft%5B%5Csum_%7Bx%3D1%7D%5En%5Cleft%28+%5Cbegin%7Bmatrix%7D+n-1+%5C%5Cx-1+%5Cend%7Bmatrix%7D+%5Cright%29%28x-1%29p%5E%7Bx-1%7D%281-p%29%5E%7Bn-x%7D+%5C%5C%2B%5Csum_%7Bx%3D1%7D%5Enp%5E%7Bx-1%7D%281-p%29%5E%7Bn-x%7D%5Cright%5D+%5Cend%7Balign%7D

右边两个求和,是将

equation?tex=x 拆成

equation?tex=%28x-1%29%2B1 的结果,显然第一个求和为二项分布

equation?tex=B%28n-1%2Cp%29 的均值,第二个求和为二项分布pmf的和,即1。

因此:

equation?tex=E%28X%5E2%29%3Dnp%5B%28n-1%29p%2B1%5D

那么:

equation?tex=%5Cbegin%7Balign%7D+Var%28X%29%26%3DE%28X%5E2%29-%5BE%28X%29%5D%5E2+%5C%5C%26%3Dnp%281-p%29+%5Cend%7Balign%7D

现在我们再来算负二项分布的

equation?tex=E%28X%29

equation?tex=Var%28X%29

负二项分布的pmf:

equation?tex=f%28x%29%3D+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x-1%5C%5Cr-1+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Er%281-p%29%5E%7Bx-r%7D

那么:

equation?tex=%5Cbegin%7Balign%7D+E%28X%29%26%3D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+xf%28x%29+%5C%5C%26%3D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+x+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x-1%5C%5Cr-1+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Er%281-p%29%5E%7Bx-r%7D+%5C%5C%26%3D%5Cfrac%7Br%7D%7Bp%7D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty++%5Cleft%28+%5Cbegin%7Bmatrix%7D+x%5C%5Cr+%5Cend%7Bmatrix%7D+%5Cright%29+p%5E%7Br%2B1%7D%281-p%29%5E%7Bx-r%7D+%5Cend%7Balign%7D

显然右边的求和式对应着负二项分布

equation?tex=r

equation?tex=r%2B1 时的pmf,因此求和为1.

equation?tex=E%28X%29%3D%5Cfrac%7Br%7D%7Bp%7D

另外,

equation?tex=%5Cbegin%7Balign%7D+E%28X%5E2%29%26%3D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+x%5E2f%28x%29+%5C%5C%26%3D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+x%5E2+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x-1%5C%5Cr-1+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Er%281-p%29%5E%7Bx-r%7D++%5C%5C%26%3D+%5Cfrac%7Br%7D%7Bp%7D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+x+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x%5C%5Cr+%5Cend%7Bmatrix%7D+%5Cright%29+p%5E%7Br%2B1%7D%281-p%29%5E%7Bx-r%7D++%5C%5C%26%3D%5Cfrac%7Br%7D%7Bp%7D+%5Cleft%5B%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+%28x%2B1%29+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x%5C%5Cr+%5Cend%7Bmatrix%7D+%5Cright%29+p%5E%7Br%2B1%7D%281-p%29%5E%7Bx-r%7D++%5C%5C-%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x%5C%5Cr+%5Cend%7Bmatrix%7D+%5Cright%29+p%5E%7Br%2B1%7D%281-p%29%5E%7Bx-r%7D+%5Cright%5D+%5C%5C%26%3D%5Cfrac%7Br%7D%7Bp%7D%5Cleft%28%5Cfrac%7Br%2B1%7D%7Bp%7D-1+%5Cright%29+%5C%5C%26%3D%5Cfrac%7Br%28r-p%2B1%29%7D%7Bp%5E2%7D+%5Cend%7Balign%7D

因此:

equation?tex=Var%28X%29%3DE%28X%5E2%29-%5BE%28X%29%5D%5E2%3D%5Cfrac%7Br%281-p%29%7D%7Bp%5E2%7D

(其实,在推导中pmf和为1的隐藏结论是需要通过级数去推的,这也意味着上述式子可以化成特殊级数形式,读者可以自行证明)

用mgf进行计算会比上述方法稍微简单一些。

MGF计算

定义

equation?tex=M%28t%29%3DE%28e%5E%7BtX%7D%29

则:

equation?tex=M%27%28t%29%3DE%28Xe%5E%7BtX%7D%29

equation?tex=M%27%27%28t%29%3DE%28X%5E2e%5E%7BtX%7D%29

那么:

equation?tex=E%28X%29%3DM%27%280%29

equation?tex=%5Cbegin%7Balign%7D+Var%28X%29%26%3DE%28X%5E2%29-%5BE%28X%29%5D%5E2+%5C%5C%26%3DM%27%27%280%29-M%27%5E2%280%29+%5Cend%7Balign%7D

那么对于二项分布:

equation?tex=%5Cbegin%7Balign%7D++M%28t%29%26%3D%5Csum_%7Bx%3D1%7D%5En+e%5E%7Btx%7Df%28x%29+%5C%5C%26%3D%5Csum_%7Bx%3D1%7D%5En+e%5E%7Btx%7D%5Cleft%28+%5Cbegin%7Bmatrix%7D+n+%5C%5Cx+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Ex%281-p%29%5E%7Bn-x%7D+%5C%5C%26%3D%5Csum_%7Bx%3D1%7D%5En+%5Cleft%28+%5Cbegin%7Bmatrix%7D+n+%5C%5Cx+%5Cend%7Bmatrix%7D+%5Cright%29%28pe%5Et%29%5Ex%281-p%29%5E%7Bn-x%7D+%5C%5C%26%3D%281-p%2Bpe%5Et%29%5En+%5Cend%7Balign%7D

equation?tex=M%27%28t%29%3Dnpe%5Et%281-p%2Bpe%5Et%29%5E%7Bn-1%7D

equation?tex=%5Cbegin%7Balign%7D+M%27%27%28t%29%26%3DM%27%28t%29%2Bn%28n-1%29p%5E2e%5E%7B2t%7D%281-p%2Bpe%5Et%29%5E%7Bn-2%7D+%5Cend%7Balign%7D

故:

equation?tex=E%28X%29%3DM%27%280%29%3Dnp

equation?tex=%5Cbegin%7Balign%7D+Var%28X%29%26%3DM%27%27%280%29-M%27%5E2%280%29+%5C%5C%26%3Dnp-np%5E2+%5C%5C%26%3Dnp%281-p%29+%5Cend%7Balign%7D

对于负二项分布:

equation?tex=%5Cbegin%7Balign%7D+M%28t%29%26%3D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+e%5E%7Btx%7D+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x-1%5C%5Cr-1+%5Cend%7Bmatrix%7D+%5Cright%29+p%5Er%281-p%29%5E%7Bx-r%7D++%5C%5C%26%3D%5Csum_%7Bx%3Dr%7D%5E%5Cinfty+e%5E%7Bt%28x-r%29%7D+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x-1%5C%5Cr-1+%5Cend%7Bmatrix%7D+%5Cright%29+%28pe%5Et%29%5Er%281-p%29%5E%7Bx-r%7D+%5C%5C%26%3D%28pe%5Et%29%5Er%5Csum_%7Bx%3D1%7D%5E%5Cinfty+%5Cleft%28+%5Cbegin%7Bmatrix%7D+x-1%5C%5Cr-1+%5Cend%7Bmatrix%7D+%5Cright%29%5B%281-p%29e%5Et%5D%5E%7Bx-r%7D++%5Cend%7Balign%7D

观察和式,令

equation?tex=w%3D%281-p%29e%5Et

equation?tex=%5Cbegin%7Balign%7D+%281-w%29%5E%7B-r%7D%26%3Dr%281-w%29%5E%7B-r-1%7D%2B%5Cfrac%7Br%28r%2B1%29%7D%7B2%7D%281-w%29%5E%7B-r-2%7D%2B%5Ccdots+%5C%5C%26%2B%5Cleft%28%5Cbegin%7Bmatrix%7Dx-1%5C%5Cr-1%5Cend%7Bmatrix%7D%5Cright%29%281-w%29%5E%7B-r-%28x-r%29%7D++%5Cend%7Balign%7D

因此:

equation?tex=M%28t%29%3D%28pe%5Et%29%5Er%281-w%29%5E%7B-r%7D%3D%5Cfrac%7B%28pe%5Et%29%5Er%7D%7B%5B1-%281-p%29e%5Et%5D%5Er%7D

则:

equation?tex=%5Cbegin%7Balign%7D+M%27%28t%29%26%3D%5Cfrac%7Br%28pe%5Et%29%5Er%5B1-%281-p%29e%5Et%5D%5Er%2Bre%5Et%281-p%29%28pe%5Et%29%5Er%5B1-%281-p%29e%5Et%5D%5E%7Br-1%7D%7D%7B%5B1-%281-p%29e%5Et%5D%5E%7B2r%7D%7D+%5C%5C%26%3D%5Cfrac%7Br%28pe%5Et%29%5Er%5B1-%281-p%29e%5Et%5D%2Bre%5Et%281-p%29%28pe%5Et%29%5Er%7D%7B%5B1-%281-p%29e%5Et%5D%5E%7Br%2B1%7D%7D+%5C%5C%26%3D%5Cfrac%7Br%28pe%5Et%29%5Er%7D%7B%5B1-%281-p%29e%5Et%5D%5E%7Br%2B1%7D%7D+%5Cend%7Balign%7D

equation?tex=%5Cbegin%7Balign%7D+M%27%27%28t%29%26%3D%5Cfrac%7Br%5E2%28pe%5Et%29%5Er%5B1-%281-p%29e%5Et%5D%5E%7Br%2B1%7D%2Bre%5Et%28r%2B1%29%281-p%29%28pe%5Et%29%5Er%5B1-%281-p%29e%5Et%5D%5Er%7D%7B%5B1-%281-p%29e%5Et%5D%5E%7B2r%2B2%7D%7D+%5C%5C%26%3D%5Cfrac%7Br%5E2%28pe%5Et%29%5Er%5B1-%281-p%29e%5Et%5D%2Bre%5Et%28r%2B1%29%281-p%29%28pe%5Et%29%5Er%7D%7B%5B1-%281-p%29e%5Et%5D%5E%7Br%2B2%7D%7D+%5C%5C%26%3D%5Cfrac%7Br%5Br%2B%281-p%29e%5Et%5D%28pe%5Et%29%5Er%7D%7B%5B1-%281-p%29e%5Et%5D%5E%7Br%2B2%7D%7D+%5Cend%7Balign%7D

故:

equation?tex=E%28X%29%3DM%27%280%29%3D%5Cfrac%7Br%7D%7Bp%7D

equation?tex=%5Cbegin%7Balign%7D+Var%28X%29%26%3DM%27%27%280%29-M%27%5E2%280%29+%5C%5C%26%3D%5Cfrac%7Br%28r%2B1-p%29%7D%7Bp%5E2%7D-%5Cfrac%7Br%5E2%7D%7Bp%5E2%7D+%5C%5C%26%3D%5Cfrac%7Br%281-p%29%7D%7Bp%5E2%7D+%5Cend%7Balign%7D

当然,我们还可以把二项分布和负二项分布分别拆成若干次独立试验。

利用伯努利分布和几何分布

伯努利分布:可以看作二项分布中的单次试验,即

equation?tex=n%3D1

几何分布:可以看作负二项分布中

equation?tex=r%3D1的情况。

二项分布中的

equation?tex=n 次试验相互独立,因此可以看作

equation?tex=n 次相互独立的伯努利试验。

而单次伯努利试验的期望:

equation?tex=E%28X_i%29%3D1%5Ctimes+p%2B0%5Ctimes+%281-p%29%3Dp

方差:

equation?tex=Var%28X_i%29%3D%281-p%29%5E2p%2B%280-p%29%5E2%281-p%29%3Dp%281-p%29

所以二项分布的均值:

equation?tex=E%28Y%29%3D%5Csum_%7Bi%3D1%7D%5EnE%28X_i%29%3Dnp

方差:

equation?tex=%5Cbegin%7Balign%7D+Var%28Y%29%26%3DE%5Cleft%5C%7B%5BY-E%28Y%29%5D%5E2%5Cright%5C%7D+%5C%5C%26%3DE%5Cleft%5C%7B%5Cleft%5B%5Csum_%7Bi%3D1%7D%5EnX_i-%5Csum_%7Bi%3D1%7D%5EnE%28X_i%29%5Cright%5D%5E2%5Cright%5C%7D+%5C%5C%26%3DE%5Cleft%5C%7B%5Cleft%5B%5Csum_%7Bi%3D1%7D%5En%28X_i-E%28X_i%29%29%5Cright%5D%5E2%5Cright%5C%7D+%5C%5C%26%3DE%5Cleft%5C%7B%5Csum_%7Bi%3D1%7D%5En%5Csum_%7Bj%3D1%7D%5En%5BX_i-E%28X_i%29%5D%5BX_j-E%28X_j%29%5D%5Cright%5C%7D+%5C%5C%26%3D%5Csum_%7Bi%3D1%7D%5En%5Csum_%7Bj%3D1%7D%5EnE%5Cleft%5C%7B%5BX_i-E%28X_i%29%5D%5BX_j-E%28X_j%29%5D%5Cright%5C%7D+%5C%5C%26%3D%5Csum_%7Bi%3D1%7D%5E%7Bn-1%7D%5Csum_%7Bj%3Di%2B1%7D%5EnE%5BX_i-E%28X_i%29%5DE%5BX_j-E%28X_j%29%5D+%5C%5C%26%2B%5Csum_%7Bi%3D1%7D%5EnE%5Cleft%5C%7B%5BX_i-E%28X_i%29%5D%5E2%5Cright%5C%7D+%5C%5C%26%3D%5Csum_%7Bi%3D1%7D%5EnE%5Cleft%5C%7B%5BX_i-E%28X_i%29%5D%5E2%5Cright%5C%7D+%5C%5C%26%3D%5Csum_%7Bi%3D1%7D%5EnVar%28X_i%29+%5C%5C%26%3Dnp%281-p%29+%5Cend%7Balign%7D

同理,我们计算几何分布的均值:

equation?tex=E%28X_i%29%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+xp%281-p%29%5E%7Bx-1%7D

equation?tex=%281-p%29E%28X_i%29%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+xp%281-p%29%5Ex

两式相减:

equation?tex=pE%28X_i%29%3Dp%2B%5Csum_%7Bx%3D1%7D%5E%5Cinfty+p%281-p%29%5Ex

则:

equation?tex=E%28X_i%29%3D1%2B%5Csum_%7Bx%3D1%7D%5E%5Cinfty%281-p%29%5Ex%3D%5Cfrac%7B1%7D%7Bp%7D

计算方差前,计算

equation?tex=E%28X_i%5E2%29

equation?tex=E%28X_i%5E2%29%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2p%281-p%29%5E%7Bx-1%7D

equation?tex=q%3D1-p,则:

equation?tex=%5Cbegin%7Balign%7D+E%28X_i%5E2%29%26%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2%281-q%29q%5E%7Bx-1%7D+%5C%5C%26%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2q%5E%7Bx-1%7D-%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2q%5Ex+%5Cend%7Balign%7D

equation?tex=f%28q%29%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2q%5E%7Bx-1%7D

则:

equation?tex=%5Cint+f%28q%29dq%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+xq%5Ex%2BC

错位相减得:

equation?tex=%5Csum_%7Bx%3D1%7D%5E%5Cinfty+xq%5Ex%3D%5Cfrac%7B1%7D%7B1-q%7D%5Cleft%28q%2B%5Cfrac%7Bq%5E2%7D%7B1-q%7D%5Cright%29%3D%5Cfrac%7Bq%7D%7B%281-q%29%5E2%7D

则:

equation?tex=f%28q%29%3D%5Cfrac%7B1%2Bq%7D%7B%281-q%29%5E3%7D

而对于

equation?tex=%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2q%5Ex ,我们将其拆成:

equation?tex=%5Csum_%7Bx%3D1%7D%5E%5Cinfty+%28x%2B1%29%5E2q%5Ex-%5Csum_%7Bx%3D1%7D%5E%5Cinfty+2xq%5Ex-%5Csum_%7Bx%3D1%7D%5E%5Cinfty+q%5Ex

equation?tex=g%28q%29%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+%28x%2B1%29%5E2q%5Ex

equation?tex=%5Cint+g%28q%29dq%3D%5Csum_%7Bx%3D1%7D%5E%5Cinfty+%28x%2B1%29q%5E%7Bx%2B1%7D%2BC

错位相减得:

equation?tex=%5Csum_%7Bx%3D1%7D%5E%5Cinfty%28x%2B1%29q%5E%7Bx%2B1%7D%3D%5Cfrac%7B1%7D%7B1-q%7D%5Cleft%282q%5E2%2B%5Cfrac%7Bq%5E3%7D%7B1-q%7D%5Cright%29%3D%5Cfrac%7B2q%5E2-q%5E3%7D%7B%281-q%29%5E2%7D

则:

equation?tex=g%28q%29%3D%5Cfrac%7Bq%28q%5E2-3q%2B4%29%7D%7B%281-q%29%5E3%7D

equation?tex=%5Csum_%7Bx%3D1%7D%5E%5Cinfty+x%5E2q%5Ex%3D%5Cfrac%7Bq%5E2%2Bq%7D%7B%281-q%29%5E3%7D

所以

equation?tex=E%28X_i%5E2%29%3D%5Cfrac%7B1-q%5E2%7D%7B%281-q%29%5E3%7D%3D%5Cfrac%7B2-p%7D%7Bp%5E2%7D

那么

equation?tex=Var%28X_i%29%3DE%28X_i%5E2%29-%5BE%28X_i%29%5D%5E2%3D%5Cfrac%7B1-p%7D%7Bp%5E2%7D

那么负二项分布的均值与方差为:

equation?tex=E%28Y%29%3DrE%28X_i%29%3D%5Cfrac%7Br%7D%7Bp%7D%2CVar%28Y%29%3DrVar%28X_i%29%3D%5Cfrac%7Br%281-p%29%7D%7Bp%5E2%7D



【本文地址】


今日新闻


推荐新闻


CopyRight 2018-2019 办公设备维修网 版权所有 豫ICP备15022753号-3