PIC

Let f (x)  be the pdf of X,  hence from definition of expected value of a random variable we write

         ∫ ∞
E (X ) =      xf (x )dx
          − ∞

Now break the integral into the sum of integrals as follows

              ∫ ξ−δ            ∫ ξ             ∫ ξ+ δ           ∫  ξ+2δ
E (X ) = ⋅⋅ ⋅ +    xf (x )dx +      xf (x )dx +       xf (x)dx +        xf (x)dx + ⋅⋅⋅
               ξ−2δ             ξ−δ             ξ                 ξ+ δ

In the limit, as δ  is made very small, the above can be written as Riemann sums of areas each of width dx →  δ  as follows

pict

But due to symmetry around ξ  then

f (ξ − iδ) = f (ξ + iδ)

for any integer i  in the above Riemann sum. This causes terms to cancel in the equation (1) above.

For example the term − δf (ξ − δ)  onthe left of the ξf
  ξ  will cancel with the term + δf (ξ − δ)  on the right of ξfξ  , and so on. Then we obtain the following sum

E (X ) = δ[⋅⋅⋅ + ξf (ξ − 2δ) +  ξf (ξ − δ) +  ξfξ +  ξf (ξ + δ) + ξf  (ξ + 2δ) + ⋅⋅⋅]

Take ξ  as common factor

E (X ) = ξδ [⋅⋅⋅ + ξf (ξ − 2δ) +  ξf (ξ − δ) +   ξfξ +  ξf (ξ + δ) + ξf  (ξ + 2δ)  + ⋅⋅⋅]
(2)

But

δ[⋅⋅⋅ + ξf (ξ − 2δ) +  ξf (ξ − δ) +   ξfξ +  ξf (ξ + δ ) + ξf (ξ + 2δ)  + ⋅⋅⋅]

is just the total area under f (x)  in the Riemann sum sense i.e. ∫ ∞
 − ∞ f (x )dx  .

Hence (2) becomes

          ∫  ∞
E (X ) = ξ     f (x)dx
            −∞

But since f (x)  is a density, this area is one. Hence

|----------|
E-(X-)-=-ξ--

PIC

The density function of an exponential distribution with parameter λ  is given by

        {    −λx
f (x) =    λe       x ≥ 0
             0      x < 0

First find the expected values of an exponential random variable X.  From definition of expected value:

pict

integrate by parts gives

pict

Hence           1
E (X ) =  λ  , Hence we need to find        (||     1||   2)
Δ  = P   X  − λ  > λ , But this is the same as finding

pict

Now compare to Chebyshev bound. Chebyshev bound says that

                        Var (X )
P  (|X  − E (X )| ≥ t) ≤  ----2----
                           t
(1)

Hence the upper bound by Chebyshev is V-ar(X)
 (2λ)2   . We now need to find V ar(X )  and this is given by

             (   )
Var (X ) = E  X2   − [E  (X  )]2

But

pict

so

pict

Hence (1) becomes

  (                  )    1-   |----|
P   |X − E  (X )| ≥ 2-  ≤  λ2-= -0.25-
                   λ      4λ2

Hence an upper bound for the probability by Chebyshev is 0.25  , and the actual probability found was 0.049787  which is well within this bound.

PIC

Let     ∑∞
Δ =      P (X ≥  K )
     k=1  , we need to show that this equals E (X )

pict

But

P (X  ≥ 1) = P (X  = 1) + P (X  = 2) + P (X  = 3) + ⋅⋅⋅

and

P (X  ≥ 2) = P (X  = 2) + P (X  = 3) + P (X  = 4) + ⋅⋅⋅

and

P (X  ≥ 3) = P (X  = 3) + P (X  = 4) + P (X  = 5) + ⋅⋅⋅

and so on. Hence adding all the above we obtain repeated terms, which comes out as follows

pict

But this is the definition of E (X )  , hence Δ =  E (X )

PIC

X  is Number of trials needed to obtain r  successes, Each trial has p  chance of success.

Let Y1   be a random variable which represents the number of trials to obtain a success (counting the success trial) (This will be the first success).

Let Y
 2   be a random variable which represents the number of trials to obtain a success (this will be the second success so far)

Let Y3   be a random variable which represents the number of trials to obtain a success (this will be the third success so far)

and so on. Hence

Let Y
 i  be a random variable which represents the number of trials to obtain the ith  success.

Therefore

pict

Hence

pict

But a Geometric r.v. represents the number of trials needed to obtain a success (counting the success trial), with each trial having p chance of success. So we need to find E (Y )  where Y  is a Geometric r.v. with parameters p

         ∑∞
E (Y ) =    kP  (X  = K  )
         k=1

But

P (Y =  K ) = p (1 − p)k

Hence

pict

Substitute (2) into (1)

pict

PIC

        ----Cov-(U,V-)-----
ρU,V =  ∘ -----------------
          V ar(U )V ar (V )
(1)

But

Cov (U,V ) = E (U V ) − E (U )E (V )

and

pict

and

pict

so

Cov  (U,V ) = E [(a + bX  )(c + dY )] − [a + bE (X )][c + dE (Y )]
(2)

and

Var (U ) = Var (a + bX ) = b2Var (X )
(3)

and

V ar(V ) = V ar(c + dY ) = d2V ar(Y )
(4)

Substitute (2),(3),(4) into (1) we obtain

pict

Now cancel bd  term. So depending if bd < 0  or bd > 0  we obtain − ρX,Y  or + ρX,Y

Hence if we consider absolute sign of bd  we write

|ρU,V| = |ρX,Y |