Weak relationships

Strong linear relationships always correspond to correlation coefficients of +1 or –1. Weak relationships usually (but not always) result in correlation coefficients near zero.

Correlation of independent variables

If two random variables, \(X\) and \(Y\), are independent

\[ \Corr(X,Y) \;=\; 0 \]

(Proved in full version)

Note that we have not proved that two variables must be independent if their correlation is zero. It is possible to define joint distributions in which the variables are strongly related but their correlation is zero.

Nonlinear relationship

Consider a discrete random variable \(X\) whose distribution is symmetric around zero. We now define a second random variable as \(Y = X^2\). The variables \(X\) and \(Y\) are strongly related — knowing the value of \(X\) tells you the exact value of \(Y\) — but

\[ \Corr(X,Y) \;=\; 0 \]

(Proved in full version)

It is important to remember that:

Independent variables have zero correlation, but variables with zero correlation are not necessarily independent.