Anscombe's quartet

Part 1

For each of the four datasets…

Compute the mean and variance of both x and y
Compute the correlation coefficient between x and y
Compute the linear regression line: y=β0+β1x+ϵ (hint: use statsmodels and look at the Statsmodels notebook)

Part 2

Using Seaborn, visualize all four datasets.

hint: use sns.FacetGrid combined with plt.scatter

代码实现如下:

import random

import numpy as np
import scipy as sp
import pandas as pd
import matplotlib.pyplot as plt
import seaborn as sns

import statsmodels.api as sm
import statsmodels.formula.api as smf

anascombe = pd.read_csv('anscombe.csv')

print('The mean value of x and y:')
print(anascombe.groupby('dataset').mean())

print('\nThe variance of x and y:')
print(anascombe.groupby('dataset').var())

print('\nThe correlation coefficient of x and y:')
print(anascombe.groupby('dataset')['x', 'y'].corr())

# df.loc[df['column_name'] == some_value]

ax = anascombe.loc[anascombe['dataset'] == 'I'].plot('x', 'y', kind='scatter', color='red', label='I')
anascombe.loc[anascombe['dataset'] == 'II'].plot('x', 'y', kind='scatter', color='orange', ax=ax, label='II')
anascombe.loc[anascombe['dataset'] == 'III'].plot('x', 'y', kind='scatter', color='yellow', ax=ax, label='III')
anascombe.loc[anascombe['dataset'] == 'IV'].plot('x', 'y', kind='scatter', color='cyan', ax=ax, label='IV')

lm = smf.ols("y~x", data=anascombe).fit()
xmin = anascombe['x'].min()
xmax = anascombe['x'].max()
X = np.linspace(xmin, xmax, 1000)
Y = lm.params[0] + lm.params[1] * X
plt.legend(loc=2, ncol=4)
plt.plot(X, Y, color='blue')
plt.show()

g = sns.FacetGrid(anascombe, col="dataset")
g = g.map(plt.scatter, "x", "y", edgecolor="w")
plt.show()

输出如下:

The mean value of x and y:
           x         y
dataset               
I        9.0  7.500909
II       9.0  7.500909
III      9.0  7.500000
IV       9.0  7.500909

The variance of x and y:
            x         y
dataset                
I        11.0  4.127269
II       11.0  4.127629
III      11.0  4.122620
IV       11.0  4.123249

The correlation coefficient of x and y:
                  x         y
dataset                      
I       x  1.000000  0.816421
        y  0.816421  1.000000
II      x  1.000000  0.816237
        y  0.816237  1.000000
III     x  1.000000  0.816287
        y  0.816287  1.000000
IV      x  1.000000  0.816521
        y  0.816521  1.000000

Process finished with exit code 0

其中输出的图像分别为: