Jupyter Notebook Exercise

Jupyter Notebook Exercise

%matplotlib inline

import random

import numpy as np
import scipy as sp
import pandas as pd
import matplotlib.pyplot as plt
import seaborn as sns

import statsmodels.api as sm
import statsmodels.formula.api as smf

sns.set_context("talk")

Anscombe’s quartet

Anscombe’s quartet comprises of four datasets, and is rather famous. Why? You’ll find out in this exercise.

Input

anascombe = pd.read_csv('data/anscombe.csv')
anascombe.head()

Output

Part 1

For each of the four datasets:
- Compute the mean and variance of both x and y
- Compute the correlation coefficient between x and y
- Compute the linear regression line: y=β0+β1x+ϵ (hint: use statsmodels and look at the - Statsmodels notebook)

Compute Means

Input

anascombe.groupby('dataset').mean()

Output

Compute Variances

Input

anascombe.groupby('dataset').var()

Output

Compute Correlation Coefficients

Input

anascombe.groupby('dataset').corr()

Output

Compute Linear Regression Line of Dataset I

Input

dataset_one = anascombe[(anascombe['dataset']=='I')].reset_index(drop=True)  
result_one = smf.ols('y ~ x', dataset_one).fit()  
result_one.summary()

Output

Compute Linear Regression Line of Dataset II

Input

dataset_two = anascombe[(anascombe['dataset']=='II')].reset_index(drop=True)  
result_two = smf.ols('y ~ x', dataset_two).fit()  
result_two.summary()

Output

Compute Linear Regression Line of Dataset III

Input

dataset_three = anascombe[(anascombe['dataset']=='III')].reset_index(drop=True)  
result_three = smf.ols('y ~ x', dataset_three).fit()   
result_three.summary()

Output

Compute Linear Regression Line of Dataset IV

Input

dataset_four = anascombe[(anascombe['dataset']=='IV')].reset_index(drop=True)  
result_four = smf.ols('y ~ x', dataset_four).fit()    
result_four.summary() 

Output

Part Two

Using Seaborn, visualize all four datasets.
hint: use sns.FacetGrid combined with plt.scatter

Input

graph = sns.FacetGrid(anascombe, col="dataset", hue="dataset")  
graph.map(plt.scatter, "x", "y", marker='o' )  

Output