逻辑回归 (Logistic Regression)

逻辑回归 (Logistic Regression)

​ Logistic Regression

数据集 | 社交网络 (The DataSet | Social Network )

​ DataSet

This dataset contains information of users in a social network. Those informations are the user id the gender the age and the estimated salary. A car company has just launched their brand new luxury SUV. And we’re trying to see which of these users of the social network are going to buy this brand new SUV And the last column here tells If yes or no the user bought this SUV we are going to build a model that is going to predict if a user is going to buy or not the SUV based on two variables which are going to be the age and the estimated salary. So our matrix of feature is only going to be these two columns.
We want to find some correlations between the age and the estimated salary of a user and his decision to purchase yes or no the SUV.

Step 1 | 数据预处理 (Data Pre-Processing)

Importing the Libraries

import numpy as np
import matplotlib.pyplot as plt
import pandas as pd

Importing the dataset

Get the dataset from here

dataset = pd.read_csv('Social_Network_Ads.csv')
X = dataset.iloc[:, [2, 3]].values
y = dataset.iloc[:, 4].values

Splitting the dataset into the Training set and Testing set

from sklearn.cross_validation import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size = 0.25, random_state = 0)

Feature Scaling

from sklearn.preprocessing import StandardScaler
sc = StandardScaler()
X_train = sc.fit_transform(X_train)
X_test = sc.transform(X_test)

Step 2 | 逻辑回归模型 (Logistic Regression Model)

The library for this job which is going to be the linear model library and it is called linear because the logistic regression is a linear classifier which means that here since we’re in two dimensions, our two categories of users are going to be separated by a straight line. Then import the logistic regression class.
Next we will create a new object from this class which is going to be our classifier that we are going to fit on our training set.

Fitting Logistic Regression to the Training set

from sklearn.linear_model import LogisticRegression
classifier = LogisticRegression()
classifier.fit(X_train, y_train)

Step 3 | 预测 (Prediction)

Predicting the Test set results

y_pred = classifier.predict(X_test)

Step 4 | 评估预测 (Evaluating The Prediction)

We predicted the test results and now we will evaluate if our logistic regression model learned and understood correctly.
So this confusion matrix is going to contain the correct predictions that our model made on the set as well as the incorrect predictions.

Making the Confusion Matrix

from sklearn.metrics import confusion_matrix
cm = confusion_matrix(y_test, y_pred)

可视化 (Visualization)

​ Training Visualization

​ Testing Visualization