Hands-On Machine Learning with Scikit-Learn & TensorFlow Exercise Q&A Chapter02

For some unknown reason, my computer's Scikit-Learn package cannot deal with the ColumnTransformer function, so I never succeed in getting the housing_prepared data, thus the following answer is official answers and results.

 

Q1. Try a Support Vector Machine regressor (sklearn.svm.SVR), with various hyperparameters such as kernel="linear" (with various values for the C hyperparameter) or kernel="rbf" (with various values for the C and gamma hyperparameters) . Don't worry about what these hyperparameters mean for now. How does the best SVR predictor perform?

A1:

model:

from sklearn.model_selection import GridSearchCV

param_grid = [
        {'kernel': ['linear'], 'C': [10., 30., 100., 300., 1000., 3000., 10000., 30000.0]},
        {'kernel': ['rbf'], 'C': [1.0, 3.0, 10., 30., 100., 300., 1000.0],
         'gamma': [0.01, 0.03, 0.1, 0.3, 1.0, 3.0]},
    ]

svm_reg = SVR()
grid_search = GridSearchCV(svm_reg, param_grid, cv=5, scoring='neg_mean_squared_error', verbose=2, n_jobs=4)
grid_search.fit(housing_prepared, housing_labels)

evaluate:

negative_mse = grid_search.best_score_
rmse = np.sqrt(-negative_mse)
rmse
grid_search.best_params_

result:

 

Q2. Try replacing GridSearchCV with RandomizedSearchCV.

A2:

model: