过拟合、欠拟合及其解决方案;
过拟合、欠拟合的概念
权重衰减
丢弃法
梯度消失、梯度爆炸;
用房价预测的例子体现:
关于房价的预测,定义这个预测函数
def train_and_pred(train_features, test_features, train_labels, test_data,
num_epochs, lr, weight_decay, batch_size):
net = get_net(train_features.shape[1])
train_ls, _ = train(net, train_features, train_labels, None, None,
num_epochs, lr, weight_decay, batch_size)
d2l.semilogy(range(1, num_epochs + 1), train_ls, ‘epochs’, ‘rmse’)
print(‘train rmse %f’ % train_ls[-1])
preds = net(test_features).detach().numpy()
test_data[‘SalePrice’] = pd.Series(preds.reshape(1, -1)[0])
submission = pd.concat([test_data[‘Id’], test_data[‘SalePrice’]], axis=1)
submission.to_csv(’./submission.csv’, index=False)
# sample_submission_data = pd.read_csv("…/input/house-prices-advanced-regression-techniques/sample_submission.