L1正则:参数绝对值的和 L 2正则:参数的平方和(Pytorch自带,weight_decay) op = torch.optim.SGD(model.parameters(), lr=0.001, weight_decay=0.001)