模型损失集合

最新推荐文章于 2024-06-14 15:00:00 发布

duoyasong5907

最新推荐文章于 2024-06-14 15:00:00 发布

阅读量171

点赞数 2

文章标签：深度学习机器学习人工智能

本文链接：https://blog.csdn.net/duoyasong5907/article/details/139332717

版权

EVA-02

pretrain

def compute_loss(output, label):
    loss_func = nn.CosineSimilarity(dim=-1)
    loss = loss_func(output.float(), label.float())
    return -loss.mean()

finetune

if mixup_fn is not None:
    # smoothing is handled with mixup label transform
    criterion = SoftTargetCrossEntropy()
elif args.smoothing > 0.:
    criterion = LabelSmoothingCrossEntropy(smoothing=args.smoothing)
else:
    criterion = torch.nn.CrossEntropyLoss() # linear