keras fit的sample_weight

40 篇文章 0 订阅
34 篇文章 0 订阅

fit根据loss函数算出梯度,sample_weight对每一个sample的梯度乘以对应的weight

import tensorflow as tf
from tensorflow import keras
from keras.layers import *
import numpy as np

tf.random.set_seed(1)
np.random.seed(1)

x_input = Input(shape=(None, 1))
y_input = Input(shape=(None, 1))

ki = keras.initializers.Constant(value=2)
bi = keras.initializers.Constant(value=-1)
y = Dense(1, kernel_initializer=ki, bias_initializer=bi)(x_input)


def myloss(yt, yp):
    return yt - yp

opt = tf.compat.v1.train.GradientDescentOptimizer(1)

m = keras.models.Model(inputs=[x_input, y_input], outputs=y)
m.compile(loss=myloss, optimizer=opt)

x_pure = np.random.randint(1, 4, 1).astype(np.float).reshape(-1, 1)
x_train = x_pure
y_train = 3 * x_pure + 2
print('data:', x_train, y_train)
print(m.trainable_weights, '>>>')

# y-wx-b >> dw=-x,db=-1
with tf.GradientTape() as tape:
    loss = myloss(y_train, m([x_train, y_train]))
grads = tape.gradient(loss, m.trainable_weights)
print('grads', grads)

# (w,b)=(2,-1)  grads=(-2,-1)
# 没有sample_weight时,(w,b)=(w,b)-grads=(4,0)
# m.fit(x=[x_train, y_train], y=y_train, verbose=1, epochs=1, shuffle=False)
# sample_weight=(3)时,(w,b)=(w,b)-grads*(3)=(8,-2)
m.fit(x=[x_train, y_train], y=y_train, verbose=1, epochs=1,shuffle=False,sample_weight=[np.array([3])])

# trainable_weights返回tensor的list, get_weights返回np.array的list
print(m.trainable_weights, '>>>')
print(m.get_weights(), '>>>')

testdata = np.arange(3).reshape(-1, 1)
print(m.predict([testdata, testdata]))
  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值