DeepFM：用预训练权重去初始化embedding weights和frozen embedding weights

最新推荐文章于 2024-07-01 15:10:35 发布

Echo-z

最新推荐文章于 2024-07-01 15:10:35 发布

阅读量866

点赞数 1

分类专栏：深度学习文章标签：深度学习

本文链接：https://blog.csdn.net/weixin_39948381/article/details/114691375

版权

深度学习专栏收录该内容

6 篇文章 0 订阅

订阅专栏

Use tf.initializers.identity() to set the embeddings_initializer of SparseFeat,and set trainable=False to frozen embedding weights.

import numpy as np
import tensorflow as tf
from deepctr.models import DeepFM
from deepctr.feature_column import SparseFeat,get_feature_names

pretrained_item_weights = np.random.randn(60,4)
pretrained_weights_initializer = tf.initializers.identity(pretrained_item_weights)

feature_columns = [SparseFeat('user_id',120,),SparseFeat('item_id',60,embedding_dim=4,embeddings_initializer=pretrained_weights_initializer,trainable=False)]
fixlen_feature_names = get_feature_names(feature_columns)

user_id = np.array([[1],[0],[1]])
item_id = np.array([[30],[20],[10]])
label = np.array([1,0,1])

model_input = {'user_id':user_id,'item_id':item_id,}

model = DeepFM(feature_columns,feature_columns)
model.compile('adagrad','binary_crossentropy')
model.fit(model_input,label)

END

----------------------------------------------------------------

欢迎关注我的公众号！