keras RAdam优化器使用教程， keras加载模型包含自定义优化器报错 如何解决？

本文首发于个人博客https://kezunlin.me/post/c691f02b/，欢迎阅读最新内容！

python keras RAdam tutorial and load custom optimizer with CustomObjectScope

RAdam

usage

import keras
import numpy as np
from keras_radam import RAdam

# Build toy model with RAdam optimizer
model = keras.models.Sequential()
model.add(keras.layers.Dense(input_shape=(17,), units=3))
model.compile(RAdam(), loss='mse')

# Generate toy data
x = np.random.standard_normal((4096 * 30, 17))
w = np.random.standard_normal((17, 3))
y = np.dot(x, w)

# Fit
model.fit(x, y, epochs=5)

use warmup

from keras_radam import RAdam

RAdam(total_steps=10000, warmup_proportion=0.1, min_lr=1e-5)

load custom op