batchnorm

最新推荐文章于 2022-10-10 18:59:36 发布

平凡的兵

最新推荐文章于 2022-10-10 18:59:36 发布

阅读量514

点赞数

分类专栏：机器学习语音识别

本文链接：https://blog.csdn.net/chinabing/article/details/78858304

版权

机器学习同时被 2 个专栏收录

23 篇文章 0 订阅

订阅专栏

语音识别

17 篇文章 2 订阅

订阅专栏

相关公式

NCNN代码

int BatchNorm::forward_inplace(Mat& bottom_top_blob) const
{
    // a = bias - slope * mean / sqrt(var)
    // b = slope / sqrt(var)
    // value = b * value + a

    int w = bottom_top_blob.w;
    int h = bottom_top_blob.h;
    int size = w * h;

    const float* a_data_ptr = a_data;
    const float* b_data_ptr = b_data;
    #pragma omp parallel for
    for (int q=0; q<channels; q++)
    {
        float* ptr = bottom_top_blob.channel(q);

        float a = a_data_ptr[q];
        float b = b_data_ptr[q];

        for (int i=0; i<size; i++)
        {
            ptr[i] = b * ptr[i] + a;
        }
    }

    return 0;
}

参考资料

[1] Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
[2] https://github.com/Tencent/ncnn