Shannon 信息熵:python_code

最新推荐文章于 2023-12-27 03:18:45 发布

Maro_13th

最新推荐文章于 2023-12-27 03:18:45 发布

阅读量653

点赞数

分类专栏： python算法文章标签： python

本文链接：https://blog.csdn.net/Maro_13th/article/details/78410516

版权

python算法专栏收录该内容

7 篇文章 0 订阅

订阅专栏

信息熵

代码来源于《机器学习》

     from math import log
import numpy as np
def calcShannonEnt(dataset):
    numEntries =len(dataset)
    labelCounts = {}
    for favocter in dataset:
        setkeys = favocter[-1]
        # print(setkeys)
        if setkeys not in labelCounts.keys():
            labelCounts[setkeys] = 0
        labelCounts[setkeys] +=1
        # print(labelCounts)
    shnnoy = 0.0
    for key in labelCounts.keys():
        prop = float(labelCounts[key])/numEntries
        shnnoy -=prop * log(prop,2)
    return  (shnnoy)

if __name__== '__main__':
    df=np.array([[1,1],[1,1],[1,2],[1,2],[1,1]])
    shon = calcShannonEnt(df)
    print(shon)