发现频繁项集FP-growth算法

              FP-growth算法只需要对数据库进行两次扫描,而Apriori算法对于每个潜在的频繁项集都会扫描数据集判断给定模式是否频繁,因此FP-growth算法的速度要比Apriori算法快。在小规模数据集上,这不是什么问题,但当处理更大数据集时,就会产生较大问题,但是FP-growth不能发现关联规则。

              发现频繁项集过程:(1)构建FP树(2)从FP树中挖掘频繁项集

              优点:一般要快于Apriori。缺点:实现比较困难,在某些数据集上性能会下降。适用数据类型:标称型数据。

class treeNode:
    def __init__(self, nameValue, numOccur, parentNode):
        self.name = nameValue
        self.count = numOccur
        self.nodeLink = None
        self.parent = parentNode      #needs to be updated
        self.children = {}  
    
    def inc(self, numOccur):
        self.count += numOccur
    
    def disp(self, ind=1):
        print '  '*ind, self.name, ' ', self.count # blank sum  ' '*ind ' '
        for child in self.children.values():
            child.disp(ind+1)
FP-growth树节点的数据结构

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
以下是使用Python实现FP-growth算法寻找频繁项集的示例代码: ```python class FPTreeNode: def __init__(self, item, count, parent): self.item = item self.count = count self.parent = parent self.children = {} self.nodeLink = None def inc(self, count): self.count += count def disp(self, ind=1): print(' ' * ind, self.item, ' ', self.count) for child in self.children.values(): child.disp(ind + 1) def createTree(dataSet, minSup=1): headerTable = {} for trans in dataSet: for item in trans: headerTable[item] = headerTable.get(item, 0) + dataSet[trans] for k in list(headerTable.keys()): if headerTable[k] < minSup: del (headerTable[k]) freqItemSet = set(headerTable.keys()) if len(freqItemSet) == 0: return None, None for k in headerTable: headerTable[k] = [headerTable[k], None] retTree = FPTreeNode('Null Set', 1, None) for tranSet, count in dataSet.items(): localD = {} for item in tranSet: if item in freqItemSet: localD[item] = headerTable[item][0] if len(localD) > 0: orderedItems = [v[0] for v in sorted(localD.items(), key=lambda p: p[1], reverse=True)] updateTree(orderedItems, retTree, headerTable, count) return retTree, headerTable def updateTree(items, inTree, headerTable, count): if items[0] in inTree.children: inTree.children[items[0]].inc(count) else: inTree.children[items[0]] = FPTreeNode(items[0], count, inTree) if headerTable[items[0]][1] is None: headerTable[items[0]][1] = inTree.children[items[0]] else: updateHeader(headerTable[items[0]][1], inTree.children[items[0]]) if len(items) > 1: updateTree(items[1:], inTree.children[items[0]], headerTable, count) def updateHeader(nodeToTest, targetNode): while nodeToTest.nodeLink is not None: nodeToTest = nodeToTest.nodeLink nodeToTest.nodeLink = targetNode def ascendTree(leafNode, prefixPath): if leafNode.parent is not None: prefixPath.append(leafNode.item) ascendTree(leafNode.parent, prefixPath) def findPrefixPath(basePat, treeNode): condPats = {} while treeNode is not None: prefixPath = [] ascendTree(treeNode, prefixPath) if len(prefixPath) > 1: condPats[frozenset(prefixPath[1:])] = treeNode.count treeNode = treeNode.nodeLink return condPats def mineTree(inTree, headerTable, minSup, preFix, freqItemList): bigL = [v[0] for v in sorted(headerTable.items(), key=lambda p: p[1])] for basePat in bigL: newFreqSet = preFix.copy() newFreqSet.add(basePat) freqItemList.append(newFreqSet) condPattBases = findPrefixPath(basePat, headerTable[basePat][1]) myCondTree, myHead = createTree(condPattBases, minSup) if myHead is not None: mineTree(myCondTree, myHead, minSup, newFreqSet, freqItemList) def loadSimpDat(): simpDat = [['r', 'z', 'h', 'j', 'p'], ['z', 'y', 'x', 'w', 'v', 'u', 't', 's'], ['z'], ['r', 'x', 'n', 'o', 's'], ['y', 'r', 'x', 'z', 'q', 't', 'p'], ['y', 'z', 'x', 'e', 'q', 's', 't', 'm']] return simpDat def createInitSet(dataSet): retDict = {} for trans in dataSet: retDict[frozenset(trans)] = 1 return retDict if __name__ == '__main__': simpDat = loadSimpDat() initSet = createInitSet(simpDat) myFPtree, myHeaderTab = createTree(initSet, 3) freqItems = [] mineTree(myFPtree, myHeaderTab, 3, set([]), freqItems) print(freqItems) ``` 这段代码首先定义了`FPTreeNode`类,表示FP树的节点。`createTree`函数用于创建FP树,它首先统计每个项在所有事务中出现的频率,然后删除不满足最小支持度的项,最后以每个事务中的项作为键,频率作为值,构建FP树。`updateTree`函数用于向FP树中插入新事务。`updateHeader`函数用于更新每个项的链表,方便后续查找。`ascendTree`函数用于回溯FP树,生成条件模式基。`findPrefixPath`函数用于查找指定项的条件模式基。`mineTree`函数用于递归地挖掘FP树,生成频繁项集。`loadSimpDat`函数用于加载测试数据,`createInitSet`函数用于将数据集转换为字典格式。在主程序中,我们使用测试数据集构建FP树,并使用`mineTree`函数挖掘频繁项集

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值