WordNet 中的synset和synsets的区别

LawsonAbs的认知与思考,还请各位读者批判阅读。

总结

  • 文章来源:csdn:LawsonAbs
  • 更多代码见我Github

1.问题

使用wordnet 时,会碰到 wn.synsets(…) 和 wn.synset(…) ,这两者有什么区别呢?见下例:

from nltk.corpus import wordnet as wn
bank1 = wn.synsets('bank')  #得到与bank所有的同义词
print(bank1)

bank2 =wn.synsets('bank.n.01')   #把 bank.n.01 作为一个单词,然后找它的同义词,当然没有啦
print(bank2) # 结果是:[] 。

bank3 = wn.synset('bank.n.01') # 这是找到 bank.n.01 这个词,所以可以输出
print(bank3)

执行结果:
在这里插入图片描述

bank4 = wn.synset('bank') # 这是找到 bank.n.01 这个词,所以可以输出
print(bank4)

就会得到程序报错:
在这里插入图片描述

2

具体总结下来就是:
synsets + (普通单词)
synset + (wordnet中的sensekey)

WordNet算法和Lesk算法都是用于英文消歧义的算法,它们可以帮助我们确定一个单词在特定上下文的含义。下面是两种算法的Python实现: 1. WordNet算法实现: ``` from nltk.corpus import wordnet def wordnet_disambiguate(word, sentence): # 获取单词的同义词集 synsets = wordnet.synsets(word) best_sense = None max_overlap = 0 context = set(sentence) for synset in synsets: # 获取同义词集的定义和例句 definition = set(synset.definition().split()) examples = set(" ".join(synset.examples()).split()) # 计算上下文与定义和例句的重叠度 overlap = len(context.intersection(definition)) + len(context.intersection(examples)) # 选择最佳的同义词集 if overlap > max_overlap: max_overlap = overlap best_sense = synset return best_sense.definition() sentence = "I went to the bank to deposit my money." word = "bank" print(wordnet_disambiguate(word, sentence.split())) ``` 2. Lesk算法实现: ``` from nltk.corpus import wordnet from nltk.corpus import stopwords def lesk_disambiguate(word, sentence): # 获取单词的同义词集 synsets = wordnet.synsets(word) best_sense = None max_overlap = 0 context = set(sentence) for synset in synsets: # 获取同义词集的定义和例句 definition = set(synset.definition().split()) examples = set(" ".join(synset.examples()).split()) # 去除停用词 stop_words = set(stopwords.words('english')) definition = definition.difference(stop_words) examples = examples.difference(stop_words) # 计算上下文与定义和例句的重叠度 overlap = len(context.intersection(definition)) + len(context.intersection(examples)) # 选择最佳的同义词集 if overlap > max_overlap: max_overlap = overlap best_sense = synset return best_sense.definition() sentence = "I went to the bank to deposit my money." word = "bank" print(lesk_disambiguate(word, sentence.split())) ``` 这两种算法的实现过程大致相同,不同之处在于Lesk算法会去除停用词。在使用时只需传入待消歧义的单词和句子即可。
评论 3
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

说文科技

看书人不妨赏个酒钱?

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值