解决module ‘tensorflow_datasets.core.features‘ has no attribute ‘text‘

问题描述

在TensorFlow官网学习加载文本的例子，执行tokenizer = tfds.features.text.Tokenizer()代码出现如下问题：

AttributeError                            Traceback (most recent call last)
<ipython-input-20-6f949be18afd> in <module>()
----> 1 tokenizer = tfds.features.text.Tokenizer()
      2 
      3 vocabulary_set = set()
      4 for text_tensor, _ in all_labeled_data:
      5   some_tokens = tokenizer.tokenize(text_tensor.numpy())

AttributeError: module 'tensorflow_datasets.core.features' has no attribute 'text'

问题解决

这是因为一些方法已被弃用，换用tfds.deprecated.text.Tokenizer来创建tokenizer对象。

参考文献

github
tensorflow官网