Gensim is an open-source vector space and topic modelling toolkit. It is implemented in Python and uses NumPy & SciPy. It also uses Cython for performance.
Gensim是一个开源矢量空间和主题建模工具包。 它在Python中实现,并使用NumPy和SciPy 。 它还使用Cython来提高性能。
1. Python Gensim模块 (1. Python Gensim Module)
Gensim is designed for data streaming, handle large text collections and efficient incremental algorithms or in simple language – Gensim is designed to extract semantic topics from documents automatically in the most efficient and effortless manner.
Gensim设计用于数据流传输,处理大型文本集和高效的增量算法或使用简单的语言-Gensim设计用于以最高效,最轻松的方式自动从文档中提取语义主题。
This actually differentiates it from others as most of them only target in-memory and batch processing. At the core of Gensim unsupervised algorithms such as Latent Semantic Analysis, Latent Dirichlet Allocation examines word statistical co-occurrence patterns within a corpus of training documents to discover the semantic structure of documents.
实际上,这与其他产品有所区别,因为其中大多数仅针对内存和批处理。 作为Gensim无监督算法(例如潜在语义分析)的核心,潜在狄利克雷分配检查了一组训练文档中的单词统计共现模式,以发现文档的语义结构。
2.为什么使用Gensim? (2. Why use Gensim?)
Gensim has various features, which give it an edge over other scientific packages, like:
Gensim具有各种功能,使其比其他科学软件包更具优势,例如:
- Memory independent – You don’t need the whole training corpus to reside in RAM