CppJieba

最新推荐文章于 2024-08-08 07:51:54 发布

lvan哇

最新推荐文章于 2024-08-08 07:51:54 发布

阅读量761

点赞数

分类专栏： c++ 文章标签： c++ 开发语言

本文链接：https://blog.csdn.net/qq_45470918/article/details/125462380

版权

CppJieba是C++版本的Jieba中文分词库，提供了在线和离线下载方式。通过jieba.cut()函数进行分词，支持HMM算法。附带词典文件，如dict(utf8编码)、idf(权重信息)和hmm_model(隐式马尔科夫模型)。

摘要由CSDN通过智能技术生成

GitHub地址：https://github.com/yanyiwu/cppjieba

简介

CppJieba是"结巴(Jieba)"中文分词的C++版本

使用方法

在线下载 or 离线下载

git clone https://github.com/yanyiwu/cppjieba.git

头文件

guanhj@guanhj-virtual-machine:~/cppjb/cppjieba$ ls
appveyor.yml  build  ChangeLog.md  CMakeLists.txt  deps  dict  include	README_EN.md  README.md  test
guanhj@guanhj-virtual-machine:~/cppjb/cppjieba$ cd include/
guanhj@guanhj-virtual-machine:~/cppjb/cppjieba/include$ tree
.
└── cppjieba
    ├── DictTrie.hpp
    ├── FullSegment.hpp
    ├── HMMModel.hpp
    ├── HMMSegment.hpp
    ├── Jieba.hpp
    ├── KeywordExtractor.hpp
    ├── limonp
    │   ├── ArgvContext.hpp
    │   ├── BlockingQueue.hpp
    │   ├── BoundedBlockingQueue.hpp
    │   ├── BoundedQueue.hpp
    │   ├── Closure.hpp
    │   ├── Colors.hpp
    │   ├── Condition.hpp
    │   ├── Config.hpp
    │   ├── FileLock.hpp
    │   ├── ForcePublic.hpp
    │   ├── LocalVector.hpp
    │   ├── Logging.hpp
    │   ├── Md5.hpp
    │   ├── MutexLock.hpp
    │   ├── NonCopyable.hpp
    │   ├── StdExtension.hpp
    │   ├── StringUtil.hpp
    │   ├── Thread.hpp
    │   └── ThreadPool.hpp
    ├── MixSegment.hpp
    ├── MPSegment.hpp
    ├── PosTagger.hpp
    ├── PreFilter.hpp
    ├── QuerySegment.hpp
    ├── SegmentBase.hpp
    ├── SegmentTagged.hpp
    ├── TextRankExtractor.hpp
    ├── Trie.hpp
    └── Unicode.hpp

2 directories, 35 files

测试文件

guanhj@guanhj-virtual-machine:~/cppjb/cppjieba$ ls
appveyor.yml  build  ChangeLog.md  CMakeLists.txt  deps  dict  include	README_EN.md  README.md  test
guanhj@guanhj-virtual-machine:~/cppjb/cppjieba$ cd test
guanhj@guanhj-virtual-machine:~/cppjb/cppjieba/test$ ls
CMakeLists.txt	demo.cpp  load_test.cpp  testdata  unittest

demo.cpp

###重要！

1 #include "../include/cppjieba/Jieba.hpp"                                                                                                            
    2 
    3 using namespace std;
    4 
    5 const char* const DICT_PA