【Boost】tokenizeri库

Tokenizer 类
  template <class TokenizerFunc = char_delimiters_separator<char>,
  class Iterator = std::string::const_iterator,
  class Type = std::string>
  class tokenizer
  其中TokenizerFunc为用于分解的函数对象，Iterator为访问该序列的迭代器类型，Type为字符串类型。

 

不说废话，直接贴代码。

例子1：

#include <string> #include <boost/lexical_cast.hpp> #include <boost/tokenizer.hpp> #include <iostream> void main() { std::string s = "Hello ! boost, I love you."; boost::tokenizer<> tok(s); // 默认用空格和标点分开 for (boost::tokenizer<>::iterator iter = tok.begin(); iter != tok.end(); ++iter) { std::cout<<*iter<<std::endl; } }

 

输出：

Hello
boost
I
love
you

 

例子2：

#include <string> #include <boost/lexical_cast.hpp> #include <boost/tokenizer.hpp> #include <iostream> void main() { std::string s = ";;Hello|world||-foo--bar;yow;baz|"; boost::char_separator<char> sep(";|-"); // 使用boost::char_separator<char> 的分解函数对象 boost::tokenizer<boost::char_separator<char>> tok(s, sep); for (boost::tokenizer<boost::char_separator<char>> ::iterator iter = tok.begin(); iter != tok.end(); ++iter) { std::cout<<*iter<<std::endl; } }

输出：

Hello
world
foo
bar
yow
baz

 

如果要处理宽字符，可以这样，具体的就不多说了

typedef boost::tokenizer<boost::char_separator<wchar_t> ,std::wstring::const_iterator,std::wstring>  tokenizer;