c++11 标准模板（STL）本地化库 - 平面类别（std::codecvt） - 在字符编码间转换，包括 UTF-8、UTF-16、UTF-32 （八）

本地化库

本地环境设施包含字符分类和字符串校对、数值、货币及日期/时间格式化和分析，以及消息取得的国际化支持。本地环境设置控制流 I/O 、正则表达式库和 C++ 标准库的其他组件的行为。

平面类别

在字符编码间转换，包括 UTF-8、UTF-16、UTF-32

std::codecvt

template<     class InternT,     class ExternT,     class State > class codecvt;

类 std::codecvt 封装字符串的转换，包括宽和多字节，从一种编码到另一种。通过 std::basic_fstream<CharT> 进行的所有 I/O 操作都使用流中感染的 std::codecvt<CharT, char, std::mbstate_t> 本地环境平面。

继承图

标准库提供以下独立（本地环境无关）特化：

定义于头文件 <locale>
std::codecvt<char, char, std::mbstate_t>	恒等转换
std::codecvt<char16_t, char, std::mbstate_t>	在 UTF-16 和 UTF-8 间转换 (C++11 起)(C++20 中弃用)
std::codecvt<char16_t, char8_t, std::mbstate_t>	在 UTF-16 和 UTF-8 间转换 (C++20 起)
std::codecvt<char32_t, char, std::mbstate_t>	在 UTF-32 和 UTF-8 间转换 (C++11 起)(C++20 中弃用)
std::codecvt<char32_t, char8_t, std::mbstate_t>	在 UTF-32 和 UTF-8 间转换 (C++20 起)
std::codecvt<wchar_t, char, std::mbstate_t>	在系统原生宽和单字节窄字符集间转换

另外， C++ 程序中构造每个的 locale 对象实现其自身的四个特化的（ locale 限定）版本。

成员类型

成员类型	定义
intern_type	InternT
extern_type	ExternT
state_type	State

调用 do_max_length & 返回能转换成单个 internT 字符的最大 externT 字符数

std::codecvt<InternT,ExternT,State>::max_length,
std::codecvt<InternT,ExternT,State>::do_max_length

public: int max_length() const throw();	（1）	(C++11 前)
public: int max_length() const noexcept;		(C++11 起)
protected: virtual int do_max_length() const throw();	(2)	(C++11 前)
protected: virtual int do_max_length() const noexcept;		(C++11 起)

1) 公开成员函数，调用最终派生类的成员函数 do_max_length 。

2) 返回对于任何合法范围 [from, from_end) 和任何 state 合法 ， do_length(state, from, from_end, 1) 所能返回的最大值。

返回值

若以 in() 转换生成一个 InternT 字符，能消耗的最大 ExternT 字符数。

不转换特化 std::codecvt<char, char, std::mbstate_t> 返回 1 。

注意

若编码依赖状态（ encoding() == -1 ），则可能消耗多于 max_length() 个外部字符生成一个内部字符。

 

调用示例 window

#include <locale>
#include <iostream>
#include <vector>
#include <Windows.h>
#include <string>
#include <codecvt>

std::vector<std::wstring> locals;

BOOL CALLBACK MyFuncLocaleEx(LPWSTR pStr, DWORD dwFlags, LPARAM lparam)
{
    locals.push_back(pStr);
    return TRUE;
}

std::string stows(const std::wstring& ws)
{
    std::string curLocale = setlocale(LC_ALL, NULL); // curLocale = "C";
    setlocale(LC_ALL, "chs");
    const wchar_t* _Source = ws.c_str();
    size_t _Dsize = 2 * ws.size() + 1;
    char *_Dest = new char[_Dsize];
    memset(_Dest, 0, _Dsize);
    wcstombs(_Dest, _Source, _Dsize);
    std::string result = _Dest;
    delete[]_Dest;
    setlocale(LC_ALL, curLocale.c_str());
    return result;
}


int main()
{
    EnumSystemLocalesEx(MyFuncLocaleEx, LOCALE_ALTERNATE_SORTS, NULL, NULL);

    std::cout << "In codecvt_utf8, the longest multibyte character is "
              << std::codecvt_utf8<wchar_t>().max_length() << " bytes long" << std::endl;

    std::cout << "In header-consuming codecvt_utf8, the longest multibyte character is "
              << std::codecvt_utf8<wchar_t,
              0x10ffff,
              std::consume_header>().max_length() << " bytes long" << std::endl;

    for (std::vector<std::wstring>::const_iterator str = locals.begin();
            str != locals.end(); ++str)
    {
        std::wcout << "In this system's " << *str << ", the longest multibyte character is "
                   << std::use_facet<std::codecvt<wchar_t, char, std::mbstate_t>>(
                       std::locale(stows(*str))
                   ).max_length() << " bytes long" << std::endl;
    }

    return 0;
}

输出

In codecvt_utf8, the longest multibyte character is 6 bytes long
In header-consuming codecvt_utf8, the longest multibyte character is 9 bytes long
In this system's de-DE_phoneb, the longest multibyte character is 5 bytes long
In this system's es-ES_tradnl, the longest multibyte character is 5 bytes long
In this system's hu-HU_technl, the longest multibyte character is 5 bytes long
In this system's ja-JP_radstr, the longest multibyte character is 5 bytes long
In this system's ka-GE_modern, the longest multibyte character is 5 bytes long
In this system's x-IV_mathan, the longest multibyte character is 5 bytes long
In this system's zh-CN_phoneb, the longest multibyte character is 5 bytes long
In this system's zh-CN_stroke, the longest multibyte character is 5 bytes long
In this system's zh-HK_radstr, the longest multibyte character is 5 bytes long
In this system's zh-MO_radstr, the longest multibyte character is 5 bytes long
In this system's zh-MO_stroke, the longest multibyte character is 5 bytes long
In this system's zh-SG_phoneb, the longest multibyte character is 5 bytes long
In this system's zh-SG_stroke, the longest multibyte character is 5 bytes long
In this system's zh-TW_pronun, the longest multibyte character is 5 bytes long
In this system's zh-TW_radstr, the longest multibyte character is 5 bytes long