D2007下使用TEncoding类进行UNICODE、UTF8、UTF32格式转换？

最新推荐文章于 2024-05-18 06:27:12 发布
最新推荐文章于 2024-05-18 06:27:12 发布
阅读量4.5k 收藏 1
点赞数
分类专栏： Delphi摘要 文章标签： integer function string encoding constructor class
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/senfore/article/details/3855211
版权

源码下载地址：http://www.rayfile.com/files/1f6d6517-eed9-11dd-8bce-0019d11a795f/

 

说明：参照Delphi2009的相关类，写了TEncoding类及继承类。重写了UTF16、UTF8、UTF32在Delphi2007下的字符处理方式，现在能进行这些格式的读写了。当然对于Delphi2007，读取UNICODE格式文字显示的时候有可能丢失字符。

 

 

 

 {* |<PRE>
================================================================================
* 软件名称：FcpEditor
* 单元名称：uEncoding
* 单元作者：Senfore
* 备    注：UNICODE读写支持
* 开发平台：Windows Xp Sp3 + Delphi 2007/Delphi2009
* 兼容测试：
* 本 地 化：使Delphi2007能使用Delphi2009的Encoding方式处理文本
* 单元标识：$Id: uEncoding.pas,v 1.1 2009/01/28
* 修改记录：
*           2009.01.28 V1.1
*               让Delphi2007环境下支持UTF32格式读写
*           2009.01.06 V1.0
*               创建单元，实现功能
================================================================================
|</PRE>}

unit uEncoding;

{$DEFINE UCS4_ENCODING_SUPPORT}

interface

uses Classes,Windows,SysUtils;

{$IFNDEF UNICODE}
function InterlockedCompareExchangePointer(var Destination: Pointer; Exchange: Pointer; Comperand: Pointer): Pointer;
{$ENDIF}

{$IFNDEF UNICODE}
type
   UnicodeString=WideString;
   RawByteString=AnsiString;
{$ENDIF}

 {$IFNDEF UNICODE}
type
  TCharArray = array of Char;

  EEncodingError = class(Exception);

  TEncoding = class
  strict private
    class var
      FASCIIEncoding: TEncoding;
      FBigEndianUnicodeEncoding: TEncoding;
      FDefaultEncoding: TEncoding;
      FUnicodeEncoding: TEncoding;
      FUTF7Encoding: TEncoding;
      FUTF8Encoding: TEncoding;
    class function GetASCII: TEncoding; static;
    class function GetBigEndianUnicode: TEncoding; static;
    class function GetDefault: TEncoding; static;
    class function GetUnicode: TEncoding; static;
    class function GetUTF7: TEncoding; static;
    class function GetUTF8: TEncoding; static;
  strict protected
    FIsSingleByte: Boolean;
    FMaxCharSize: Integer;
    function GetByteCount(Chars: PChar; CharCount: Integer): Integer; overload; virtual; abstract;
    function GetBytes(Chars: PChar; CharCount: Integer; Bytes: PByte; ByteCount: Integer): Integer; overload; virtual; abstract;
    function GetCharCount(Bytes: PByte; ByteCount: Integer): Integer; overload; virtual; abstract;
    function GetChars(Bytes: PByte; ByteCount: Integer; Chars: PChar; CharCount: Integer): Integer; overload; virtual; abstract;
  public
    class function Convert(Source, Destination: TEncoding; Bytes: TBytes): TBytes; overload;
    class function Convert(Source, Destination: TEncoding; Bytes: TBytes; StartIndex, Count: Integer): TBytes; overload;
    class procedure FreeEncodings;
    class function IsStandardEncoding(AEncoding: TEncoding): Boolean; static;
    class function GetBufferEncoding(const Buffer: TBytes; var AEncoding: TEncoding): Integer; static;
    function GetByteCount(const Chars: TCharArray): Integer; overload;
    function GetByteCount(const Chars: TCharArray; CharIndex, CharCount: Integer): Integer; overload;
    function GetByteCount(const S: string): Integer; overload;
    function GetByteCount(const S: string; CharIndex, CharCount: Integer): Integer; overload;
    function GetBytes(const Chars: TCharArray): TBytes; overload;
    function GetBytes(const Chars: TCharArray; CharIndex, CharCount: Integer;
      var Bytes: TBytes; ByteIndex: Integer): Integer; overload;
    function GetBytes(const S: string): TBytes; overload;
    function GetBytes(const S: string; CharIndex, CharCount: Integer;
      var Bytes: TBytes; ByteIndex: Integer): Integer; overload;
    function GetCharCount(const Bytes: TBytes): Integer; overload;
    function GetCharCount(const Bytes: TBytes; ByteIndex, ByteCount: Integer): Integer; overload;
    function GetChars(const Bytes: TBytes): TCharArray; overload;
    function GetChars(const Bytes: TBytes; ByteIndex, ByteCount: Integer): TCharArray; overload;
    function GetChars(const Bytes: TBytes; ByteIndex, ByteCount: Integer;
      var Chars: TCharArray; CharIndex: Integer): Integer; overload;
    class function GetEncoding(CodePage: Integer): TEncoding; static;
    function GetMaxByteCount(CharCount: Integer): Integer; virtual; abstract;
    function GetMaxCharCount(ByteCount: Integer): Integer; virtual; abstract;
    function GetPreamble: TBytes; virtual; abstract;
    function GetString(const Bytes: TBytes): string; overload;
    function GetString(const Bytes: TBytes; ByteIndex, ByteCount: Integer): string; overload;
    class property ASCII: TEncoding read GetASCII;
    class property BigEndianUnicode: TEncoding read GetBigEndianUnicode;
    class property Default: TEncoding read GetDefault;
    property IsSingleByte: Boolean read FIsSingleByte;
    class property Unicode: TEncoding read GetUnicode;
    class property UTF7: TEncoding read GetUTF7;
    class property UTF8: TEncoding read GetUTF8;
  end;

 TMBCSEncoding = class(TEncoding)
  private
    FCodePage: Cardinal;
    FMBToWCharFlags: Cardinal;
    FWCharToMBFlags: Cardinal;
  strict protected
    function GetByteCount(Chars: PChar; CharCount: Integer): Integer; overload; override;
    function GetBytes(Chars: PChar; CharCount: Integer; Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetCharCount(Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetChars(Bytes: PByte; ByteCount: Integer; Chars: PChar; CharCount: Integer): Integer; overload; override;
  public
    constructor Create; overload; virtual;
    constructor Create(CodePage: Integer); overload; virtual;
    constructor Create(CodePage, MBToWCharFlags, WCharToMBFlags: Integer); overload; virtual;
    function GetMaxByteCount(CharCount: Integer): Integer; override;
    function GetMaxCharCount(ByteCount: Integer): Integer; override;
    function GetPreamble: TBytes; override;
  end;

  TUTF7Encoding = class(TMBCSEncoding)
  strict protected
    function GetByteCount(Chars: PChar; CharCount: Integer): Integer; overload; override;
    function GetBytes(Chars: PChar; CharCount: Integer; Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetCharCount(Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetChars(Bytes: PByte; ByteCount: Integer; Chars: PChar; CharCount: Integer): Integer; overload; override;
  public
    constructor Create; override;
    function GetMaxByteCount(CharCount: Integer): Integer; override;
    function GetMaxCharCount(ByteCount: Integer): Integer; override;
  end;

  TUTF8Encoding = class(TUTF7Encoding)
  public
    constructor Create; override;
    function GetMaxByteCount(CharCount: Integer): Integer; override;
    function GetMaxCharCount(ByteCount: Integer): Integer; override;
    function GetPreamble: TBytes; override;
  end;

  TUnicodeEncoding = class(TEncoding)
  strict protected
    function GetByteCount(Chars: PChar; CharCount: Integer): Integer; overload; override;
    function GetBytes(Chars: PChar; CharCount: Integer; Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetCharCount(Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetChars(Bytes: PByte; ByteCount: Integer; Chars: PChar; CharCount: Integer): Integer; overload; override;
  public
    constructor Create; virtual;
    function GetMaxByteCount(CharCount: Integer): Integer; override;
    function GetMaxCharCount(ByteCount: Integer): Integer; override;
    function GetPreamble: TBytes; override;
  end;

  TBigEndianUnicodeEncoding = class(TUnicodeEncoding)
  strict protected
    function GetBytes(Chars: PChar; CharCount: Integer; Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetChars(Bytes: PByte; ByteCount: Integer; Chars: PChar; CharCount: Integer): Integer; overload; override;
  public
    function GetPreamble: TBytes; override;
  end;

  TStringsEx=class(TStrings)
  private

  public
    procedure LoadFromFile(const FileName: string); overload; virtual;
    procedure LoadFromFile(const FileName: string; Encoding: TEncoding); overload; virtual;
    procedure LoadFromStream(Stream: TStream); overload; virtual;
    procedure LoadFromStream(Stream: TStream; Encoding: TEncoding); overload; virtual;
    procedure SaveToFile(const FileName: string); overload; virtual;
    procedure SaveToFile(const FileName: string; Encoding: TEncoding); overload; virtual;
    procedure SaveToStream(Stream: TStream); overload; virtual;
    procedure SaveToStream(Stream: TStream; Encoding: TEncoding); overload; virtual;
  end;

{ TStringList class }
  TStringListEx = class;
  TStringListExSortCompare = function(List: TStringListEx; Index1, Index2: Integer): Integer;

  TStringListEx = class(TStringsEx)
  private
    FList: PStringItemList;
    FCount: Integer;
    FCapacity: Integer;
    FSorted: Boolean;
    FDuplicates: TDuplicates;
    FCaseSensitive: Boolean;
    FOnChange: TNotifyEvent;
    FOnChanging: TNotifyEvent;
    procedure ExchangeItems(Index1, Index2: Integer);
    procedure Grow;
    procedure QuickSort(L, R: Integer; SCompare: TStringListExSortCompare);
    procedure SetSorted(Value: Boolean);
    procedure SetCaseSensitive(const Value: Boolean);
  protected
    procedure Changed; virtual;
    procedure Changing; virtual;
    function Get(Index: Integer): string; override;
    function GetCapacity: Integer; override;
    function GetCount: Integer; override;
    function GetObject(Index: Integer): TObject; override;
    procedure Put(Index: Integer; const S: string); override;
    procedure PutObject(Index: Integer; AObject: TObject); override;
    procedure SetCapacity(NewCapacity: Integer); override;
    procedure SetUpdateState(Updating: Boolean); override;
    function CompareStrings(const S1, S2: string): Integer; override;
    procedure InsertItem(Index: Integer; const S: string; AObject: TObject); virtual;
  public
    destructor Destroy; override;
    function Add(const S: string): Integer; override;
    function AddObject(const S: string; AObject: TObject): Integer; override;
    procedure Clear; override;
    procedure Delete(Index: Integer); override;
    procedure Exchange(Index1, Index2: Integer); override;
    function Find(const S: string; var Index: Integer): Boolean; virtual;
    function IndexOf(const S: string): Integer; override;
    procedure Insert(Index: Integer; const S: string); override;
    procedure InsertObject(Index: Integer; const S: string;
      AObject: TObject); override;
    procedure Sort; virtual;
    procedure CustomSort(Compare: TStringListExSortCompare); virtual;
    property Duplicates: TDuplicates read FDuplicates write FDuplicates;
    property Sorted: Boolean read FSorted write SetSorted;
    property CaseSensitive: Boolean read FCaseSensitive write SetCaseSensitive;
    property OnChange: TNotifyEvent read FOnChange write FOnChange;
    property OnChanging: TNotifyEvent read FOnChanging write FOnChanging;
  end;

  {$ENDIF}

{$IFDEF UCS4_ENCODING_SUPPORT}
type
  TUCS4Encoding = class(TEncoding)
  strict protected
    FBOMEnable: Boolean;
    FBigEndian: Boolean;
    function GetByteCount(Chars: PChar; CharCount: Integer): Integer; overload; override;
    function GetBytes(Chars: PChar; CharCount: Integer; Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetCharCount(Bytes: PByte; ByteCount: Integer): Integer; overload; override;
    function GetChars(Bytes: PByte; ByteCount: Integer; Chars: PChar; CharCount: Integer): Integer; overload; override;
  public
    constructor Create; overload; virtual;
    constructor Create(BigEndian: Boolean); overload; virtual;
    constructor Create(BigEndian, BOMEnable: Boolean); overload; virtual;
    function GetMaxByteCount(CharCount: Integer): Integer; override;
    function GetMaxCharCount(ByteCount: Integer): Integer; override;
    function GetPreamble: TBytes; override;
  end;

{$ENDIF UCS4_ENCODING_SUPPORT}

{CheckBom}
  function HasUTF16LEBOM(S: TStream): Boolean; overload;
  function HasUTF16LEBOM(S: AnsiString): Boolean; overload;
  function HasUTF16BEBOM(S: TStream): Boolean; overload;
  function HasUTF16BEBOM(S: AnsiString): Boolean; overload;
  function HasUTF8BOM(S: TStream): Boolean; overload;
  function HasUTF8BOM(S: AnsiString): Boolean; overload;
  function HasUTF32LEBOM(S: TStream): Boolean; overload;
  function HasUTF32LEBOM(S: AnsiString): Boolean; overload;
  function HasUTF32BEBOM(S: TStream): Boolean; overload;
  function HasUTF32BEBOM(S: AnsiString): Boolean; overload;
{Encoding}
  function GetEncodeFromStream(Stream: TStream;var CodePage:LongInt): Boolean;
  function GetCodePageFromFile(const FileName:TFileName;var DefCodePage:LongInt):Boolean;
  function GetEncoding(CodePage: Integer): TEncoding;
  function GetEnCodingFromFile(const FileName:TFileName;DefCodePage:LongInt=0):TEncoding;
{File<->Str}
  function StrToFile(const FileName, S: String): Boolean;overload;
  function StrToFile(const FileName, S: String;Encoding:TEncoding): Boolean;overload;
  procedure StrSaveToStream(const S:string;Stream: TStream; Encoding: TEncoding);
  function FileToStr(const FileName: string):string;overload;
  function FileToStr(const FileName: string; Encoding: TEncoding):string;overload;
  function FileToString(const FileName: string): RawByteString;
  function StrLoadFromStream(Stream: TStream; Encoding: TEncoding):string;
{Unicode}
  function UnicodeEncode(Str: string; CodePage: integer): WideString;
  function UnicodeDecode(Str: WideString; CodePage: integer): string;
  function Gb2Big5(Str: string): string;
  function Big52Gb(Str: string): string;
  function GBCHT2CHS(const S: string): string;
  function GBCHS2CHT(const S: string): string;

 

 

 

 

senfore
关注
专栏目录
delphi TEncoding
weixin_33825683的博客
02-06 1437
#include &lt;tchar.h&gt; #include &lt;memory&gt; //For STL auto_ptr class //--------------------------------------------------------------------------- #pragma argsused int _tmain(int a...
delphi tcp utf8_解决Delphi7的自带的UTF-8编码转换函数BUG
weixin_39550258的博客
12-21 604
Delphi7及其以下版本的VCL 只支持Ansi, 所以... WideString 与UTF8String (定义与AnsiString 相同) 并没有办法正确的在VCL 中显示Delphi7自带的utf-8转换函数遇到其无法识别的字符串就返回空。用以下转换函数可以解决这个bugunit util_utf8;interfaceuses Windows;typeUTF8String = Ansi...
适用于DELPHI2007及以下版本的BytesOf和StringOf （字符串转TBtyes)
wh445306
05-09 646
function BytesOf(const Val: AnsiString): TBytes; var Len: Integer; begin Len := Length(Val); SetLength(Result, Len); Move(Val[1], Result[0], Len); end; function StringOf(const buf:TBytes): AnsiString; begin SetLength(Result, Length(buf)); Co.
也谈UTF8编码问题
blueforgetmenot的专栏
03-26 325
UTF8有点烧脑
【delphi】判断文件的编码方式（ANSI、Unicode、UTF8、UnicodeBIG）
sensor_WU 博客
06-09 3585
判断文件的编码格式(ANSI、Unicode、UTF8、UnicodeBIG）等
delph 自带URL编码函数 TNetEncoding
重楼的博客
08-11 883
UTF-8编码 sKey := TNetEncoding.URL.Encode('中文', [], [], TEncoding.UTF8); %E4%B8%AD%E6%96%87 GBK编码 sKey := TNetEncoding.URL.Encode('中文', [], [], TEncoding.ANSI); %D6%D0%CE%C4
如何解决delphi2007中UTF-8转码的奇数汉字出错的问题
gevyaa的专栏
07-14 1213
很多人遇到这个问题，就是奇数个转码为UTF-8格式后，转换回来就出问题。 我用delphi2007也遇到这种情况，delphi自带的widestringtoUTF8遇到奇数汉字直接返回空值。用windows自带的转换函数会丢掉最后一个汉字。 原因是UTF-8的汉字每个都是三个字节，奇数个汉字就是奇数个字节，而转码时每次是处理两个字节，这样就会剩下一个字节，这个字节会被置为‘？’。 网上有很多
UTF8_STR.RAR_delphi Utf8_delphi string_delphi utf 8 gb23_delphi
09-19
4. **GBK到UTF8的转换**：GBK是中文环境下常用的编码格式，如果你需要在UTF8和GBK之间转换，可以使用`TEncoding`类，这是从Delphi 2009开始引入的，但你可以通过第三方库在Delphi 7中实现相同的功能。 5. **文件...
xe10_utf_8转换
01-16
对于`AnsiString`，可以先转换为`UnicodeString`，再用`UTF8ToString`进行转换，反之亦然。 4. **流处理**：如果你需要读取或写入包含UTF-8编码的文件，可以使用`TMemoryStream`和`TFileStream`。在读取时，可以...
TEncoding.UTF8.GetBytes
06-08
TEncoding.UTF8.GetBytes 是 Delphi 中用于将 Unicode 字符串编码为 UTF-8 字节序列的函数。它的函数原型如下： ```delphi function GetBytes(const S: string): TBytes; overload; ``` 其中，S 是要编码的 ...
Delphi Unicode移植（从Delphi2007及一下版本移植到Delph2009以上）
05-11
Delphi Unicode移植（从Delphi2007及一下版本移植到Delph2009以上）
Delphi中UTF-8,Unicode格式转换
08-06
delphi7调用delphi2009生成的dll文件会出现乱码问题。是unicode的原因 终于找到了UTF-8、Unicode格式转换函数
delphi utf8转换乱码
06-24
另一种解决 Delphi UTF-8 转换乱码问题的方法是使用第三方库，如 UTF8String、Utf8Decode、Utf8Encode 等，这些库能够将 UTF-8 编码的字符转换为 Unicode 格式的字符，再进一步进行处理，展示出正确的结果。...
delphi2007 读取得unicode文本显示出来时乱码?
jacknes009的专栏
07-04 1691
正好今天在编程序，把我写的读写unicode及utf-8的函数上传到这里。 utf8Head:   Array[0..2] of Char = (#239,#$bb,#$bf); unicodeHead: Array[0..1] of Char = (#255,#$fe); // read utf8 file function ReadUtf8File(const filena
python字符串_Python的字符串和编码
weixin_39662432的博客
10-21 141
字符编码我们已经讲过了，字符串也是一种数据类型，但是，字符串比较特殊的是还有一个编码问题。因为计算机只能处理数字，如果要处理文本，就必须先把文本转换为数字才能处理。最早的计算机在设计时采用8个比特(bit)作为一个字节(byte)，所以，一个字节能表示的最大的整数就是255(二进制11111111=十进制255)，如果要表示更大的整数，就必须用更多的字节。比如两个字节可以表示的最大整数是65535...
提升Delphi编程效率必须使用的快捷键(Delphi2007版本)
missmecn的专栏
10-05 3553
1. [CTRL+空格] [CTRL+SHIFT+空格]这两个快捷键都是在代码编写过程中用到的，起提示作用，使用频率最高。  CTRL+空格： 在当前光标处提示有哪些变量、函数可以使用。这个功能对于无法准确写出函数名非常有用，你不需要去记住每个函数的名字，只需要在提示选项中选择，这样你仅需要输入几个字母就可以完成整个变量或者函数的输入。不过很不幸的是通常情况下输入法占用了这个快捷键，让
Delphi读取UTF-8格式ini
qq_18932003的博客
11-24 1341
不说了贴代码。 Uses IniFiles; const SZ_APP_NAME = 'demo_test'; Procedure TForm1.GetSettings; var _MemIniU: TMemIniFile; _SettingsPath: string; begin try _SettingsPath := GetHomePath + Pat...
lazarus下firebird中文乱码
最新发布
05-18 1828
中文乱码是个悠久的问题，是每个
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值