UnicodeDecodeError: ‘gb2312‘ codec can‘t decode byte 0x93 in position 4: illegal multibyte sequence

python 字符转码异常

使用代码：

str(row[2], encoding=charset)

使用场景

从数据库中取字段，但字段存储的中文编码格式不一致

当执行时，遇到错误：UnicodeDecodeError: 'gb2312' codec can't decode byte 0x93 in position 4: illegal multibyte sequence

这是转码失败！

解决方式

    def __init__(self, value='', encoding=None, errors='strict'): # known special case of str.__init__
        """
        str(object='') -> str
        str(bytes_or_buffer[, encoding[, errors]]) -> str
        
        Create a new string object from the given object. If encoding or
        errors is specified, then the object must expose a data buffer
        that will be decoded using the given encoding and error handler.
        Otherwise, returns the result of object.__str__() (if defined)
        or repr(object).
        encoding defaults to sys.getdefaultencoding().
        errors defaults to 'strict'.
        # (copied from class doc)
        """
        pass

str(row[2], encoding=charset, errors='ignore') 增加参数ignore

还有一种方式 decode(‘gb2312’,‘ignore’)

后语

网上还有一种方式是，将gb2312改为gbk，认为gb2312的编码集没有gbk广泛。但我这里不完全适用，gbk的编码也会偶尔报错