mysql导入中文文本数据乱码

查看数据库编码情况

mysql> show variables like '%character%';
+--------------------------+----------------------------------+
| Variable_name            | Value                            |
+--------------------------+----------------------------------+
| character_set_client     | utf8                             |
| character_set_connection | utf8                             |
| character_set_database   | utf8                             |
| character_set_filesystem | binary                           |
| character_set_results    | utf8                             |
| character_set_server     | utf8                             |
| character_set_system     | utf8                             |
| character_sets_dir       | /usr/local/mysql/share/charsets/ |
+--------------------------+----------------------------------+
8 rows in set (0.00 sec)

 

[root@qkcache ~]# head -n 10 FXauthor130521.txt
1,|??,|1
2,|??,|1
3,|.?,|1
4,|??,|1
5,|.?
6,|??
7,|u?,|1
8,|??,|1
9,|.?,|1
10,|.÷,|1

 

linux下查看文本文件乱码

 

mysql> load data infile '/opt/mydata/FXauthor130521.txt' into table discover_authorbk fields terminated by ',|'  lines terminated by '\n' (authorid,author,tag);
Query OK, 7187986 rows affected, 65535 warnings (1 min 31.01 sec)
Records: 7187986  Deleted: 0  Skipped: 0  Warnings: 12090946
导进数据库查看

中文那个字段空白

---------------------------------------------------------------------------

处理步骤

mysql> set names gbk ;
Query OK, 0 rows affected (0.00 sec)

 

mysql> show variables like '%character%';
+--------------------------+----------------------------------+
| Variable_name            | Value                            |
+--------------------------+----------------------------------+
| character_set_client     | gbk                              |
| character_set_connection | gbk                              |
| character_set_database   | utf8                             |
| character_set_filesystem | binary                           |
| character_set_results    | gbk                              |
| character_set_server     | utf8                             |
| character_set_system     | utf8                             |
| character_sets_dir       | /usr/local/mysql/share/charsets/ |
+--------------------------+----------------------------------+
8 rows in set (0.00 sec)

 

mysql> load data infile '/opt/mydata/FXauthor130521.txt' into table discover_authorbk character set gbk fields terminated by ',|'  lines terminated by '\n' (authorid,author,tag);
Query OK, 7187986 rows affected, 65535 warnings (1 min 25.97 sec)
Records: 7187986  Deleted: 0  Skipped: 0  Warnings: 4955844

再次查看正常。。