java替换非utf-8得字符_使用声明的编码= UTF-8- Java从XML中删除非UTF-8字符

一旦在Java机器上将字节数组转换为字符串,就会得到(默认情况下,大多数机器)UTF16编码字符串。摆脱非utf-8字符的正确解决方案是使用以下代码:

String[] values = {"\\xF0\\x9F\\x98\\x95", "\\xF0\\x9F\\x91\\x8C", "/*", "look into my eyes ã .ã ", "fkdjsf ksdjfslk", "\\xF0\\x80\\x80\\x80", "aa \\xF0\\x9F\\x98\\x95 aa"};

for (int i = 0; i < values.length; i++) {

System.out.println(values[i].replaceAll(

"[\\\\x00-\\\\x7F]|" + //single-byte sequences 0xxxxxxx

"[\\\\xC0-\\\\xDF][\\\\x80-\\\\xBF]|" + //double-byte sequences 110xxxxx 10xxxxxx

"[\\\\xE0-\\\\xEF][\\\\x80-\\\\xBF]{2}|" + //triple-byte sequences 1110xxxx 10xxxxxx * 2

"[\\\\xF0-\\\\xF7][\\\\x80-\\\\xBF]{3}" //quadruple-byte sequence 11110xxx 10xxxxxx * 3

, ""));

}

或者,如果要验证某个字符串是否包含非utf8字符,则可以使用pattern.matches,如:

String[] values = {"\\xF0\\x9F\\x98\\x95", "\\xF0\\x9F\\x91\\x8C", "/*", "look into my eyes ã .ã ", "fkdjsf ksdjfslk", "\\xF0\\x80\\x80\\x80", "aa \\xF0\\x9F\\x98\\x95 aa"};

for (int i = 0; i < values.length; i++) {

System.out.println(Pattern.matches(

".*(" +

"[\\\\x00-\\\\x7F]|" + //single-byte sequences 0xxxxxxx

"[\\\\xC0-\\\\xDF][\\\\x80-\\\\xBF]|" + //double-byte sequences 110xxxxx 10xxxxxx

"[\\\\xE0-\\\\xEF][\\\\x80-\\\\xBF]{2}|" + //triple-byte sequences 1110xxxx 10xxxxxx * 2

"[\\\\xF0-\\\\xF7][\\\\x80-\\\\xBF]{3}" //quadruple-byte sequence 11110xxx 10xxxxxx * 3

+ ").*"

, values[i]));

}

如果有可用的字节数组,则可以使用以下命令更正确地筛选它们:

BufferedReader bufferedReader = null;

try {

bufferedReader = new BufferedReader(new InputStreamReader(new ByteArrayInputStream(bytes), "UTF-8"));

for (String currentLine; (currentLine = bufferedReader.readLine()) != null;) {

currentLine = currentLine.replaceAll(

"[\\x00-\\x7F]|" + //single-byte sequences 0xxxxxxx

"[\\xC0-\\xDF][\\x80-\\xBF]|" + //double-byte sequences 110xxxxx 10xxxxxx

"[\\xE0-\\xEF][\\x80-\\xBF]{2}|" + //triple-byte sequences 1110xxxx 10xxxxxx * 2

"[\\xF0-\\xF7][\\x80-\\xBF]{3}" //quadruple-byte sequence 11110xxx 10xxxxxx * 3

, ""));

}