java中修改和删除的单词,如何在Java中从String中消除重复的单词？

I have an ArrayList of Strings and it contains records such as:

this is a first sentence

hello my name is Chris

what's up man what's up man

today is tuesday

I need to clear this list, so that the output does not contain repeated content. In the case above, the output should be:

this is a first sentence

hello my name is Chris

what's up man

today is tuesday

as you can see, the 3rd String has been modified and now contains only one statement what's up man instead of two of them.

In my list there is a situation that sometimes the String is correct, and sometimes it is doubled as shown above.

I want to get rid of it, so I thought about iterating through this list:

for (String s: myList) {

but I cannot find a way of eliminating duplicates, especially since the length of each string is not determined, and by that I mean there might be record:

this is a very long sentence this is a very long sentence

or sometimes short ones:

single word singe word

is there some native java function for that maybe?

解决方案

I would suggest using regular expressions. I was able to remove duplicates using this pattern: \b([\w\s']+) \1\b

public class Main {

static String [] phrases = {

"this is a first sentence",

"hello my name is Chris",

"what's up man what's up man",

"today is tuesday",

"this is a very long sentence this is a very long sentence",

"single word single word",

"hey hey"

};

public static void main(String[] args) throws Exception {

String duplicatePattern = "\\b([\\w\\s']+) \\1\\b";

Pattern p = Pattern.compile(duplicatePattern);

for (String phrase : phrases) {

Matcher m = p.matcher(phrase);

if (m.matches()) {

System.out.println(m.group(1));

} else {

System.out.println(phrase);

}

}

}

}

Results:

this is a first sentence

hello my name is Chris

what's up man

today is tuesday

this is a very long sentence

single word

hey