Hy,
I have a (very)large XML file (100GB) with a list of foo, I want to convert-it into a stream like they where introduce into java 8 of object:
Any idea of lib or code sample?
at the beginning:
...
...
at the end:
Stream foosStream = ????("foo.xml")
streamFoos.forEach(foo->foo.doFooStuffs());
Edit:
@Pierre Thank-you, here is the implementation of your solution:
try {
XMLEventReader reader = XMLInputFactory.newInstance().
createXMLEventReader(stream);
final Unmarshaller unmarshaller = JAXBContext.newInstance(XXXXX.class).createUnmarshaller();
Iterator it = new XmlIterator<>(reader, unmarshaller, "xxxxxx");
return StreamSupport.stream(Spliterators.spliteratorUnknownSize(it, Spliterator.ORDERED), false);
} catch (XMLStreamException e1) {
logger.error("XMLStreamException", e1);
} catch (JAXBException e) {
logger.error("JAXBException", e);
}
and
public class XmlIterator implements Iterator {
private final Logger logger = LoggerFactory.getLogger(this.getClass());
XMLEventReader reader;
XMLEvent event;
Unmarshaller unmarshaller;
String name;
public XmlIterator(XMLEventReader reader, Unmarshaller unmarshaller, String name) {
this.reader = reader;
this.unmarshaller = unmarshaller;
this.name = name;
try {
reader.next();
this.event = reader.peek();
} catch (XMLStreamException e) {
logger.error("", e);
event = null;
}
}
@Override
public boolean hasNext() {
try {
while (event != null && !(event.isStartElement() && name.equals(event.asStartElement().getName().getLocalPart()))) {
Object a = reader.next();
event = reader.peek();
}
return event != null;
} catch (XMLStreamException e) {
logger.error("", e);
event = null;
}
return event != null;
}
@Override
public T next() {
try {
T next = ((JAXBElement) unmarshaller.unmarshal(reader)).getValue();
event = reader.peek();
return next;
} catch (JAXBException e) {
logger.error("error during unmarshalling ", e);
return null;
} catch (XMLStreamException e) {
logger.error("error during stream ", e);
return null;
}
}
}
解决方案
Each time you see a tag 'foo' (using https://docs.oracle.com/javase/7/docs/api/javax/xml/stream/XMLEventReader.html#peek() ) , use the Stax reader to parse and build your object Foo
Foo readFoo(XMLEventReader xmlIn) throws XMLStreamException {
(...)
return foo;
}
implements a java.util.Iterator that will use the previous function to return the 'next()' Foo
622
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
