java xml 拆分,使用Java拆分1GB Xml文件

I have a 1GB Xml file, how can I split it into well-formed, smaller size Xml files using Java ?

Here is an example:

john

....

Thanks.

解决方案

I would use a StAX parser for this situation. It will prevent the entire document from being read into memory at one time.

Advance the XMLStreamReader to the local root element of the sub-fragment.

You can then use the javax.xml.transform APIs to produce a new document from this XML fragment. This will advance the XMLStreamReader to the end of that fragment.

Repeat step 1 for the next fragment.

Code Example

For the following XML, output each "statement" section into a file named after the "account attributes value":

...stuff...

...stuff...

This can be done with the following code:

import java.io.File;

import java.io.FileReader;

import javax.xml.stream.XMLInputFactory;

import javax.xml.stream.XMLStreamConstants;

import javax.xml.stream.XMLStreamReader;

import javax.xml.transform.Transformer;

import javax.xml.transform.TransformerFactory;

import javax.xml.transform.stax.StAXSource;

import javax.xml.transform.stream.StreamResult;

public class Demo {

public static void main(String[] args) throws Exception {

XMLInputFactory xif = XMLInputFactory.newInstance();

XMLStreamReader xsr = xif.createXMLStreamReader(new FileReader("input.xml"));

xsr.nextTag(); // Advance to statements element

TransformerFactory tf = TransformerFactory.newInstance();

Transformer t = tf.newTransformer();

while(xsr.nextTag() == XMLStreamConstants.START_ELEMENT) {

File file = new File("out/" + xsr.getAttributeValue(null, "account") + ".xml");

t.transform(new StAXSource(xsr), new StreamResult(file));

}

}

}