Editing big xml files

[Aryan Khan]

Hi,

I have an xml file of 30M. I use the following code to delete the tags with no childs. But jdom simply does not build the document and
with out any exception the application goes out of this method.

The same code works fine for smaller file e.g. 9MBs?

My question.

1. Is there any file size limit?
2. What can be the solution to this?
3. What is the best way to remove tags with no childs from xml files?

Many thanks

[sachin poddar]

try launching application with -Xmx512m option

[v ray]

Similar thing in my project, the input files are tremendously huge, so we have written a program called as xmlfilesplitter which splits the large xml file into many smaller files(you can have a limit of say 20 records per file) and use that as input wherever you want.
To do this, you can use the opening tag name, say <item> and closing tag name </item> or whatever as the start and end point.
[ May 26, 2007: Message edited by: v ray ]

[Rahul Bhattacharjee]

Though I have not worked much on STAX (Streaming API for XML ; JAXP 1.3 onwards).You might consider.

Stax will give you the advantage of SAX (low on memory) and feature of DOM (editing/creation of XML) with which you can read and construct another xml on the fly without the nodes that you do not want.

Experts ; please suggest ?

[William Brogden]

This might be a job for "pipeline" style XML processing. This article mentions some uses of XML pipeline toolkits. The ServingXML open source toolkit would be the one I would look at first.

Bill