Huge XML

[Mortin kim]

HI.,


I have an huge xml like 400 mb size..i want to parse the xml ,but in between i got memory out of bound exception..as it
very huge so how can I do that..do you want split the xml..?how to maintain this senario..?

Thanks
Kim.

[Ulf Dittmer]

How are you parsing it? SAX should be able to handle it just fine.

[Jignesh Patel]

Originally posted by Mortin kim:
HI.,


I have an huge xml like 400 mb size..i want to parse the xml ,but in between i got memory out of bound exception..as it
very huge so how can I do that..do you want split the xml..?how to maintain this senario..?

Thanks
Kim.

As Ulf mention go with SAX. Spliting required to use xslt and will lead you to more development efforts and in turn leads you for budeting.

[William Brogden]

You neglect to mention what you have to do with the data. If you are processing simple records and don't need the whole monster in memory at one time, SAX is the way to go.

So - what do you have to do with the data?

Bill

[Mortin kim]

HI All.,
Thnks for the reply.
I am Using SAX parser...some XMLS are 1000MB I am getting exception while parsing..?hOw can I can fix this senario.

Thanks and regards
Hari.

[William Brogden]

I am Using SAX parser...some XMLS are 1000MB I am getting exception while parsing..?hOw can I can fix this senario

My crystal ball is in the shop for the 10000 vision checkup so I can't read your screen or log file to determine WHICH EXACT EXCEPTION you got.



The standard Java API provides methods for extracting useful information from SAX related exceptions - for example:

     }catch(SAXParseException spe ){
        StringBuffer sb = new StringBuffer( spe.toString() );
        sb.append("\n  Line number: " + spe.getLineNumber());
        sb.append("\nColumn number: " + spe.getColumnNumber() );
        sb.append("\n Public ID: " + spe.getPublicId() );
        sb.append("\n System ID: " + spe.getSystemId() + "\n");
        System.out.println( sb.toString() );
    }catch( SAXException se ){
       System.out.println("loadMVL threw " + se );       
       se.printStackTrace( System.out );
    }
   

Bill