• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

urgent :(... XML file Size

 
Ranch Hand
Posts: 56
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi,
Would enbody tell a XMl ignorant dude as to whether talking of XML files having sizes in the higher range of 100MB is logical?
The reason is wld be worthwhile to have 2 XML files of say 300Mb and then use some tool to compare them to get differential XML file?
 
Sheriff
Posts: 5782
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I am not sure how a file this big is being generated, but I can certainly tell you that 100 MB is way too much for a typical XML document.
The bigger the file is, the parsing process will become more resource intensive. You could optimize the process by using small foot print SAX parsers, but the long term solution should be to generate and consume smaller files. If the (large) size of the file is driven by the requirements, then you should consider some kind of custom parsing or using plain text-comparison tools to deal with such documents.
Hope that helps,
 
deep venu
Ranch Hand
Posts: 56
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Oh it does help!!
i can tell my boss that!
the background behind this is that we trying to extract/load or migrate data from legacy app(s) into our current application database.
Due to customer laid restrictions datawarehousing is not being considered as a solution. So the question of sending the data from more than one laegacy apps to our application required some kind of common file format and XML was the choice..so then arise this problem of parsing or comparing such huge files...
 
Don't get me started about those stupid light bulbs.
reply
    Bookmark Topic Watch Topic
  • New Topic