• Post Reply Bookmark Topic Watch Topic
  • New Topic

Heap Size issue while writing snappy ip stream bytes to file  RSS feed

 
Amruta Vispute
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Guys,

I am compressing a file snappy op stream library org.xereal.snappy.
Then I decompress file using snappy ip stream and write to my local folder.
However I get following error -

"Java heap space issue. File size greater than 1GB."

Could you please suggest.


Regards,
Amruta
 
Campbell Ritchie
Sheriff
Posts: 53779
128
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Welcome to the Ranch

Do you know how big the file actually is? Can you increase your heap size? Look here (Unix version) and look for the -Xmxsize option.
If you are not running snappy as a Java® application, I don't know whether anybody will know much about it. Is there anything about size limits in the snappy documentation? I have never used that tool myself.
 
Dave Tolls
Ranch Hand
Posts: 2504
27
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Can you show us the code around reading and writing?
A (fairly brief) read of the docs seems to imply that the FramedInput/Output version might be what you should look at as the deal with the data in chunks.
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!