• Post Reply Bookmark Topic Watch Topic
  • New Topic

how to write more data to csv file  RSS feed

 
shashank beerla
Greenhorn
Posts: 28
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
OutputStreamWriter outWriter = new OutputStreamWriter(output);
BufferedWriter writer = new BufferedWriter(outWriter, (int) MEG);
private static final double MEG = (Math.pow(1024, 2));

I am using this writer to write database table data to csv file. At a max i was able to write 900000. I need write around 2million of data. Can someone suggest how to improve my buffered writer to do that. Thanks,
 
Paul Clapham
Sheriff
Posts: 22185
38
Eclipse IDE Firefox Browser MySQL Database
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
You don't have to have a single buffer big enough to hold the entire file, you know. Just choose a reasonable buffer size (say 8192 but don't ask me why not some other number because it really doesn't matter much) and write the data to the buffered writer in the normal way.
 
shashank beerla
Greenhorn
Posts: 28
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Are you asking me to increase the private static final double MEG = (Math.pow(1024, 2)); size to 8192?

I didn't get your advise when you mentioned use multiple writers. I am iterating through list of objects and writing to the CSV file. How can i use two writers to accomplish what I am doing
 
Paul Clapham
Sheriff
Posts: 22185
38
Eclipse IDE Firefox Browser MySQL Database
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
shashank beerla wrote:Are you asking me to increase the private static final double MEG = (Math.pow(1024, 2)); size to 8192?


No, because 1048576 is greater than 8192. That wouldn't be an increase.

I didn't get your advise when you mentioned use multiple writers. I am iterating through list of objects and writing to the CSV file. How can i use two writers to accomplish what I am doing


That's because I didn't mention "multiple writers" at all. I don't know where you got that idea from. And if you think I was telling you to use two writers, I don't know where you got that idea from either. On the other hand if that was your idea, then don't do that. Just use one BufferedWriter and write the data to it. Don't forget to close it when you're finished.
 
Maneesh Godbole
Bartender
Posts: 11445
18
Android Eclipse IDE Google Web Toolkit Java Mac Ubuntu
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Please do take out time to CarefullyChooseOneForum
Your question has nothing to do with GWT. Moving to a more appropriate forum
 
It is sorta covered in the JavaRanch Style Guide.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!