Win a copy of The Little Book of Impediments (e-book only) this week in the Agile and Other Processes forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Bulk Data Processing

 
Prateek Jauhari
Greenhorn
Posts: 26
Hibernate Java Spring
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I am trying to process bulk amount of data....
I am using IBM DB2.

I am reading a list of Item from an Excel using POI interface and for each Item there is a particular set of queries that has to be fired.
The problem is that the if I am running the same set of query for each item then result processing is taking to much of time
(i.e. if the items increases to 50 or above) and ultimately causing the browser to display Request time out error.


Is there to any other way to implement the same with procedure or something ?

Thanks & Regards
Prateek
 
Jeanne Boyarsky
author & internet detective
Marshal
Posts: 35279
384
Eclipse IDE Java VI Editor
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Do you have to process one at a time? If not, you can batch the queries so there are less server round trips (and less work for the database.)
 
Prateek Jauhari
Greenhorn
Posts: 26
Hibernate Java Spring
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Like I have a List
Such as
1001
1002
1003
and so on
now after reading 1001 we fire a set of queries,
and then for 1002 the same set of queries,
and then for 1003..
and so on...
 
Mayank Pande
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
The reason I raised this here because I'm using hibernate and wanted to check if there is a better option in Spring to do so.

--------------------------
Data Entry
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic