This week's book giveaway is in the Agile and Other Processes forum.
We're giving away four copies of The Little Book of Impediments (e-book only) and have Tom Perry on-line!
See this thread for details.
Win a copy of The Little Book of Impediments (e-book only) this week in the Agile and Other Processes forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Expected speed from a load through Hibernate?

 
Tony Ennis
Ranch Hand
Posts: 86
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

We're looping over an Excel sheet, pulling emails out of a few columns, and modifying a parent-child table where the child is the email address and the parent is in the row.

Roughly, how many rows per second should I expect? The tables aren't too large, there aren't any triggers, the indexes are typical.

I know this is real general, I'm looking for ballpark.

 
Jeanne Boyarsky
author & internet detective
Marshal
Posts: 35279
384
Eclipse IDE Java VI Editor
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Tony,
It is going to depend on the machine running it and the size of each row (and memory and physical db layout and # indexes and many other things.) I think the best thing to do is try it.
 
Tony Ennis
Ranch Hand
Posts: 86
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Oh, we have been. It runs at about 7 (spreadsheet) rows per second on our local boxes and 1.9/sec on a VM which is the test server. Our users are rejecting the facility because it is too slow. I was trying to figure out what 'reasonable' means in this case. Basically, we didn't know when we should give up and try something else.

Since I posted we got some political pull and were able to get the code onto a production server. It runs at about 17/sec there which is very acceptable.
 
Paul Sturrock
Bartender
Posts: 10336
Eclipse IDE Hibernate Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
In the past where we've done simmilar stuff the bottleneck we observed was Excel, not the DB. Large data sets were exponentially slower from Excel than they were from a plain old loader file. Do you know it is the DB that is causing the slowness?
 
Tony Ennis
Ranch Hand
Posts: 86
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Yah, pretty sure of it. My guess is that we had VMs fighting over network access.
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic