Win a copy of The Little Book of Impediments (e-book only) this week in the Agile and Other Processes forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

How to reduce the response time when querying the Database ...

 
Raza Mohd
Ranch Hand
Posts: 247
Java MyEclipse IDE MySQL Database
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
hi all,

I am using Ejb 3.0 in my Application with back End MySQL 5.0

I am working on a bank reconcilation Module where a file of about 20 lacks record is uploaded.

which is validated with database and then inserted .

it took almost 20 lacks queries to insert data..

It take a lot of tym to upload that Huge Amount of Data..

Can anybody tell me the way How can i Reduce the performance tym...




Thanks n Regards
Raza
 
Paul Sturrock
Bartender
Posts: 10336
Eclipse IDE Hibernate Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
ORMs are generally a poor choice for performing bulk data uploads. You can tune them a bit for bulk operations (see the documentation of whatever your JPA provider is) but is speed is key, I would look at the bulk load tools that come with your database.

("lacks" == 100000, yes?)
 
Raza Mohd
Ranch Hand
Posts: 247
Java MyEclipse IDE MySQL Database
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
thanks..

I am using Hibernate as JPA provider..

So what will be the better option..?

You mean to say that ORMs are not good as far as performance is considered??
 
Paul Sturrock
Bartender
Posts: 10336
Eclipse IDE Hibernate Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

I am using Hibernate as JPA provider..

Have a look at the docs for what you can do about bulk operations.


You mean to say that ORMs are not good as far as performance is considered??

Not for bulk loading, but then that is not what they are designed for.
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic