• Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Enhancing the performace of a batch job

 
Shruti Sharma
Ranch Hand
Posts: 55
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi,

I have a question on enhancing the performance of the batch job. My batch job is supposed to process 500,000 records. Currently, it crashes after 70,000 records. Here are the steps we are performing:

1. Read the records from the file and dump into the Staging (temporary) table (this step takes just about few seconds since we are using DB2 loader).

2. Read the data from the staging table and populate the main application tables. This is where the batch code is giving performance issues. Any tips to enhance the performance?

 
Martin Vajsar
Sheriff
Posts: 3752
62
Chrome Netbeans IDE Oracle
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I wouldn't classify "it crashes" as a performance problem. What is the error message you get? I believe you need to start from there.

Without much more details of the processing, the best you can get is some very vague general advice. I'm not sure this would be true specifically in DB2, but generally I'd say you'll get the best performance by using SQL statements to manipulate the data in bulk. Does DB2 have some documentation regarding performance?
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic