I am working in an application where I need to be able to process at worst... 620,000+ records. I need to compare data between 2 tables, the first table has 620k records which i need to manipulate and roll upto 20,000 records, these then need to be compared against another 20,000 records in table2.
Our application uses Spring framework and Oracle 10g. It is a web application used internally, when the user clicks a button this processing and comparing needs to happen on the fly and return data to the user. It is not a batch job overnight or anything. I am wondering is this feasible given that it needs to happen on the fly? Also what approach is best, can we use cursors for this? I am not too familiar with using cursors in oracle...are they used just for batch jobs? What about stored procedures?
Any help will be much appreciated from you db experts out there.