Processing millions of facts and rules with Drools and Spring Batch

[Gautam Karnataki]

Has anyone done any research on combining Drools and Spring Batch? My requirement is to process more than 1.5 million records periodicallys with about 75-100 rules. I cannot do it in a single JVM. I can break the number of facts in chunks of 100000 each but then i have rules which need to iterate through all the facts.
Would spring batch somehow help me in solving this problem?

[Saifuddin Merchant]

Spring batch has some good support to work in parallel (multi-thread/multi-process). You might want to have a look at remote chunking

I (think) your particular problem could also benefit from the partitioning technique

Have a look the documentation isn't too much to overwhelm, but covers everything that's needed.

You might also want to look at the samples provided.

[Dhanashree Gambhir]

hi gautam, dod you try spring batch + drools for million records? How did you do it? What was the performance

[Tim Holloway]

Dhanashree Gambhir wrote:hi gautam, dod you try spring batch + drools for million records? How did you do it? What was the performance

Sorry. The question was asked a decade ago. Gautam has probably left the building by now.