Win a copy of Murach's Python Programming this week in the Jython/Python forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic

Processing millions of facts and rules with Drools and Spring Batch  RSS feed

 
Gautam Karnataki
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Has anyone done any research on combining Drools and Spring Batch? My requirement is to process more than 1.5 million records periodicallys with about 75-100 rules. I cannot do it in a single JVM. I can break the number of facts in chunks of 100000 each but then i have rules which need to iterate through all the facts.
Would spring batch somehow help me in solving this problem?
 
Saifuddin Merchant
Ranch Hand
Posts: 607
Firefox Browser Java Spring
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Spring batch has some good support to work in parallel (multi-thread/multi-process). You might want to have a look at remote chunking

I (think) your particular problem could also benefit from the partitioning technique

Have a look the documentation isn't too much to overwhelm, but covers everything that's needed.

You might also want to look at the samples provided.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!