Win a copy of Kotlin in Action this week in the Kotlin forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic

Processing millions of facts and rules with Drools and Spring Batch  RSS feed

 
Gautam Karnataki
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Has anyone done any research on combining Drools and Spring Batch? My requirement is to process more than 1.5 million records periodicallys with about 75-100 rules. I cannot do it in a single JVM. I can break the number of facts in chunks of 100000 each but then i have rules which need to iterate through all the facts.
Would spring batch somehow help me in solving this problem?
 
Saifuddin Merchant
Ranch Hand
Posts: 607
Firefox Browser Java Spring
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Spring batch has some good support to work in parallel (multi-thread/multi-process). You might want to have a look at remote chunking

I (think) your particular problem could also benefit from the partitioning technique

Have a look the documentation isn't too much to overwhelm, but covers everything that's needed.

You might also want to look at the samples provided.
 
It is sorta covered in the JavaRanch Style Guide.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!