Wim Vanni wrote:Welcome to the Ranch, Zahid.
Your design question is quite a challenge and I'm letting it sink in and have it run in a background thread for a while. I'll get back to you as soon as that thread comes up with some conclusions
Wim
There are only two hard things in computer science: cache invalidation, naming things, and off-by-one errors
fred rosenberger wrote:
How fault-tolerant do you need to be? In other words, if you send 150 of the 300, and your program bombs, how bad is it if you re-send the same 150 again?
Wim Vanni wrote:
I wanted to add that I'm puzzled by the "max 300 at a time" and "percentage-wise spread over available csv's" requirements. The first seems unnecessary if you push data to the app with a webservice or MQ; or is it that 300 records in one batch get sent? The second must have something to do with not using a first-in-first-out (FIFO) system to comply with some functional requirement.
Anyway, hope this helps.
Cheers,
Wim
SCJP 1.4, SCWCD 1.4
Did you see how Paul cut 87% off of his electric heat bill with 82 watts of micro heaters? |