Leotask: reliable & lightweight MapReduce on a multi-core PC

[Leo King]

I want to introduce the LeoTask - a lightweight parallel task running and results aggregation framework



The framework implements the MapReduce model, allocating tasks to multi-cores of a computer and aggregating results according to a XML based configuration file.

The framework includes mechanisms to automatically recover applications from interruptions caused by accidents (e.g. Power Cut). Applications using the framework can continue running after an interruption without losing its calculated results.

The framework is ultra-lightweight: only about 300KB.

It has the following features:

Automatic & parallel parameter space exploration

Flexible & configuration-based result aggregation

Programming model focusing only on the key logic

Reliable & automatic interruption recovery

...

And utilities:

Dynamic & cloneable networks structures.

Integration with Gnuplot.

Network generation according to common network models

DelimitedReader: a sophisticated reader that explores CSV (Comma-separated values) files like a database

Fast random number generator based on the Mersenne Twister algorithm

...

For more details please visit:

LeoTask Project Homepage