ProcPile is a pure Ruby distributed computing cluster environment. Its goal is to allow fast prototyping on smaller datasets, especially those where serialization and deserialization are minor expenses relative to the core processing task. Once the algorithms are settled, you should be able to scale out to full production usage. At that point, you can replace the core processes with Ruby modules written in C (or Inline::C), or move the design to a more "grown-up" clustering environment.
|Tags||Software Development Libraries Ruby Modules|