Fractals and lots of Machines

Posted by timw on May 23 2008 | Developer, Misc

After setting up a test hadoop map-reduce cluster for our viral seeding service here at rubber towers earlier this year, I needed to come up with a simple task to run to get my head around the map-reduce programming model.

Stumbling upon this great blog post, I decided to run a task to render a Buddhabrot in glorious detail (6000X4000 pixels).

These images are released under a creative commons non-commercial share-alike licence (click the image for a low-resolution desktop background)

buddahbrot-small

Creative Commons License
BuddhaBrot by Team Rubber / Tim Wintle is licensed under a Creative Commons Attribution-Non-Commercial-Share Alike 2.0 UK: England & Wales License.

Here is a close-up of the “head” of the brot (the part on the left) in it’s original resolution:

buddhabrot-closeup

You can download the image scaled down to a desktop background, the high resolution image (not on the site to preserve bandwidth) is roughly 40Mb as a png.

For those interested, the intermediate data (passed between the map and reduce phases) was roughly 250 Gb of raw data. The mapper and reducer were both written in Python, with a single final reduce done off-cluster using PIL (the Python Imaging Library).

UPDATE

You can now download a torrent of the entire, full resolution image.

3 comments for now

3 Responses to “Fractals and lots of Machines”

  1. Brian H

    How many nodes in the cluster? How long did it take?

    23 May 2008 at 4:14 pm

  2. Why not provide a torrent of the full resolution image?

    23 May 2008 at 4:22 pm

  3. [...] - bookmarked by 5 members originally found by zainab91 on 2008-09-17 Fractals and lots of Machines http://www.teamrubber.com/blog/?p=111 - bookmarked by 5 members originally found by Neldorf on [...]

    09 Oct 2008 at 6:45 pm

Trackback URI | Comments RSS

Leave a Reply