Monday, June 30, 2008

Simple AND Elegant

Simple AND Elegant. Two adjectives you use all the time to describe algorithms like MapReduce, but you know you have stumbled upon something special when you can also say the same about a framework that implements that algorithm. I've been following Hadoop, the open source implementation of Google's MapReduce algorithm, for some time now and until recently, I haven't had the urge to really look into how it works and what it can do until I read a blog called Hadoop by a New York Times developer, Derek Gottfrid. The incredible power of the framework and Amazon Web Services can easily be seen by what Derek Gottfrid did for the NY Times Archive.

So welcome to Distributed Maze, my foray into the distributed computing world and a blog post to help others who want to do the same. Sure, the name isn't creative, but at least it's original as of today's date! Hope it helps someone do some amazing things one day.

No comments: