CODEWITHSUNDEEP
hadoopmapreducedistributed-computing
George
George

Reputation: 8378

Where do I start with distributed computing?

I'm interested in learning techniques for distributed computing. As a Java developer, I'm probably willing to start with Hadoop. Could you please recommend some books/tutorials/articles to begin with?

Upvotes: 13

Views: 1782

Answers (7)

CBlock811
CBlock811

Reputation: 23

If you are looking to learn a distributed computing platform that is less complicated than Hadoop you can try Zillabyte. You only need to know some Ruby or Python to build apps on the platform.

As LoLo said, Hadoop is a powerful solution, but can be rough to start with.

For materials to learn about distributed computing try http://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-824-distributed-computer-systems-engineering-spring-2006/syllabus/. There are several resources recommended by the course as well.

Upvotes: 1

Lolo
Lolo

Reputation: 4347

Hadoop is not necessarily the best tool for all distributed computing problems. Despite its power, it also has a pretty steep learning curve and cost of ownership. You might want to clarify your requirements and look for suitable alternatives in the Java world, such as HTCondor, JPPF or GridGain (my apologies to those I do not mention).

Upvotes: 2

Jingguo Yao
Jingguo Yao

Reputation: 7986

MIT 6.824 is the best stuff. Only reading google papers related to Hadoop is not enough. A systematic course learning is required if you want to go deeper.

Upvotes: 3

Joe Stein
Joe Stein

Reputation: 1275

The All Things Hadoop Podcast http://allthingshadoop.com/podcast has some good content and good guests. A lot of it is geared to getting started with Distributed Computing.

Upvotes: 2

Binary Nerd
Binary Nerd

Reputation: 13927

Currently, bookwise I would check out - Hadoop A Definitive Guide. Its written by Tom White who has worked on Hadoop for a good while now, and works at Cloudera with Doug Cutting (Hadoop creator).

Also on the free side, Jimmy Lin from UMD has written a book called: Data-Intensive Text Processing with MapReduce. Here's a link to the final pre-production verison (link provided by the author on his website).

Upvotes: 3

David M
David M

Reputation: 4376

Here are some resources from Yahoo! Developer Network

a tutorial:

http://developer.yahoo.com/hadoop/tutorial/

an introductory course (requires Siverlight, sigh):

http://yahoo.hosted.panopto.com/CourseCast/Viewer/Default.aspx?id=281cbf37-eed1-4715-b158-0474520014e6

Upvotes: 1

ZelluX
ZelluX

Reputation: 72595

Maybe you can read some papers related to MapReduce and distributed computing first, to gain a better understanding of it. Here are some I would like to recommand:

On the other hand, if you want to know better of Hadoop, maybe you can start reading Hadoop MapReduce framework source code.

Upvotes: 10

Related Questions