Quantcast
Viewing all articles
Browse latest Browse all 3435

How do I develop MapReduce programs?

I am looking to develop Hadoop MapReduce programs. So far I’ve done the following:

    Downloaded and installed the HortonWorks sandbox (2.2, but can upgrade to 2.3).
    Installed Eclipse on my local Windows 8 machine.
    Downloaded and unzipped Hadoop 2.7.1 onto my local box.
    Created *Driver.java, *Mapper.java, *Reducer.java classes in my sample Java project. Then I added every .jar I could find in the hadoop 2.7.1 distribution via ‘Add External JARs’ dialog.

But that’s as far as I got. No idea how to actually build it, or run it, or submit it. Or whether I even referenced the right libraries.

I am looking for a step by step tutorial on how to get started (preferably Eclipse). E.g. what libraries to reference, which eclipse plugins to install, how to create and send the job to the VM sandbox, etc…

What I see on the internet right now are tutorials that are 2 years old or so and everything is outdated.

Is there anything that will walk me through creating my first program?


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>