Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Reply To: How configure eclipse W7 execute map reduce java program on remote cluster unix

$
0
0

Question about java map reduce, i use setJarByClass(myclass), i consider hadoop using the class serialization sended remotely from my eclipse to my linux cluster,
or i must send a jar on cluster ? it is the case

Job job = Job.getInstance(conf);
job.setJarByClass(QuizScoreJob.class);
job.setJobName(“Job QuizScore”);

job.setOutputKeyClass(Text.class);
job.setOutputValueClass(IntWritable.class);

job.setMapperClass(QuizMapper.class); // Replace Map.class name with your Mapper class
job.setNumReduceTasks(2);
job.setCombinerClass(QuizReducer.class);
job.setReducerClass(QuizReducer.class); //Replace Reduce.class name with your Reducer class

job.setInputFormatClass(TextInputFormat.class);
job.setOutputFormatClass(TextOutputFormat.class);


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>