We are in the process of migrating to Hadoop 2.0 – specifically: Hadoop 2.4.0.2.1.1.0-385 on the sandbox. I am testing running MR jobs remotely (i.e. from outside the cluster). I get the following error when I try to run the job.
2014-09-21 11:01:47,123 INFO Application=WORDCOUNT.RMProxy.createRMProxy.92: Connecting to ResourceManager at /192.168.195.161:8050
2014-09-21 11:01:48,554 WARN Application=WORDCOUNT.JobSubmitter.copyAndConfigureFiles.259: No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2014-09-21 11:01:48,565 INFO Application=WORDCOUNT.FileInputFormat.listStatus.280: Total input paths to process : 1
2014-09-21 11:01:48,796 INFO Application=WORDCOUNT.JobSubmitter.submitJobInternal.396: number of splits:1
2014-09-21 11:01:48,908 INFO Application=WORDCOUNT.JobSubmitter.printTokens.479: Submitting tokens for job: job_1411128663444_0032
2014-09-21 11:01:49,049 INFO Application=WORDCOUNT.YARNRunner.createApplicationSubmissionContext.369: Job jar is not present. Not adding any jar to the list of resources.
2014-09-21 11:01:49,099 INFO Application=WORDCOUNT.YarnClientImpl.submitApplication.204: Submitted application application_1411128663444_0032
2014-09-21 11:01:49,132 INFO Application=WORDCOUNT.Job.submit.1289: The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1411128663444_0032/
2014-09-21 11:01:49,132 INFO Application=WORDCOUNT.Job.monitorAndPrintJob.1334: Running job: job_1411128663444_0032
2014-09-21 11:01:53,155 INFO Application=WORDCOUNT.Job.monitorAndPrintJob.1355: Job job_1411128663444_0032 running in uber mode : false
2014-09-21 11:01:53,159 INFO Application=WORDCOUNT.Job.monitorAndPrintJob.1362: map 0% reduce 0%
2014-09-21 11:01:53,170 INFO Application=WORDCOUNT.Job.monitorAndPrintJob.1375: Job job_1411128663444_0032 failed with state FAILED due to: Application application_1411128663444_0032 failed 2 times due to AM Container for appattempt_1411128663444_0032_000002 exited with exitCode: 1 due to: Exception from container-launch: org.apache.hadoop.util.Shell$ExitCodeException:
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)