Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Reply To: Stdout log capture

$
0
0

Hi Eric,
Can you clarify if you are running the vmware or virtualbox application? On the virtualbox side, there is a known issue with not being able to see the logs for the nodemanager webui, it is referenced in the release notes as BUG­-34592. Can you simply run a simple pi job and see the logs? On VMware, I was able to view the logs after running a simple pi job as hdfs user :
yarn jar /usr/hdp/2.2.4.2-2/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 10

After the job finished, I was able to go to the job history server:

http://192.168.235.133:19888/jobhistory

which shows the job id I executed, clicking on it, it brought me to the job page http://192.168.235.133:19888/jobhistory/job/job_1429552652390_0001 showing the map and reduce tasks. From there, there is a log link which I am able to click on as well, which shows log information such as:

2015-04-20 23:31:12,219 INFO [Thread-85] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://sandbox.hortonworks.com:8020 /user/hdfs/.staging/job_1429552652390_0001
2015-04-20 23:31:12,227 INFO [Thread-85] org.apache.hadoop.ipc.Server: Stopping server on 57728
2015-04-20 23:31:12,229 INFO [IPC Server listener on 57728] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 57728
2015-04-20 23:31:12,232 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2015-04-20 23:31:12,232 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted

Also another way to get logs is you can run the following command mentioned in this blog:

http://hortonworks.com/blog/simplifying-user-logs-management-and-access-in-yarn/

yarn logs -applicationId <application ID> ­

For instance, in my example job I ran, the app id is

Hence I would run the command as
yarn logs -applicationId application_1429552652390_0001

Hope that helps.
Regards,
Robert


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>