Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Accessing HDFS files through ssh

$
0
0

I ran a pig script within the sandbox environment and got some errors. The logs say that the errors are located at this location:

org.apache.pig.Main - Logging error messages to: /hadoop/yarn/local/usercache/admin/appcache/application_1447771155652_0002/container_e26_1447771155652_0002_01_000002/pig_1447772308290.log

Im trying to find this location on the sandbox so that I can see the log files.
So far this is what I have dome to get to the above listed file:
1) I looked through > hue/filebrowser coulnt find the listed folders
2) I looked through Ambari/HDFS Files  couldnt find the above location
3) I logged into the sandbox through SSH and ran the following command:

[root@sandbox ~]# hadoop fs -ls
ls: `.’: No such file or directory

4) I ran this command and seemed to get a bit closer….

[root@sandbox ~]# hadoop fs -ls /
Found 9 items
drwxrwxrwx   – yarn   hadoop          0 2015-09-28 13:47 /app-logs
drwxr-xr-x   – hdfs   hdfs            0 2015-08-19 12:36 /apps
drwxr-xr-x   – hdfs   hdfs            0 2015-08-19 12:59 /demo
drwxr-xr-x   – hdfs   hdfs            0 2015-08-19 12:32 /hdp
drwxr-xr-x   – mapred hdfs            0 2015-08-19 12:32 /mapred
drwxrwxrwx   – mapred hadoop          0 2015-08-19 12:32 /mr-history
drwxr-xr-x   – hdfs   hdfs            0 2015-08-19 12:52 /ranger
drwxrwxrwx   – hdfs   hdfs            0 2015-09-30 15:14 /tmp
drwxr-xr-x   – hdfs   hdfs            0 2015-09-28 13:47 /user

 

5) Then I tried to access the hadoop folder:

[root@sandbox ~]# hadoop fs cd /hadoop
cd: Unknown command

So now Im posting my question here. How do I get to the log file?

 

 

 

 


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>