New to Hadoop and trying to get a streaming version of the wordcount tutorial example working in Perl. The Java version of the wordcount example works, so I know that part of the setup is correct. My mapper and reducer perl scripts run without error. When I try this command:
[hue@sandbox ~]$ hadoop jar /usr/hdp/2.2.0.0-2041/hadoop-mapreduce/hadoop-streaming-2.6.0.2.2.0.0-2041.jar -input mytestdir/mylocaldir -output myperloutdir -mapper ‘/tmp/wc_mapper.pl’ -reducer ‘/tmp/wc_reducer.pl’ -file /tmp/wc_mapper.pl -file /tmp/wc_reducer.pl
I get this (along with a lot of other messages):
Caused by: java.io.IOException: Cannot run program “/hadoop/yarn/local/usercache/hue/appcache/application_1429018620039_0012/container_1429018620039_0012_01_000002/./wc_mapper.pl”: error=13, Permission denied
I’ve tried running as hue and root. I’ve tried adding executable permission to the .pl files. I’ve tried moving them from user directory to /tmp. No success. Any help appreciated.
I’m using HDP 2.2.
