When trying to view application logs vi job history UI and Hue the following error is received: Error getting logs at shldvatlbxxx.tvlport.net:45454. In the Node Manager log I see the following error message:
2015-09-24 15:58:38,270 ERROR logaggregation.AppLogAggregatorImpl (AppLogAggregatorImpl.java:cleanOldLogs(373)) – Failed to clean old logs
org.apache.hadoop.security.AccessControlException: Permission denied: user=yarn, access=EXECUTE, inode=”/app-logs/jalaj.pahuja/logs”:jalaj.pahuja:hdfs:drwxrwx—
Changed permissions to chmod -R 1777 /app-logs and YARN is the owner and could access logs. But after next job runs permissions for /app-logs/{user}/logs are reset to drwxrwx— and can not access log files.
Type Name Size User Group Permissions Date
. jalaj.pahuja hdfs drwxrwxrwxt August 10, 2015 12:35 PM
.. yarn hdfs drwxrwxrwxt September 30, 2015 09:49 AM
logs jalaj.pahuja hdfs drwxrwx— October 13, 2015 09:12 AM
Why is the directory permissions being reset?