I upgraded from Ambari 1.6 to 2.0.
YARN apptimeline server is not starting because of following errors.
stderr: /var/lib/ambari-agent/data/errors-1417.txt
2015-05-04 11:02:19,254 – Error while executing command ‘start':
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 214, in execute
method(env)
File “/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py”, line 58, in start
service(‘timelineserver’, action=’start’)
File “/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/service.py”, line 59, in service
initial_wait=5
File “/usr/lib/python2.6/site-packages/resource_management/core/base.py”, line 148, in __init__
self.env.run()
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 152, in run
self.run_action(resource, action)
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 118, in run_action
provider_action()
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py”, line 274, in action_run
raise ex
Fail: Execution of ‘ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps -p cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1′ returned 1.
stdout: /var/lib/ambari-agent/data/output-1417.txt
2015-05-04 11:01:49,315 – u”Directory[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/’]” {‘recursive': True}
2015-05-04 11:01:49,491 – u”File[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip’]” {‘content': DownloadSource(‘http://hwnn:8080/resources//UnlimitedJCEPolicyJDK7.zip’)}
2015-05-04 11:01:49,582 – Not downloading the file from http://hwnn:8080/resources//UnlimitedJCEPolicyJDK7.zip, because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already exists
2015-05-04 11:01:49,723 – u”Group[‘hadoop’]” {‘ignore_failures': False}
2015-05-04 11:01:49,723 – Modifying group hadoop
2015-05-04 11:01:49,767 – u”Group[‘nobody’]” {‘ignore_failures': False}
2015-05-04 11:01:49,768 – Modifying group nobody
2015-05-04 11:01:49,811 – u”Group[‘users’]” {‘ignore_failures': False}
2015-05-04 11:01:49,812 – Modifying group users
2015-05-04 11:01:49,857 – u”User[‘hive’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:49,857 – Modifying user hive
2015-05-04 11:01:49,903 – u”User[‘oozie’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’users’]}
2015-05-04 11:01:49,904 – Modifying user oozie
2015-05-04 11:01:49,950 – u”User[‘nobody’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’nobody’]}
2015-05-04 11:01:49,951 – Modifying user nobody
2015-05-04 11:01:49,994 – u”User[‘ambari-qa’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’users’]}
2015-05-04 11:01:49,995 – Modifying user ambari-qa
2015-05-04 11:01:50,039 – u”User[‘hdfs’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,039 – Modifying user hdfs
2015-05-04 11:01:50,086 – u”User[‘storm’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,086 – Modifying user storm
2015-05-04 11:01:50,130 – u”User[‘mapred’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,131 – Modifying user mapred
2015-05-04 11:01:50,177 – u”User[‘hbase’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,178 – Modifying user hbase
2015-05-04 11:01:50,224 – u”User[‘tez’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’users’]}
2015-05-04 11:01:50,224 – Modifying user tez
2015-05-04 11:01:50,268 – u”User[‘zookeeper’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,269 – Modifying user zookeeper
2015-05-04 11:01:50,315 – u”User[‘falcon’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,315 – Modifying user falcon
2015-05-04 11:01:50,359 – u”User[‘sqoop’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,360 – Modifying user sqoop
2015-05-04 11:01:50,407 – u”User[‘yarn’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,407 – Modifying user yarn
2015-05-04 11:01:50,453 – u”User[‘hcat’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-05-04 11:01:50,453 – Modifying user hcat
2015-05-04 11:01:50,500 – u”File[‘/var/lib/ambari-agent/data/tmp/changeUid.sh’]” {‘content': StaticFile(‘changeToSecureUid.sh’), ‘mode': 0555}
2015-05-04 11:01:50,789 – u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa’]” {‘not_if': ‘(test $(id -u ambari-qa) -gt 1000) || (false)’}
2015-05-04 11:01:50,834 – Skipping u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa’]” due to not_if
2015-05-04 11:01:50,834 – u”Directory[‘/hadoop/hbase’]” {‘owner': ‘hbase’, ‘recursive': True, ‘mode': 0775, ‘cd_access': ‘a’}
2015-05-04 11:01:51,155 – u”File[‘/var/lib/ambari-agent/data/tmp/changeUid.sh’]” {‘content': StaticFile(‘changeToSecureUid.sh’), ‘mode': 0555}
2015-05-04 11:01:51,430 – u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase’]” {‘not_if': ‘(test $(id -u hbase) -gt 1000) || (false)’}
2015-05-04 11:01:51,473 – Skipping u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase’]” due to not_if
2015-05-04 11:01:51,473 – u”Group[‘hdfs’]” {‘ignore_failures': False}
2015-05-04 11:01:51,474 – Modifying group hdfs
2015-05-04 11:01:51,516 – u”User[‘hdfs’]” {‘ignore_failures': False, ‘groups': [u’hadoop’, ‘hadoop’, ‘hdfs’, u’hdfs’]}
2015-05-04 11:01:51,517 – Modifying user hdfs
2015-05-04 11:01:51,560 – u”Directory[‘/etc/hadoop’]” {‘mode': 0755}
2015-05-04 11:01:51,711 – u”Directory[‘/etc/hadoop/conf.empty’]” {‘owner': ‘root’, ‘group': ‘hadoop’, ‘recursive': True}
2015-05-04 11:01:51,859 – u”Link[‘/etc/hadoop/conf’]” {‘not_if': ‘ls /etc/hadoop/conf’, ‘to': ‘/etc/hadoop/conf.empty’}
2015-05-04 11:01:51,905 – Skipping u”Link[‘/etc/hadoop/conf’]” due to not_if
2015-05-04 11:01:51,916 – u”File[‘/etc/hadoop/conf/hadoop-env.sh’]” {‘content': InlineTemplate(…), ‘owner': ‘hdfs’, ‘group': ‘hadoop’}
2015-05-04 11:01:52,164 – u”Execute[‘(‘setenforce’, ‘0’)’]” {‘sudo': True, ‘only_if': ‘test -f /selinux/enforce’}
2015-05-04 11:01:52,272 – u”Directory[‘/var/log/hadoop’]” {‘owner': ‘root’, ‘mode': 0775, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:52,673 – u”Directory[‘/var/run/hadoop’]” {‘owner': ‘root’, ‘group': ‘root’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:53,080 – u”Directory[‘/tmp/hadoop-hdfs’]” {‘owner': ‘hdfs’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:53,416 – u”File[‘/etc/hadoop/conf/commons-logging.properties’]” {‘content': Template(‘commons-logging.properties.j2′), ‘owner': ‘hdfs’}
2015-05-04 11:01:53,644 – u”File[‘/etc/hadoop/conf/health_check’]” {‘content': Template(‘health_check-v2.j2′), ‘owner': ‘hdfs’}
2015-05-04 11:01:53,870 – u”File[‘/etc/hadoop/conf/log4j.properties’]” {‘content': ‘…’, ‘owner': ‘hdfs’, ‘group': ‘hadoop’, ‘mode': 0644}
2015-05-04 11:01:54,116 – u”File[‘/etc/hadoop/conf/hadoop-metrics2.properties’]” {‘content': Template(‘hadoop-metrics2.properties.j2′), ‘owner': ‘hdfs’}
2015-05-04 11:01:54,345 – u”File[‘/etc/hadoop/conf/task-log4j.properties’]” {‘content': StaticFile(‘task-log4j.properties’), ‘mode': 0755}
2015-05-04 11:01:54,637 – u”File[‘/etc/hadoop/conf/configuration.xsl’]” {‘owner': ‘hdfs’, ‘group': ‘hadoop’}
2015-05-04 11:01:55,004 – u”Directory[‘/var/run/hadoop-yarn’]” {‘owner': ‘yarn’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:55,509 – u”Directory[‘/var/run/hadoop-yarn/yarn’]” {‘owner': ‘yarn’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:55,995 – u”Directory[‘/var/log/hadoop-yarn/yarn’]” {‘owner': ‘yarn’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:56,490 – u”Directory[‘/var/run/hadoop-mapreduce’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:56,900 – u”Directory[‘/var/run/hadoop-mapreduce/mapred’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:57,395 – u”Directory[‘/var/log/hadoop-mapreduce’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:57,797 – u”Directory[‘/var/log/hadoop-mapreduce/mapred’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:58,284 – u”Directory[‘/var/log/hadoop-yarn’]” {‘owner': ‘yarn’, ‘ignore_failures': True, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:01:58,688 – u”XmlConfig[‘core-site.xml’]” {‘group': ‘hadoop’, ‘conf_dir': ‘/etc/hadoop/conf’, ‘mode': 0644, ‘configuration_attributes': {}, ‘owner': ‘hdfs’, ‘configurations': …}
2015-05-04 11:01:58,707 – Generating config: /etc/hadoop/conf/core-site.xml
2015-05-04 11:01:58,707 – u”File[‘/etc/hadoop/conf/core-site.xml’]” {‘owner': ‘hdfs’, ‘content': InlineTemplate(…), ‘group': ‘hadoop’, ‘mode': 0644, ‘encoding': ‘UTF-8′}
2015-05-04 11:01:58,908 – Writing u”File[‘/etc/hadoop/conf/core-site.xml’]” because contents don’t match
2015-05-04 11:01:59,085 – u”XmlConfig[‘mapred-site.xml’]” {‘group': ‘hadoop’, ‘conf_dir': ‘/etc/hadoop/conf’, ‘mode': 0644, ‘configuration_attributes': {}, ‘owner': ‘yarn’, ‘configurations': …}
2015-05-04 11:01:59,139 – Generating config: /etc/hadoop/conf/mapred-site.xml
2015-05-04 11:01:59,139 – u”File[‘/etc/hadoop/conf/mapred-site.xml’]” {‘owner': ‘yarn’, ‘content': InlineTemplate(…), ‘group': ‘hadoop’, ‘mode': 0644, ‘encoding': ‘UTF-8′}
2015-05-04 11:01:59,637 – Writing u”File[‘/etc/hadoop/conf/mapred-site.xml’]” because contents don’t match
2015-05-04 11:01:59,863 – Changing owner for /etc/hadoop/conf/mapred-site.xml from 1009 to yarn
2015-05-04 11:01:59,996 – u”XmlConfig[‘yarn-site.xml’]” {‘group': ‘hadoop’, ‘conf_dir': ‘/etc/hadoop/conf’, ‘mode': 0644, ‘configuration_attributes': {}, ‘owner': ‘yarn’, ‘configurations': …}
2015-05-04 11:02:00,041 – Generating config: /etc/hadoop/conf/yarn-site.xml
2015-05-04 11:02:00,041 – u”File[‘/etc/hadoop/conf/yarn-site.xml’]” {‘owner': ‘yarn’, ‘content': InlineTemplate(…), ‘group': ‘hadoop’, ‘mode': 0644, ‘encoding': ‘UTF-8′}
2015-05-04 11:02:00,539 – Writing u”File[‘/etc/hadoop/conf/yarn-site.xml’]” because contents don’t match
2015-05-04 11:02:00,836 – u”XmlConfig[‘capacity-scheduler.xml’]” {‘group': ‘hadoop’, ‘conf_dir': ‘/etc/hadoop/conf’, ‘mode': 0644, ‘configuration_attributes': {}, ‘owner': ‘yarn’, ‘configurations': …}
2015-05-04 11:02:00,852 – Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2015-05-04 11:02:00,853 – u”File[‘/etc/hadoop/conf/capacity-scheduler.xml’]” {‘owner': ‘yarn’, ‘content': InlineTemplate(…), ‘group': ‘hadoop’, ‘mode': 0644, ‘encoding': ‘UTF-8′}
2015-05-04 11:02:01,147 – Writing u”File[‘/etc/hadoop/conf/capacity-scheduler.xml’]” because contents don’t match
2015-05-04 11:02:01,458 – Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1008 to yarn
2015-05-04 11:02:01,502 – u”Directory[‘/var/log/hadoop-yarn/timeline’]” {‘owner': ‘yarn’, ‘group': ‘hadoop’, ‘recursive': True, ‘cd_access': ‘a’}
2015-05-04 11:02:02,096 – u”File[‘/etc/hadoop/conf/yarn.exclude’]” {‘owner': ‘yarn’, ‘group': ‘hadoop’}
2015-05-04 11:02:02,511 – u”File[‘/etc/security/limits.d/yarn.conf’]” {‘content': Template(‘yarn.conf.j2′), ‘mode': 0644}
2015-05-04 11:02:02,979 – u”File[‘/etc/security/limits.d/mapreduce.conf’]” {‘content': Template(‘mapreduce.conf.j2′), ‘mode': 0644}
2015-05-04 11:02:03,578 – u”File[‘/etc/hadoop/conf/yarn-env.sh’]” {‘content': InlineTemplate(…), ‘owner': ‘yarn’, ‘group': ‘hadoop’, ‘mode': 0755}
2015-05-04 11:02:04,200 – u”File[‘/etc/hadoop/conf/mapred-env.sh’]” {‘content': InlineTemplate(…), ‘owner': ‘hdfs’}
2015-05-04 11:02:05,088 – u”File[‘/etc/hadoop/conf/taskcontroller.cfg’]” {‘content': Template(‘taskcontroller.cfg.j2′), ‘owner': ‘hdfs’}
2015-05-04 11:02:05,600 – u”XmlConfig[‘mapred-site.xml’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’, ‘conf_dir': ‘/etc/hadoop/conf’, ‘configuration_attributes': {}, ‘configurations': …}
2015-05-04 11:02:05,930 – Generating config: /etc/hadoop/conf/mapred-site.xml
2015-05-04 11:02:05,931 – u”File[‘/etc/hadoop/conf/mapred-site.xml’]” {‘owner': ‘mapred’, ‘content': InlineTemplate(…), ‘group': ‘hadoop’, ‘mode': None, ‘encoding': ‘UTF-8′}
2015-05-04 11:02:07,147 – Writing u”File[‘/etc/hadoop/conf/mapred-site.xml’]” because contents don’t match
2015-05-04 11:02:08,301 – Changing owner for /etc/hadoop/conf/mapred-site.xml from 1007 to mapred
2015-05-04 11:02:08,960 – u”XmlConfig[‘capacity-scheduler.xml’]” {‘owner': ‘hdfs’, ‘group': ‘hadoop’, ‘conf_dir': ‘/etc/hadoop/conf’, ‘configuration_attributes': {}, ‘configurations': …}
2015-05-04 11:02:09,001 – Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2015-05-04 11:02:09,002 – u”File[‘/etc/hadoop/conf/capacity-scheduler.xml’]” {‘owner': ‘hdfs’, ‘content': InlineTemplate(…), ‘group': ‘hadoop’, ‘mode': None, ‘encoding': ‘UTF-8′}
2015-05-04 11:02:10,579 – Writing u”File[‘/etc/hadoop/conf/capacity-scheduler.xml’]” because contents don’t match
2015-05-04 11:02:10,949 – Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1007 to hdfs
2015-05-04 11:02:11,081 – u”File[‘/etc/hadoop/conf/ssl-client.xml.example’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’}
2015-05-04 11:02:11,618 – u”File[‘/etc/hadoop/conf/ssl-server.xml.example’]” {‘owner': ‘mapred’, ‘group': ‘hadoop’}
2015-05-04 11:02:12,126 – u”File[‘/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid’]” {‘action': [‘delete’], ‘not_if': ‘ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps -p cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1′}
2015-05-04 11:02:12,357 – Deleting u”File[‘/var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid’]”
2015-05-04 11:02:12,445 – u”Execute[‘ulimit -c unlimited; export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh –config /etc/hadoop/conf start timelineserver’]” {‘not_if': ‘ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps -p cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1′, ‘user': ‘yarn’}
2015-05-04 11:02:13,996 – u”Execute[‘ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps -p cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1′]” {‘initial_wait': 5, ‘not_if': ‘ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps -p cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1′, ‘user': ‘yarn’}
2015-05-04 11:02:19,254 – Error while executing command ‘start':
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 214, in execute
method(env)
File “/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py”, line 58, in start
service(‘timelineserver’, action=’start’)
File “/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/service.py”, line 59, in service
initial_wait=5
File “/usr/lib/python2.6/site-packages/resource_management/core/base.py”, line 148, in __init__
self.env.run()
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 152, in run
self.run_action(resource, action)
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 118, in run_action
provider_action()
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py”, line 274, in action_run
raise ex
Fail: Execution of ‘ls /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1 && ps -p cat /var/run/hadoop-yarn/yarn/yarn-yarn-timelineserver.pid >/dev/null 2>&1′ returned 1.