Hi All,
Am facing the following error.
Could someone help me with this
stderr:
2015-11-17 19:56:23,083 – Error while executing command ‘install’:
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 214, in execute
method(env)
File “/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py”, line 38, in install
self.install_packages(env)
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 289, in install_packages
Package(name)
File “/usr/lib/python2.6/site-packages/resource_management/core/base.py”, line 148, in __init__
self.env.run()
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 152, in run
self.run_action(resource, action)
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 118, in run_action
provider_action()
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py”, line 43, in action_install
self.install_package(package_name, self.resource.use_repos)
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py”, line 55, in wrapper
return function_to_decorate(self, name, *args[2:])
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py”, line 95, in install_package
shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 70, in inner
return function(command, **kwargs)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 82, in checked_call
return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path, sudo, on_new_line)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 199, in _call
raise Fail(err_msg)
Fail: Execution of ‘/usr/bin/apt-get -q -o Dpkg::Options::=–force-confdef –allow-unauthenticated –assume-yes install ‘hadoop-2-2-.*-yarn” returned 100. Reading package lists…
Building dependency tree…
Reading state information…
The following extra packages will be installed:
hadoop-2-2-8-0-3150 ranger-2-2-8-0-3150-hdfs-plugin zookeeper-2-2-8-0-3150
The following NEW packages will be installed:
hadoop-2-2-8-0-3150 hadoop-2-2-8-0-3150-yarn
hadoop-2-2-8-0-3150-yarn-nodemanager hadoop-2-2-8-0-3150-yarn-proxyserver
hadoop-2-2-8-0-3150-yarn-resourcemanager
hadoop-2-2-8-0-3150-yarn-timelineserver ranger-2-2-8-0-3150-hdfs-plugin
zookeeper-2-2-8-0-3150
0 upgraded, 8 newly installed, 0 to remove and 270 not upgraded.
Need to get 9,371 kB/271 MB of archives.
After this operation, 283 MB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
zookeeper-2-2-8-0-3150 ranger-2-2-8-0-3150-hdfs-plugin hadoop-2-2-8-0-3150
hadoop-2-2-8-0-3150-yarn hadoop-2-2-8-0-3150-yarn-nodemanager
hadoop-2-2-8-0-3150-yarn-proxyserver
hadoop-2-2-8-0-3150-yarn-resourcemanager
hadoop-2-2-8-0-3150-yarn-timelineserver
Authentication warning overridden.
Get:1 http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/ HDP/main zookeeper-2-2-8-0-3150 all 3.4.6.2.2.8.0-3150 [9,371 kB]
Fetched 1,102 B in 10s (101 B/s)
Failed to fetch http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/pool/main/z/zookeeper/zookeeper-2-2-8-0-3150_3.4.6.2.2.8.0-3150_all.deb Size mismatch
E: Unable to fetch some archives, maybe run apt-get update or try with –fix-missing?
stdout:
2015-11-17 19:55:30,244 – u”Directory[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/’]” {‘recursive’: True}
2015-11-17 19:55:30,404 – u”File[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip’]” {‘content’: DownloadSource(‘http://hadoop1.dev.com:8080/resources//UnlimitedJCEPolicyJDK7.zip’)}
2015-11-17 19:55:30,488 – Not downloading the file from http://hadoop1.dev.com:8080/resources//UnlimitedJCEPolicyJDK7.zip, because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already exists
2015-11-17 19:55:30,631 – u”Group[‘hadoop’]” {‘ignore_failures’: False}
2015-11-17 19:55:30,632 – Modifying group hadoop
2015-11-17 19:55:30,674 – u”Group[‘users’]” {‘ignore_failures’: False}
2015-11-17 19:55:30,674 – Modifying group users
2015-11-17 19:55:30,717 – u”User[‘oozie’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’users’]}
2015-11-17 19:55:30,717 – Modifying user oozie
2015-11-17 19:55:30,759 – u”User[‘hive’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:30,759 – Modifying user hive
2015-11-17 19:55:30,802 – u”User[‘mapred’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:30,802 – Modifying user mapred
2015-11-17 19:55:30,844 – u”User[‘hbase’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:30,845 – Modifying user hbase
2015-11-17 19:55:30,887 – u”User[‘ambari-qa’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’users’]}
2015-11-17 19:55:30,887 – Modifying user ambari-qa
2015-11-17 19:55:30,929 – u”User[‘flume’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:30,930 – Modifying user flume
2015-11-17 19:55:30,972 – u”User[‘zookeeper’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:30,972 – Modifying user zookeeper
2015-11-17 19:55:31,015 – u”User[‘tez’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’users’]}
2015-11-17 19:55:31,015 – Modifying user tez
2015-11-17 19:55:31,057 – u”User[‘hdfs’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:31,057 – Modifying user hdfs
2015-11-17 19:55:31,100 – u”User[‘sqoop’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:31,100 – Modifying user sqoop
2015-11-17 19:55:31,142 – u”User[‘yarn’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:31,143 – Modifying user yarn
2015-11-17 19:55:31,185 – u”User[‘hcat’]” {‘gid’: ‘hadoop’, ‘ignore_failures’: False, ‘groups’: [u’hadoop’]}
2015-11-17 19:55:31,185 – Modifying user hcat
2015-11-17 19:55:31,228 – u”File[‘/var/lib/ambari-agent/data/tmp/changeUid.sh’]” {‘content’: StaticFile(‘changeToSecureUid.sh’), ‘mode’: 0555}
2015-11-17 19:55:31,496 – u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa’]” {‘not_if’: ‘(test $(id -u ambari-qa) -gt 1000) || (false)’}
2015-11-17 19:55:31,538 – Skipping u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa’]” due to not_if
2015-11-17 19:55:31,538 – u”Directory[‘/hadoop/hbase’]” {‘owner’: ‘hbase’, ‘recursive’: True, ‘mode’: 0775, ‘cd_access’: ‘a’}
2015-11-17 19:55:31,848 – u”File[‘/var/lib/ambari-agent/data/tmp/changeUid.sh’]” {‘content’: StaticFile(‘changeToSecureUid.sh’), ‘mode’: 0555}
2015-11-17 19:55:32,114 – u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase’]” {‘not_if’: ‘(test $(id -u hbase) -gt 1000) || (false)’}
2015-11-17 19:55:32,156 – Skipping u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase’]” due to not_if
2015-11-17 19:55:32,156 – u”Group[‘hdfs’]” {‘ignore_failures’: False}
2015-11-17 19:55:32,156 – Modifying group hdfs
2015-11-17 19:55:32,198 – u”User[‘hdfs’]” {‘ignore_failures’: False, ‘groups’: [u’hadoop’, ‘hadoop’, ‘hdfs’, u’hdfs’]}
2015-11-17 19:55:32,199 – Modifying user hdfs
2015-11-17 19:55:32,241 – u”Directory[‘/etc/hadoop’]” {‘mode’: 0755}
2015-11-17 19:55:32,383 – u”Directory[‘/etc/hadoop/conf.empty’]” {‘owner’: ‘root’, ‘group’: ‘hadoop’, ‘recursive’: True}
2015-11-17 19:55:32,524 – u”Link[‘/etc/hadoop/conf’]” {‘not_if’: ‘ls /etc/hadoop/conf’, ‘to’: ‘/etc/hadoop/conf.empty’}
2015-11-17 19:55:32,571 – Skipping u”Link[‘/etc/hadoop/conf’]” due to not_if
2015-11-17 19:55:32,582 – u”File[‘/etc/hadoop/conf/hadoop-env.sh’]” {‘content’: InlineTemplate(…), ‘owner’: ‘hdfs’, ‘group’: ‘hadoop’}
2015-11-17 19:55:32,819 – u”Repository[‘HDP-2.2’]” {‘base_url’: ‘http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0’, ‘action’: [‘create’], ‘components’: [u’HDP’, ‘main’], ‘repo_template’: ‘repo_ubuntu.j2’, ‘repo_file_name’: ‘HDP’, ‘mirror_list’: None}
2015-11-17 19:55:32,826 – u”File[‘/tmp/tmpT1CqLK’]” {‘content’: ‘deb http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0 HDP main\n’}
2015-11-17 19:55:33,011 – Writing u”File[‘/tmp/tmpT1CqLK’]” because contents don’t match
2015-11-17 19:55:33,152 – u”Repository[‘HDP-UTILS-1.1.0.20’]” {‘base_url’: ‘http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/ubuntu12’, ‘action’: [‘create’], ‘components’: [u’HDP-UTILS’, ‘main’], ‘repo_template’: ‘repo_ubuntu.j2’, ‘repo_file_name’: ‘HDP-UTILS’, ‘mirror_list’: None}
2015-11-17 19:55:33,154 – u”File[‘/tmp/tmpdOUmci’]” {‘content’: ‘deb http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/ubuntu12 HDP-UTILS main\n’}
2015-11-17 19:55:33,325 – Writing u”File[‘/tmp/tmpdOUmci’]” because contents don’t match
2015-11-17 19:55:33,468 – u”Package[‘unzip’]” {}
2015-11-17 19:55:33,561 – Skipping installing existent package unzip
2015-11-17 19:55:33,561 – u”Package[‘curl’]” {}
2015-11-17 19:55:33,651 – Skipping installing existent package curl
2015-11-17 19:55:33,651 – u”Package[‘hdp-select’]” {}
2015-11-17 19:55:33,742 – Skipping installing existent package hdp-select
2015-11-17 19:55:33,742 – u”Directory[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/’]” {‘recursive’: True}
2015-11-17 19:55:33,882 – u”File[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz’]” {‘content’: DownloadSource(‘http://hadoop1.dev.com:8080/resources//jdk-7u67-linux-x64.tar.gz’)}
2015-11-17 19:55:33,966 – Not downloading the file from http://hadoop1.dev.com:8080/resources//jdk-7u67-linux-x64.tar.gz, because /var/lib/ambari-agent/data/tmp/jdk-7u67-linux-x64.tar.gz already exists
2015-11-17 19:55:35,293 – u”Directory[‘/usr/jdk64’]” {}
2015-11-17 19:55:35,436 – u”Execute[‘(‘chmod’, ‘a+x’, u’/usr/jdk64′)’]” {‘not_if’: ‘test -e /usr/jdk64/jdk1.7.0_67/bin/java’, ‘sudo’: True}
2015-11-17 19:55:35,478 – Skipping u”Execute[‘(‘chmod’, ‘a+x’, u’/usr/jdk64′)’]” due to not_if
2015-11-17 19:55:35,478 – u”Execute[‘mkdir -p /var/lib/ambari-agent/data/tmp/jdk && cd /var/lib/ambari-agent/data/tmp/jdk && tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz && ambari-sudo.sh cp -rp /var/lib/ambari-agent/data/tmp/jdk/* /usr/jdk64’]” {‘not_if’: ‘test -e /usr/jdk64/jdk1.7.0_67/bin/java’}
2015-11-17 19:55:35,520 – Skipping u”Execute[‘mkdir -p /var/lib/ambari-agent/data/tmp/jdk && cd /var/lib/ambari-agent/data/tmp/jdk && tar -xf /var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jdk-7u67-linux-x64.tar.gz && ambari-sudo.sh cp -rp /var/lib/ambari-agent/data/tmp/jdk/* /usr/jdk64’]” due to not_if
2015-11-17 19:55:35,521 – u”Execute[‘(‘chgrp’, ‘-R’, u’hadoop’, u’/usr/jdk64/jdk1.7.0_67′)’]” {‘sudo’: True}
2015-11-17 19:55:35,563 – u”Execute[‘(‘chown’, ‘-R’, ‘root’, u’/usr/jdk64/jdk1.7.0_67′)’]” {‘sudo’: True}
2015-11-17 19:55:35,864 – u”Package[‘hadoop-2-2-.*-yarn’]” {}
2015-11-17 19:55:35,967 – Installing package hadoop-2-2-.*-yarn (‘/usr/bin/apt-get -q -o Dpkg::Options::=–force-confdef –allow-unauthenticated –assume-yes install ‘hadoop-2-2-.*-yarn”)
2015-11-17 19:55:44,898 – Execution of ‘[‘/usr/bin/apt-get’, ‘-q’, ‘-o’, ‘Dpkg::Options::=–force-confdef’, ‘–allow-unauthenticated’, ‘–assume-yes’, ‘install’, u’hadoop-2-2-.*-yarn’]’ returned 100. Reading package lists…
Building dependency tree…
Reading state information…
The following extra packages will be installed:
hadoop-2-2-8-0-3150 ranger-2-2-8-0-3150-hdfs-plugin zookeeper-2-2-8-0-3150
The following NEW packages will be installed:
hadoop-2-2-8-0-3150 hadoop-2-2-8-0-3150-yarn
hadoop-2-2-8-0-3150-yarn-nodemanager hadoop-2-2-8-0-3150-yarn-proxyserver
hadoop-2-2-8-0-3150-yarn-resourcemanager
hadoop-2-2-8-0-3150-yarn-timelineserver ranger-2-2-8-0-3150-hdfs-plugin
zookeeper-2-2-8-0-3150
0 upgraded, 8 newly installed, 0 to remove and 270 not upgraded.
Need to get 9,371 kB/271 MB of archives.
After this operation, 283 MB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
zookeeper-2-2-8-0-3150 ranger-2-2-8-0-3150-hdfs-plugin hadoop-2-2-8-0-3150
hadoop-2-2-8-0-3150-yarn hadoop-2-2-8-0-3150-yarn-nodemanager
hadoop-2-2-8-0-3150-yarn-proxyserver
hadoop-2-2-8-0-3150-yarn-resourcemanager
hadoop-2-2-8-0-3150-yarn-timelineserver
Authentication warning overridden.
Get:1 http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/ HDP/main zookeeper-2-2-8-0-3150 all 3.4.6.2.2.8.0-3150 [9,371 kB]
Fetched 1,101 B in 7s (141 B/s)
Failed to fetch http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/pool/main/z/zookeeper/zookeeper-2-2-8-0-3150_3.4.6.2.2.8.0-3150_all.deb Size mismatch
E: Unable to fetch some archives, maybe run apt-get update or try with –fix-missing?
2015-11-17 19:55:44,899 – Failed to install package hadoop-2-2-.*-yarn. Executing /usr/bin/apt-get update -qq
2015-11-17 19:56:11,103 – Retrying to install package hadoop-2-2-.*-yarn
2015-11-17 19:56:23,083 – Error while executing command ‘install’:
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 214, in execute
method(env)
File “/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py”, line 38, in install
self.install_packages(env)
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 289, in install_packages
Package(name)
File “/usr/lib/python2.6/site-packages/resource_management/core/base.py”, line 148, in __init__
self.env.run()
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 152, in run
self.run_action(resource, action)
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 118, in run_action
provider_action()
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py”, line 43, in action_install
self.install_package(package_name, self.resource.use_repos)
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py”, line 55, in wrapper
return function_to_decorate(self, name, *args[2:])
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/apt.py”, line 95, in install_package
shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 70, in inner
return function(command, **kwargs)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 82, in checked_call
return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path, sudo, on_new_line)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 199, in _call
raise Fail(err_msg)
Fail: Execution of ‘/usr/bin/apt-get -q -o Dpkg::Options::=–force-confdef –allow-unauthenticated –assume-yes install ‘hadoop-2-2-.*-yarn” returned 100. Reading package lists…
Building dependency tree…
Reading state information…
The following extra packages will be installed:
hadoop-2-2-8-0-3150 ranger-2-2-8-0-3150-hdfs-plugin zookeeper-2-2-8-0-3150
The following NEW packages will be installed:
hadoop-2-2-8-0-3150 hadoop-2-2-8-0-3150-yarn
hadoop-2-2-8-0-3150-yarn-nodemanager hadoop-2-2-8-0-3150-yarn-proxyserver
hadoop-2-2-8-0-3150-yarn-resourcemanager
hadoop-2-2-8-0-3150-yarn-timelineserver ranger-2-2-8-0-3150-hdfs-plugin
zookeeper-2-2-8-0-3150
0 upgraded, 8 newly installed, 0 to remove and 270 not upgraded.
Need to get 9,371 kB/271 MB of archives.
After this operation, 283 MB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
zookeeper-2-2-8-0-3150 ranger-2-2-8-0-3150-hdfs-plugin hadoop-2-2-8-0-3150
hadoop-2-2-8-0-3150-yarn hadoop-2-2-8-0-3150-yarn-nodemanager
hadoop-2-2-8-0-3150-yarn-proxyserver
hadoop-2-2-8-0-3150-yarn-resourcemanager
hadoop-2-2-8-0-3150-yarn-timelineserver
Authentication warning overridden.
Get:1 http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/ HDP/main zookeeper-2-2-8-0-3150 all 3.4.6.2.2.8.0-3150 [9,371 kB]
Fetched 1,102 B in 10s (101 B/s)
Failed to fetch http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.2.8.0/pool/main/z/zookeeper/zookeeper-2-2-8-0-3150_3.4.6.2.2.8.0-3150_all.deb Size mismatch
E: Unable to fetch some archives, maybe run apt-get update or try with –fix-missing?
2015-11-17 19:56:23,126 – Command: /usr/bin/hdp-select status hadoop-yarn-timelineserver > /tmp/tmp8T4AFo
Output: hadoop-yarn-timelineserver – None