I’m installing HDP 2.2 using Ambari on a 3-node RedHat 6.4 cluster. Everything is working fine, configured the proxy address also, but in the last step when I try to install the packages the installation fails.
this is the error that I’m getting:
stderr:
2015-04-29 16:35:38,355 – Error while executing command ‘install':
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 214, in execute
method(env)
File “/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py”, line 34, in hook
install_packages()
File “/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py”, line 77, in install_packages
Package(packages)
File “/usr/lib/python2.6/site-packages/resource_management/core/base.py”, line 148, in __init__
self.env.run()
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 152, in run
self.run_action(resource, action)
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 118, in run_action
provider_action()
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py”, line 43, in action_install
self.install_package(package_name, self.resource.use_repos)
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py”, line 51, in install_package
shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 70, in inner
return function(command, **kwargs)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 82, in checked_call
return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path, sudo, on_new_line)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 199, in _call
raise Fail(err_msg)
Fail: Execution of ‘/usr/bin/yum -d 0 -e 0 -y install hdp-select’ returned 1.
Error Downloading Packages:
hdp-select-2.2.4.2-2.el6.noarch: failure: hdp-select/hdp-select-2.2.4.2-2.el6.noarch.rpm from HDP-2.2: [Errno 256] No more mirrors to try.
stdout:
2015-04-29 16:35:01,581 – u”Directory[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/’]” {‘recursive': True}
2015-04-29 16:35:01,786 – u”File[‘/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip’]” {‘content': DownloadSource(‘http://smt-bi3.example.com:8080/resources//UnlimitedJCEPolicyJDK7.zip’)}
2015-04-29 16:35:01,901 – Not downloading the file from http://smt-bi3.example.com:8080/resources//UnlimitedJCEPolicyJDK7.zip, because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already exists
2015-04-29 16:35:02,112 – u”Group[‘hadoop’]” {‘ignore_failures': False}
2015-04-29 16:35:02,113 – Modifying group hadoop
2015-04-29 16:35:02,222 – u”Group[‘users’]” {‘ignore_failures': False}
2015-04-29 16:35:02,223 – Modifying group users
2015-04-29 16:35:02,281 – u”Group[‘knox’]” {‘ignore_failures': False}
2015-04-29 16:35:02,282 – Modifying group knox
2015-04-29 16:35:02,341 – u”Group[‘spark’]” {‘ignore_failures': False}
2015-04-29 16:35:02,342 – Modifying group spark
2015-04-29 16:35:02,401 – u”User[‘oozie’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’users’]}
2015-04-29 16:35:02,401 – Modifying user oozie
2015-04-29 16:35:02,465 – u”User[‘hive’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,465 – Modifying user hive
2015-04-29 16:35:02,533 – u”User[‘ambari-qa’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’users’]}
2015-04-29 16:35:02,534 – Modifying user ambari-qa
2015-04-29 16:35:02,596 – u”User[‘flume’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,597 – Modifying user flume
2015-04-29 16:35:02,662 – u”User[‘hdfs’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,663 – Modifying user hdfs
2015-04-29 16:35:02,724 – u”User[‘knox’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,725 – Modifying user knox
2015-04-29 16:35:02,790 – u”User[‘storm’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,791 – Modifying user storm
2015-04-29 16:35:02,851 – u”User[‘spark’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,851 – Modifying user spark
2015-04-29 16:35:02,911 – u”User[‘mapred’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,912 – Modifying user mapred
2015-04-29 16:35:02,972 – u”User[‘hbase’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:02,973 – Modifying user hbase
2015-04-29 16:35:03,033 – u”User[‘tez’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’users’]}
2015-04-29 16:35:03,034 – Modifying user tez
2015-04-29 16:35:03,094 – u”User[‘zookeeper’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,095 – Modifying user zookeeper
2015-04-29 16:35:03,157 – u”User[‘kafka’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,158 – Modifying user kafka
2015-04-29 16:35:03,219 – u”User[‘falcon’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,220 – Modifying user falcon
2015-04-29 16:35:03,279 – u”User[‘sqoop’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,280 – Modifying user sqoop
2015-04-29 16:35:03,340 – u”User[‘yarn’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,341 – Modifying user yarn
2015-04-29 16:35:03,401 – u”User[‘hcat’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,402 – Modifying user hcat
2015-04-29 16:35:03,461 – u”User[‘ams’]” {‘gid': ‘hadoop’, ‘ignore_failures': False, ‘groups': [u’hadoop’]}
2015-04-29 16:35:03,462 – Modifying user ams
2015-04-29 16:35:03,516 – u”File[‘/var/lib/ambari-agent/data/tmp/changeUid.sh’]” {‘content': StaticFile(‘changeToSecureUid.sh’), ‘mode': 0555}
2015-04-29 16:35:03,876 – u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa’]” {‘not_if': ‘(test $(id -u ambari-qa) -gt 1000) || (false)’}
2015-04-29 16:35:03,930 – Skipping u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa’]” due to not_if
2015-04-29 16:35:03,930 – u”Directory[‘/hadoop/hbase’]” {‘owner': ‘hbase’, ‘recursive': True, ‘mode': 0775, ‘cd_access': ‘a’}
2015-04-29 16:35:04,329 – u”File[‘/var/lib/ambari-agent/data/tmp/changeUid.sh’]” {‘content': StaticFile(‘changeToSecureUid.sh’), ‘mode': 0555}
2015-04-29 16:35:04,672 – u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase’]” {‘not_if': ‘(test $(id -u hbase) -gt 1000) || (false)’}
2015-04-29 16:35:04,733 – Skipping u”Execute[‘/var/lib/ambari-agent/data/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/hadoop/hbase’]” due to not_if
2015-04-29 16:35:04,734 – u”Group[‘hdfs’]” {‘ignore_failures': False}
2015-04-29 16:35:04,734 – Modifying group hdfs
2015-04-29 16:35:04,800 – u”User[‘hdfs’]” {‘ignore_failures': False, ‘groups': [u’hadoop’, ‘hadoop’, ‘hdfs’, u’hdfs’]}
2015-04-29 16:35:04,801 – Modifying user hdfs
2015-04-29 16:35:04,862 – u”Directory[‘/etc/hadoop’]” {‘mode': 0755}
2015-04-29 16:35:05,076 – u”Directory[‘/etc/hadoop/conf.empty’]” {‘owner': ‘root’, ‘group': ‘hadoop’, ‘recursive': True}
2015-04-29 16:35:05,333 – u”Link[‘/etc/hadoop/conf’]” {‘not_if': ‘ls /etc/hadoop/conf’, ‘to': ‘/etc/hadoop/conf.empty’}
2015-04-29 16:35:05,397 – Skipping u”Link[‘/etc/hadoop/conf’]” due to not_if
2015-04-29 16:35:05,424 – u”File[‘/etc/hadoop/conf/hadoop-env.sh’]” {‘content': InlineTemplate(…), ‘owner': ‘hdfs’, ‘group': ‘hadoop’}
2015-04-29 16:35:05,784 – u”Repository[‘HDP-2.2′]” {‘base_url': ‘http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.2.4.2′, ‘action': [‘create’], ‘components': [u’HDP’, ‘main’], ‘repo_template': ‘repo_suse_rhel.j2′, ‘repo_file_name': ‘HDP’, ‘mirror_list': None}
2015-04-29 16:35:05,801 – u”File[‘/etc/yum.repos.d/HDP.repo’]” {‘content': Template(‘repo_suse_rhel.j2′)}
2015-04-29 16:35:06,177 – u”Repository[‘HDP-UTILS-1.1.0.20′]” {‘base_url': ‘http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6′, ‘action': [‘create’], ‘components': [u’HDP-UTILS’, ‘main’], ‘repo_template': ‘repo_suse_rhel.j2′, ‘repo_file_name': ‘HDP-UTILS’, ‘mirror_list': None}
2015-04-29 16:35:06,185 – u”File[‘/etc/yum.repos.d/HDP-UTILS.repo’]” {‘content': Template(‘repo_suse_rhel.j2′)}
2015-04-29 16:35:06,513 – u”Package[‘unzip’]” {}
2015-04-29 16:35:07,059 – Skipping installing existent package unzip
2015-04-29 16:35:07,059 – u”Package[‘curl’]” {}
2015-04-29 16:35:07,430 – Skipping installing existent package curl
2015-04-29 16:35:07,430 – u”Package[‘hdp-select’]” {}
2015-04-29 16:35:07,842 – Installing package hdp-select (‘/usr/bin/yum -d 0 -e 0 -y install hdp-select’)
2015-04-29 16:35:38,355 – Error while executing command ‘install':
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py”, line 214, in execute
method(env)
File “/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py”, line 34, in hook
install_packages()
File “/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py”, line 77, in install_packages
Package(packages)
File “/usr/lib/python2.6/site-packages/resource_management/core/base.py”, line 148, in __init__
self.env.run()
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 152, in run
self.run_action(resource, action)
File “/usr/lib/python2.6/site-packages/resource_management/core/environment.py”, line 118, in run_action
provider_action()
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py”, line 43, in action_install
self.install_package(package_name, self.resource.use_repos)
File “/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py”, line 51, in install_package
shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 70, in inner
return function(command, **kwargs)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 82, in checked_call
return _call(command, logoutput, True, cwd, env, preexec_fn, user, wait_for_finish, timeout, path, sudo, on_new_line)
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 199, in _call
raise Fail(err_msg)
Fail: Execution of ‘/usr/bin/yum -d 0 -e 0 -y install hdp-select’ returned 1.
Error Downloading Packages:
hdp-select-2.2.4.2-2.el6.noarch: failure: hdp-select/hdp-select-2.2.4.2-2.el6.noarch.rpm from HDP-2.2: [Errno 256] No more mirrors to try.