Hi Hugo,
I guess I have run into a similar problem mentioned in
.
As u mentioned that you changed the /etc/yum.repos.d/ambari.repo to point it to your local repository – can you provide your repo files and other changes ? I can try that and see if it works for me too.
Thanks and regards.
I am trying to configure my HUE for my cluster and I am seeing this error.
Request Method: GET
Request URL: http://hdp21nn01:8000/about/
Django Version: 1.2.3
Exception Type: AttributeError
Exception Value:
‘str’ object has no attribute ‘get’
Exception Location: /usr/lib/hue/desktop/core/src/desktop/lib/conf.py in _get_data_and_presence, line 131
Python Executable: /usr/bin/python2.6
Python Version: 2.6.6
Python Path: [‘/usr/lib/hue/build/env/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/pip-0.6.3-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Babel-0.9.6-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/BabelDjango-0.2.2-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Mako-0.7.2-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Markdown-2.0.3-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/MarkupSafe-0.9.3-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/MySQL_python-1.2.3c1-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Paste-1.7.2-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/PyYAML-3.09-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Pygments-1.3.1-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/South-0.7-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/Spawning-0.9.6-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/avro-1.5.0-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/configobj-4.6.0-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/django_auth_ldap-1.0.7-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/django_extensions-0.5-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/django_nose-0.5-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/elementtree-1.2.6_20050316-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/enum-0.4.4-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/eventlet-0.9.14-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/greenlet-0.3.1-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/happybase-0.6-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/kerberos-1.1.1-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/lockfile-0.8-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/lxml-3.3.5-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/moxy-1.0.0-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/pam-0.1.3-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/pyOpenSSL-0.13-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/pycrypto-2.6-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/pysqlite-2.5.5-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/python_daemon-1.5.1-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/python_ldap-2.3.13-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/pytidylib-0.2.1-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/requests-2.2.1-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/requests_kerberos-0.4-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/sasl-0.1.1-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/sh-1.08-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/simplejson-2.0.9-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/threadframe-0.2-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/thrift-0.9.0-py2.6-linux-x86_64.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/urllib2_kerberos-0.1.6-py2.6.egg’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages/xlrd-0.9.0-py2.6.egg’, ‘/usr/lib/hue/desktop/core/src’, ‘/usr/lib/hue/desktop/libs/hadoop/src’, ‘/usr/lib/hue/desktop/libs/liboozie/src’, ‘/usr/lib/hue/build/env/lib/python2.6/site-packages’, ‘/usr/lib/hue/apps/about/src’, ‘/usr/lib/hue/apps/beeswax/src’, ‘/usr/lib/hue/apps/filebrowser/src’, ‘/usr/lib/hue/apps/hcatalog/src’, ‘/usr/lib/hue/apps/help/src’, ‘/usr/lib/hue/apps/jobbrowser/src’, ‘/usr/lib/hue/apps/jobsub/src’, ‘/usr/lib/hue/apps/oozie/src’, ‘/usr/lib/hue/apps/pig/src’, ‘/usr/lib/hue/apps/proxy/src’, ‘/usr/lib/hue/apps/useradmin/src’, ‘/usr/lib/hue/build/env/bin’, ‘/usr/lib64/python26.zip’, ‘/usr/lib64/python2.6′, ‘/usr/lib64/python2.6/plat-linux2′, ‘/usr/lib64/python2.6/lib-tk’, ‘/usr/lib64/python2.6/lib-old’, ‘/usr/lib64/python2.6/lib-dynload’, ‘/usr/lib64/python2.6/site-packages’, ‘/usr/lib64/python2.6/site-packages/gst-0.10′, ‘/usr/lib64/python2.6/site-packages/gtk-2.0′, ‘/usr/lib64/python2.6/site-packages/webkit-1.0′, ‘/usr/lib/python2.6/site-packages’, ‘/usr/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg-info’, ‘/usr/lib/hue/apps/beeswax/src/beeswax/../../gen-py’, ‘/usr/lib/hue/apps/jobbrowser/src/jobbrowser/../../gen-py’, ‘/usr/lib/hue/apps/proxy/src/proxy/../../gen-py’]
Server time: Tue, 10 Feb 2015 16:52:36 -0800
Has anyone else encountered this?
Thank you in advance.
Virtual reality is the next level in sports training. While once the focus was on building the players’ physical size, strength, stamina
Before u register did u try ssh all the host nodes
5 node cluster created with my own. This same problem. I investigated that this is not problem with HCat but it’s problem with MapReduce if you check job browser and logs.
Yes I did and it’s working, even the logs confirm it. I’m unable to figure out the repository related error – all the nodes have Internet access.
Hi All,
I have a cluster where the hdfs client is firewalled from the rest of the Hadoop cluster. I have been able to secure most access however I am getting errors when monitoring a job. It appears the nodemanager uses a dynamic port each time making it difficult to secure the firewall. Is there a way to restrict the range of ports that are selected to bind the tracking URL to?
The output I receive is as follows:
15/02/11 08:15:22 INFO fs.TestDFSIO: TestDFSIO.1.7
15/02/11 08:15:22 INFO fs.TestDFSIO: nrFiles = 500
15/02/11 08:15:22 INFO fs.TestDFSIO: nrBytes (MB) = 1000.0
15/02/11 08:15:22 INFO fs.TestDFSIO: bufferSize = 1000000
15/02/11 08:15:22 INFO fs.TestDFSIO: baseDir = /benchmarks/TestDFSIO
15/02/11 08:15:23 INFO fs.TestDFSIO: creating control file: 1048576000 bytes, 500 files
15/02/11 08:15:36 INFO fs.TestDFSIO: created control files for: 500 files
15/02/11 08:15:37 INFO impl.TimelineClientImpl: Timeline service address: http://0.0.0.0:8188/ws/v1/timeline/
15/02/11 08:15:37 INFO client.RMProxy: Connecting to ResourceManager at node10.test.local/192.168.0.10:8050
15/02/11 08:15:37 INFO impl.TimelineClientImpl: Timeline service address: http://0.0.0.0:8188/ws/v1/timeline/
15/02/11 08:15:37 INFO client.RMProxy: Connecting to ResourceManager at node10.test.local/192.168.0.10:8050
15/02/11 08:15:38 INFO mapred.FileInputFormat: Total input paths to process : 500
15/02/11 08:15:38 INFO mapreduce.JobSubmitter: number of splits:500
15/02/11 08:15:38 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1423324247753_0011
15/02/11 08:15:38 INFO impl.YarnClientImpl: Submitted application application_1423324247753_0011
15/02/11 08:15:38 INFO mapreduce.Job: The url to track the job: http://node10.test.lo…24247753_0011/
15/02/11 08:15:38 INFO mapreduce.Job: Running job: job_1423324247753_0011
15/02/11 08:16:03 INFO ipc.Client: Retrying connect to server: node1.test.local/10.10.10.17:33463. Already tried 0 time(s); maxRetries=3
15/02/11 08:16:23 INFO ipc.Client: Retrying connect to server: node1.test.local/10.10.10.17:33463. Already tried 1 time(s); maxRetries=3
15/02/11 08:16:43 INFO ipc.Client: Retrying connect to server: node1.test.local/10.10.10.17:33463. Already tried 2 time(s); maxRetries=3
node1.test.local runs the Ambari DATANODE and NODEMANAGER roles.
The distro is Hortonworks 2.1.1. Please note I have seen this page http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.1/bk_reference/content/reference_chap2.html but it doesn’t seem to make any reference to such a port range.
Any help will be much appreciated.
Thanks
Charlie
I had a similar issue and found it was some stale yum configuration from some earlier testing. I logged onto the node and ran “yum clean all” and it all sprang back into action.
I just had this same problem, I had to change this to use a hostname instead of NameServiceId. Curious as well how to get this to use HA Name Node… anyone found an answer?
HdfsBolt bolt1 = new HdfsBolt()
.withFsUrl(“hdfs://my.server.com”)
.withFileNameFormat(fileNameFormat)
.withRecordFormat(format)
.withRotationPolicy(rotationPolicy)
.withSyncPolicy(syncPolicy);
I’m attempting to get an application with a bundled Apache Hadoop 1.2.1 client to work with a HDP 1.3.10 cluster. The same application works fine with earlier versions of Hortonworks.
When I try to use my application, i get an error like “java.lang.IllegalAgrumentException: No enum const class org.apache.hadoop.hdfs.protocol.DatanodeInfo$AdminStates”
Is it possible that the bug fix listed below on the 1.3.10 patch list has broken compatibility with the vanilla Hadoop 1.2 client?
HDFS HADOOP-10627 BUG-14148 DataNode must support HTTPS on HDP 1.3.x
Thank you,
Ben
After downloading the sandbox and changing couple of configuration files i got rid of most the configuration errors except the Beeswax. I am not sure where to make the changes required. Sandbox was downloaded on VMWare environment.
Beeswax (Hive UI) The application won’t work without a running HiveServer2.
I fixed the error by simply installing local repositories, in ‘Advanced Repository Options’, replaced the web url with the local repository URL and it registered the hosts.
Thanks everyone.
Hi everyone,
I’ve written a step-by-step walkthrough on how to use HUE 3.7+ with HDP 2.2
It’s available on the GetHue.com Blog here: Install Guide
There are still a few areas that need some debugging and integration, such as Pig and Oozie.
Cheers,
Andrew
Thanks, do you have a step-by-step guide on how to install and deploy clusters with Ambari 1.7?
Flip the 80/20 Rule!
Read this article from Forbes
AUTO MONEY APP Review Is True Work Exposed!
AUTO MONEY APP Review
It’s basically a thermos for your can of beer that will keep your brew cold for a very long time. How long exactly? I decided to find out.
The private social network is only available in a few major metros
Make sure that your public key is appended to authorized_keys. so basically
cd /root/.ssh
and then
cat id_rsa.pub >> authorized_keys
Ok, so i have debugged this but don’t get why i have this problem…..
look at the bottom and you see that passwordless logins work between the two hosts.
but the error in bootstrap.err is permission denied….so I found out that the sshKey file in the ssh command is missing…it does not show up in the original path. as you can see. So if passwordless ssh is already setup why specify a key file? I hacked the /usr/lib/python2.6/site-packages/ambari_server/bootstrap.py script to leave off the keyfile from command and got past this step… before i go forward I was wondering if anyone else came across this and in fact is there something else wrong?
root@ambari:/var/run/ambari-server/bootstrap/6# ls -la
total 16
drwxr-xr-x 2 root root 140 Feb 14 11:26 .
drwxr-xr-x 9 root root 180 Feb 14 11:38 ..
-rw-r–r– 1 root root 657 Feb 14 11:19 bootstrap.err
-rw-r–r– 1 root root 0 Feb 14 11:19 bootstrap.out
-rw-r–r– 1 root root 3 Feb 14 11:19 horton1.laptop.local.done
-rw-r–r– 1 root root 796 Feb 14 11:19 horton1.laptop.local.log
-rw——- 1 root root 406 Feb 14 11:26 sshKey
root@ambari:/var/run/ambari-server/bootstrap/6# more bootstrap.err
INFO:root:BootStrapping hosts [‘horton1.laptop.local’] using /usr/lib/python2.6/site-packages/ambari_server cluster prim
ary OS: ubuntu14 with user ‘root’ sshKey File /var/run/ambari-server/bootstrap/6/sshKey password File null using tmp dir
/var/run/ambari-server/bootstrap/6 ambari: ambari.laptop.local; server_port: 8080; ambari version: 1.7.0
INFO:root:Executing parallel bootstrap
ERROR:root:ERROR: Bootstrap of host horton1.laptop.local fails because previous action finished with non-zero exit code
(255)
ERROR MESSAGE: Permission denied (publickey,password).
STDOUT:
Permission denied (publickey,password).
INFO:root:Finished parallel bootstrap
root@ambari:/var/run/ambari-server/bootstrap/6# ssh horton1.laptop.local
Last login: Sat Feb 14 11:38:01 2015 from ambari.laptop.local
root@horton1:~# exit
