Optimization in Hive: Does Hive update dynamically the graph structure of tasks?
When I look at the Hive source code (latest version 1.0.0): In the ‘compile’ phase, each SQL query input will generate a list of dependent tasks (a graph of tasks). My question is in the ‘execution’...
View ArticleReply To: Memory configuration for 1NN (16GB RAM ) and 4 DN (8GB RAM)
Hi Dave, I have 5 systems with 1 system for NN having disk space of 250GB , 4 core, 16 GB momoery , and other 4 system have disk space of 250GB , 4 core processor and 8GB memory . Configuration...
View ArticleAs Ship Goes Missing With 49 On Board
The system uses special “signals”, which are basically pieces of information about what trades should be made. Using these signals, the software began to do all of the hard work for us. In fact, there...
View ArticleReply To: Ambari-Server sync-ldap not working
Hello there, I am having a similar issue to this. And in answer to Jeff’s question – our ambari server is setup for https, listening on port 8443. This seems relevant in some way otherwise I guess you...
View ArticleReply To: Install failures due to efi permissions
All I was able to do was manually edit the 10 or so settings containing the /boot/efi path. This is during the “Customize Services” step in the install wizard. Unfortunately, any time I had to back up...
View Articlejava.lang.UnsatisfiedLinkError when running hbase shell
Hi Folks, I have an java.lang.UnsatisfiedLinkError when running HBase shell. Any suggestions? I saw someone had this problem some time ago and they fixed their problem through upgrading JRuby...
View ArticleReply To: java.lang.UnsatisfiedLinkError when running hbase shell
OK – I see that several other people have similar problems with JRuby – including https://jira.codehaus.org/browse/JRUBY-6597 A work around seems to be to tell the program to use a different tmp...
View ArticleGraphite.sink metrics
How to change . (dot) separator to another character when send metrics to graphite from Hadoop. Graphite crete a new dir for each dot. Is it possible to change the dot to another caracter Regards...
View ArticleInstalled 4 node cluster – services not starting Ambari 1.7 HDP 2.1
centos 6.5 ambari 1.7. HDP 2.1 4 node physical cluster Followed documentation – exactly from http://docs.hortonworks.com/HDPDocuments/Ambari-1.7.0.0/AMBARI_DOC_SUITE/index.html#Item3.14 All products...
View ArticleSSL Enablement
I’m following the directions here: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.2.0/HDP_Security_Guide_v22/index.html#Item1.3.4.4 and I’m seeing this error when I enable HTTPS and restart HDFS:...
View ArticleReply To: Hive ORC format
Create a Hive table as text and another one as ORC. ie. table_stg and table_base Load up the text table then do a insert overwrite into table_base and select * from table_stg.
View ArticleNagios Dependency
File “/usr/lib/python2.6/site-packages/resource_management/core/shell.py”, line 90, in _call raise Fail(err_msg) Fail: Execution of ‘/usr/bin/yum -d 0 -e 0 -y install hdp_mon_nagios_addons’ returned...
View ArticleReply To: oozie workflow fails for hive query of ORC table
I have the same issue running an oozie workflow….have you found a solution?...
View ArticleHDP2.2 Hue 2.6.1, issues with log tab in Hive Editor (beeswax)
I installed HDP2.2 using ambari 1.7 and manually installed and configuredd hue as instructed on this page....
View ArticleReply To: HDP2.2 Hue 2.6.1, issues with log tab in Hive Editor (beeswax)
Hello, I am also having this issue with the same version. I have noticed especially when I insert into a table I dont see any log via beeswax hue. IF I run the same statement through oozie its all...
View ArticleReply To: Execute on Tez
I also dont see the checkbox on my install. I just add the following setting in bees wax which does the same thing. You can set this in ambari website under Hive as a default if you wish key =...
View ArticleJA017: Unknown hadoop job
Hi I am getting this error when i am trying to run pig job: I am trying to schedule it over cluster that i had setup using HDP2.2 and ambari1.7 JA017: Unknown hadoop job [job_1425653747034_0055]...
View ArticleUnable to run the custom hook script error
I had added custom service using steps described here https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133. It was successful, but then I was not able to start cluster. Then I...
View ArticleReply To: NameNode not running, port conflict
Hi there I have in the same problem. Anybody who has a solution please let me know. Timothee for example, can you please tell how exactly you solved this issue?
View ArticleHow to configure Hadoop to use LDAP group mappings?
Hello, I have been trying to configure Hadoop to use LDAP group mappings by following this link :http://hortonworks.com/blog/hadoop-groupmapping-ldap-integration/ The services.ldif file mentioned in...
View Article