History server startup issues
Hi all, I just setup HDP2.3 on some virtual machines in Azure using Ambari 2.1.2. I cannot get MapReduce to start, since the History Server keeps on failing with the following message: stderr:...
View ArticleReply To: HDP2.3 /CentOS7 installation problems
It seems like the /usr/lib/python2.6/site-packages/ambari_agent/HostCleanup.py <span class=”st”>is actually deleting files from yum/rpm governed packages without removing package the from the...
View ArticleReply To: Kafka Producer error.
Alexey solution worked for me. Mahalo Alexey. localhost (<span style=”line-height: 1.5;”>127.0.0.1) and port 9092 is the issue.</span> # find the inet addr (e.g., eth0) or use <span...
View ArticleRequired executor memory is above the max threshold of this cluster
Hello Everyone, We would like to know how to change the executor memory threshold. We have installed SAP HANA Spark Controller on our HDP 2.3.2 (requirement for SAP HANA VORA) and tried to start spark...
View ArticleHive and Xpath Problem
Hello Hortonworks Community, I run the Hortonworks Sandbox and i have problems with Xpath. I loaded this simple xml-File into the HDFS and then in a single column table. <?xml version=’1.0′...
View ArticleReply To: Required executor memory is above the max threshold of this cluster
I suspect you are setting max allocation too small. Please check the following configuration in yarn-site.xml whether it is 512M. IMO, 512 is too small for most of applications. Please increase it...
View ArticleI have to analyze Ambari source.
I have to analyze Ambari source to apply for new application. But too many lines for me to do it. I even do not know what I have to do now for analyzing it. Please tell me how can I start with to...
View ArticleHow to add a new service to Knox0.6.0 in declarative way???
Hi all I want to add our own service to Knox 0.6.0 in HDP2.3 . This service can be deployed to HDP2.3 through Ambari2.x. It is a server has a LDAP or DB as user store and authentication. How can I...
View ArticleReply To: I have to analyze Ambari source.
Hi Jaehyeon Ambari Wiki might be of help. Also please review Ambari GitHub page. Thanks & Rgds Venkat
View ArticleReply To: Accessing Hive From Spark Issue
Hi Dhruv, I was experiencing the same problem with Ahmed’s and after specifying the datanucleus jars like you said, my Spark application was able to proceed. However, I’m encountering another problem...
View ArticleHCAT returns NPE when hive.security.authorization.manager not set to default
When hive-site parameter hive.security.authorization.manager is changed from default org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider to...
View ArticleReply To: HCAT returns NPE when hive.security.authorization.manager not set...
Forgot to mention that Hive version is 0.13.0.2.1
View ArticleGC Overhead Limit
Hello, I get random GC Overhead limit exceeded error when I use Hive (on Tez). It seems to happen when I get significant (but not massive) amount of data using HiverServer. I have to restart...
View ArticleFalcon Tutorial / Entity Scheduling Error / FalconWebException / E1004
Hi – good morning! unfortunately the falcon tutorial (Link to Tutorial) does not work for me. I’ve successfully done this tutorial weeks ago with another sandbox version. The problem is: I get an...
View ArticleReply To: Required executor memory is above the max threshold of this cluster
Hi Jeff, thanks! We have changed the value of this parameter to 15872 MB (almost 16GB) but still facing the same issue. Are there any parameters that we also have to change?
View ArticleReply To: YARN containers being killed – memory configuration ignored (?)
I had to recreate my cluster before I could try this out, and found that when I changed YARN memory limits Ambari suggested a load of other configuration changes to go with it, including MapReduce...
View ArticleReply To: HDP2.3 /CentOS7 installation problems
I also think the same. Although I installed everything (ambari did not succesfully run all services though). I find that storm is going down and so are other services with connection refused. I am...
View ArticleData node installation problem Ambari server 1.7
I’ve installed Ambari server 1.7 with two slave nodes. Everything goes well but in the Install, Start, Test I will get this error for my datanode: I searched a lot but I couldn’t find the solution....
View ArticleReply To: HCAT returns NPE when hive.security.authorization.manager not set...
SQL Standard authorization mode is supported only with HiveServer2. This is because it can be relied to secure access only if direct access to file system is not given to the users. Users having...
View ArticleUnable to start Name node – java.net.ConnectException: Connection refused
Hi I am New to hadoop and trying to setup single node hadoop cluster on Ubuntu 12.04 using Ambari <span id=”i18n-121″>Version</span> 2.1.2 while starting the name node i am getting error...
View Article