Reply To: Bad substitution error with spark on HDP 2.2
Just wanted to add that, indeed, the solution stands in the command line argument. Modifying my local Spark ‘spark-defaults.conf’ has not solved the issue.
View ArticleHive updates
Hello there, Messing around with Sandbox 2.2 and Hive updates. I’ve created a table, done an insert and updated it about 16 times. According to the documentation, minor compaction should occur after...
View ArticleHDP 2.3 Ambari, Cannot update YARN memory configs
Hi All I have downloaded and installed the Hortonworks HDP 2.3 Sandbox on a VMWare virtual machine. I have upped the RAM to 16GB and the number of cores to 8 on the virtual machine. When I try to use...
View ArticleHow to retrive ambari HDFS disk usage metrics
Hi all i am trying to retrieve ambari metrics. if any one know please reply. for example if i call bellow Rest API i will get CPU utilization data in JSON:...
View ArticleReply To: How do you override the default rpc timeout with MapReduce jobs
Please use, <property> <name>hbase.rpc.timeout</name> <value>time in milliseconds</value> </property> in hbase-site.xml
View ArticleReply To: How do you override the default rpc timeout with MapReduce jobs
You can also set in the configuration in the code, conf.setLong(“hbase.rpc.timeout”, 600000);
View ArticleReply To: How to retrive ambari HDFS disk usage metrics
correction in above first url: http://<ambari-server>:8080/api/v1/clusters/<cluster-name>?fields=metrics/cpu[1430844925,1430848525,15]&_=1430848532904 correction in second url...
View ArticleScoop issue with Oozie
Hi, I am trying to import data from teradata to hive using scoop through oozie. Error : 2758 [main] WARN org.apache.sqoop.tool.SqoopTool – $SQOOP_CONF_DIR has not been set in the environment. Cannot...
View ArticleFinding out which hosts have which components using Ambari Rest API
I’m trying to find out which hosts in my cluster have which components using Ambari Rest API commands. The cluster’s blueprint has a log of which components are on which host, but they do not give the...
View ArticleRun a Service Check using Ambari API command
I have been trying to follow this link: https://cwiki.apache.org/confluence/display/AMBARI/Running+Service+Checks This gives directions on how to run a service check using backend Ambari Rest API...
View ArticleReply To: Hive updates
if you request compaction manually (using ALTER TABLE) does it work? when you set hive.compactor.initiator.on, did you restart metastore? compaction is triggered inside metastore process so it has to...
View ArticleRanger User sync – Unix
Hi, I dont see my newly created UNIX users in Ranger portal. I see the following errors in Ranger logs /var/log/ranger/usersync 29 Jun 2015 15:40:11 ERROR PasswordValidator [Thread-4] – Response...
View ArticleReply To: starting ambari-server is getting failed
Any sucess for this error? Waiting for server start…./bin/sh: line 0: ulimit: open files: cannot modify limit: Operation not permitted …………….
View ArticleReply To: Hive on Tez disabling session mode
> So if I’m correct, Hive-on-Tez always starts one application for one Hive session. Hive on tez always use tez in session mode. > The container reuse is that Tez does not shut down the...
View ArticleReply To: HDP 2.2 Apache Ranger
in ambari select services->ranger->configs then, under ranger settings, for authentication method, select none. save and restart ranger. admin/admin should then work.
View ArticleHow to retrive ambari cluster HDFS DISK USAGE METRICS
Hi all i am trying to retrieve ambari UI metrics. if any one knows please reply. for example if i call bellow Rest API i get ambari metrics in JSON:...
View ArticleReply To: problem add Ranger servcice
We did see this, and for whatever reason, the mysql jar was not under /var/lib/ambari-server/resources on the Ambari server. We copied it from a functioning environment, and all was well.
View ArticleReply To: Scoop issue with Oozie
Hi, I was able to resolve the issue. Problem was the SCOOP statement in the command tag. We should ignore scoop statement and simply write <command>import –table …… </command> . Hope this...
View Articleambari 1.6.1 — install of hdfs fails
my stack: centos6, epel, postgres, ambari 1.6.1, HDP 2.1, etc. Iptables and selinux are disabled configuration: 3 nodes; standalone postgres for ambari/hive/oozie For ambari-server setup I use the...
View ArticleReply To: ambari 1.6.1 — install of hdfs fails
Better to go with Ambari 2.0 (specifically 2.0.1). Ambari 1.6 is a year older. http://docs.hortonworks.com/HDPDocuments/Ambari-2.0.1.0/index.html
View Article