Rack Awareness in HDP2.3
Hi all.. I’ve been testing out HDP2.3 and noticed rack awareness no longer allows the use of custom scripts in ../conf. I can see there is now topology_mappings.data and topology_script.py. Seems...
View ArticleReply To: Configuration errors of java heap/tez container/yarn resource manager
Hi, I am also getting the S020 Data storage error when running the following query from the ‘Hello World’ tutorial: SELECT TRUCKID,AVG(MPG) AVGMPG FROM TRUCK_MILEAGE GROUP BY TRUCKID; error code...
View ArticleHow many map/reduce tasks for a job on a single node
For one job – how many map/reduce tasks will a single node handle? Yes, I am aware that for a job, there can be multiple map/reducer jobs spread across multiple nodes. And a node can have multiple...
View ArticleHow to assign RPC port for namenode in a non-HA environment
I notice that HBASE configuration requires specifying RPC port for namenode. In a non-HA environment how to specify RPC port for namenode? Because all the options I see for assigning RPC port only...
View Articlecan Hive support select query in the insert statements
Like : insert into table table_1 (columnnames_1, <span style=”line-height: 19.2px;”>columnnames_2</span><span style=”line-height: 1.5;”> ) values (select columnname from table_2,...
View ArticleSanbox HDP2.3 – Add Partition Fails
Out of the box, the new Sandbox HDP 2.3 VM won’t add partitions to an external table, whereas HDP 2.2 is fine. The following code fails on 2.3 at adding a partition: create external table if not...
View ArticleReply To: Sanbox HDP2.3 – Add Partition Fails
Typo correction – the add partition statement being run is actually, i.e. missed typing add: alter table Test01.Test02 add partition(LogDay=’2008-10-29′) location ‘/user/hue/Logs/2008-10-29’;
View ArticleReply To: can Hive support select query in the insert statements
No, it expects the entries in a values clause to be constant expressions. I don’t think what you’re proposing is valid SQL, since the result of a values clause is supposed to be single valued, not a...
View ArticleReply To: can Hive support select query in the insert statements
Thank You Alan for your response, then how can we insert into table with column specific based on a select statement.
View ArticleReply To: can Hive support select query in the insert statements
insert into table t1 (c1) select c2 from t2; will work. The ability to add the columns list (c1 in this case) to the insert was only added in Hive 1.2 (HDP 2.3). So if you are using an older version...
View ArticleReply To: can Hive support select query in the insert statements
I am using hive 0.14 and HDP 2.2 I have tried the above query approach in this environment but it is not working.
View ArticleReply To: can Hive support select query in the insert statements
Right, this won’t work in Hive 0.14. For that you’ll have to do: insert into table t1 select c3 from t2; if there are columns in t1 that you don’t want to select values for, you can assign a null in...
View ArticleRanger 0.4.0 using Ambari 2.1 at HDP 2.2 in AWS
Hi I have HDP 2.2, wanted to go for Ranger installation using Ambari so upgraded Ambari 1.7 to Ambari 2.1 , this went on fine Now while installing Ranger it Errors while connecting to MySQL as root,...
View ArticleUnable to install client only services (HDP 2.3/Ambari 2.1.1)
I have a cluster running HDP 2.3.2.2 and Ambari 2.1.1, with the following services enabled: ACCUMULO AMBARI_METRICS ATLAS FALCON FLUME GANGLIA HBASE HDFS HIVE KAFKA KNOX MAHOUT MAPREDUCE2 OOZIE PIG...
View ArticleHDFS Command is taking too much time
HDFS commands are taking around 12 seconds on hadoop 2.7.1 release, while on the same hardware if I install hadoop 2.4 release, hdfs commands are taking less than 3 seconds. e.g. <span...
View ArticleReply To: HDP Streaming Job with C# Mapper/Reducer and Configuration File
its a late reply, still some one could be benefited out of it. You can provide the configuration parameter as part of the like -D...
View ArticleClik here to view.
Cannot access WEB UI
Hi guys, We have installed HDP 2.3 on a five node cluster via Ambari (cluster nodes are CentOS7 VMs, created via OpenStack client). When we have tried to access web UI, the url is in the form...
View ArticleHDP 2.3.2 Spark Tutorial – permission denied
After downloading Hortonworks Data Platform 2.3.2 and loading it into VirtualBox on mac os x yosemite, I started the first tutorial for Apache Spark. But I didn’t get far. the command to copy the...
View ArticleH060 Unable to open Hive session
Hi all, I am trying to configure the Ambari Views. I could configure Ambari view for Files and PIG following the documentation present. For setting up HIVE view also I followed the documentation but...
View ArticleReply To: Sqoop EXPORT to Oracle failing – 'There is no column...
More information: It looks like sqoop is able to recognize the table and columns initially, but then errors out: /usr/bin/sqoop export –connect jdbc:oracle:thin:@oracle11:1521:orcl –username test...
View Article