Reply To: JA017: Unknown hadoop job
Hi. We have also encountered this issue with HDP2.2 and with security enabled. Since this issue was very hard to locate i thought I should share this. The issue was...
View ArticleReply To: Hive jdbc connection error
@Clovis Ferro Junior, thanks. Your idea worked! Until now I had to specify /usr/lib/hive/lib/* and /usr/lib/hadoop/* in the classpath everytime i wanted my program to work.
View ArticleNot getting the desired output with a Hive query.
Hello All, I have two input files which are ; delimited. I loaded these files into two tables. Both tables contain the information on books. I joined both the tables on ISBN field. Now I am trying the...
View ArticleReply To: webhdfs error: namenoderpcaddress is not specified
Add “namenoderpcaddress” parameter. Example: curl -i “http://haisenberg-pc:50075/webhdfs/v1/input/testData.txt?op=OPEN&<b>namenoderpcaddress</b>=haisenberg-pc:9000″
View ArticleReply To: webhdfs error: namenoderpcaddress is not specified
Add “namenoderpcaddress” parameter. Example: curl -i “http://haisenberg-pc:50075/webhdfs/v1/input/testData.txt?op=OPEN&namenoderpcaddress=haisenberg-pc:9000″
View Articlewrong file permissions on /etc/hadoop
Hi I’m doing an Ambari based multi-node install. for some reason, the file permissions are not set properly and do not allow hdfs and other service users to read and write into their folders. $ su...
View ArticleReply To: Storm and IBM MQ Series
If you want to address this, you can superclass the JmsSpout and put in the missing steps to connect to MQ. Look in the Spout.open() method after it goes to make a connection to the connection factory.
View ArticleManage an existing cluster
I’m currently investigating how (or even if it is possible) to get Ambari setup to monitor / manage an existing cluster. I have so far come across 6 other forum topics with no good answers. Some say...
View ArticleInstallation / Registration Failure
I’m trying to install Ambari for the first time and I can’t get any of the nodes to register. I keep getting messages like: INFO 2015-03-31 20:22:47,824 security.py:48 – SSL Connect being called.....
View Articleunequal disk size
hi all, i’d like to ask a question about how hadoop handle unequal disk size i have hadoop cluster : node1 Filesystem Size Used Avail Use% Mounted on /dev/sda1 20G 6.2G 13G 33% / /dev/sda1 240G 79G...
View ArticleReply To: Tutorial:Real time Data Ingestion in HBase & Hive using Storm Bolt
Hi The changes to POM.XML do work apply to pom.xml in Tutorial-master directory and most importantly rebuild the application using maven The Kafka Spout and HBase bolt are now working without errors...
View ArticleLOAD vs OVERWRITE INSERT PRODUCE DIFFERENT TABLE SIZE!
Hi to everyone, I would like to know whether a problem I am facing with Apache Hive in Azure HDInsight occurs in Hortonworks as well. As follow is the explanation: The size of the table doubles if I...
View ArticleClik here to view.
Reply To: unequal disk size
Hi Tarjo, I suppose that your cluster is only made of 2 datanodes… If you write files with repfactor = 2, HDFS will always try to replicate blocks on distinct nodes. So it is normal that the used...
View ArticleMaven / POM setting for HDP 2.2
Hi, I always have difficulty with setting maven for Hortonworks HDP. Currently i have HDP 2.2 and i need to set POM so that it contain dependencies of all (Hadoop, HBASE, HIVE, STORM and all others)....
View ArticleReply To: LOAD vs OVERWRITE INSERT PRODUCE DIFFERENT TABLE SIZE!
Can you check the total record number of these 2 tables ? The size diff may due to different file format or compression. using “select count(*) from item/item2″
View ArticleReply To: LOAD vs OVERWRITE INSERT PRODUCE DIFFERENT TABLE SIZE!
Already checked, same number of rows (102001), same encoding (UTF-8 w/o BOM) but I dnoticed that in the file with INSERT OVERWRITE, between every field there is a SOH…probably is the replacement of...
View ArticleHive INSERT INTO TABLE overwriting partitions without OVERWRITE specified
Hi everyone – new to the forum and posting with the hope that someone can help…. I have an external table that has one partition (string). I did an initial load of data with dynamic partitions and it...
View ArticleReply To: wrong file permissions on /etc/hadoop
also I managed to get this bug https://issues.apache.org/jira/browse/AMBARI-9867 on HDP 2.2 with Ambari 1.7 a workaround is to manually set the permissions on the ambari-agent folder.
View ArticleReply To: LOAD vs OVERWRITE INSERT PRODUCE DIFFERENT TABLE SIZE!
Please check the field delimiter of table by using: describe formatted <table_name> If the table has the different delimiter, maybe this is the cause for size difference. You can create a table...
View ArticleHDP 2.2 Apache Spark 1.2.0 AccessControlException
Hi, When I trying to run “Run the Spark Pi Example” as described in http://hortonworks.com/hadoop-tutorial/using-apache-spark-hdp/ am I getting below error on my single HDP2.2 and Apache Spark 1.2.0...
View Article