Reply To: Storage for nodes
Do you mean you have 3 physical nodes, each of which has 16Tb. > How much storage is considered good for every single vm How much do you need? I don’t understand the question. Only you can figure...
View ArticleReply To: TEZ performance ?
ok i understand, when i launch tez sample it use TEZ because specfic TEZ implemetnation in java code sample , but if launch pig or hive task with hue gui, it use classic map reduce that why i have no...
View ArticleUnable to start any components on cluster
Hello, I followed this guide: http://docs.hortonworks.com/HDPDocuments/Ambari-2.0.0.0/Ambari_Doc_Suite/ADS_v200.html#Installing_HDP_Using_Ambari I’m using Ubuntu 12.04.5, HDP-2.2.4.2. I have used the...
View ArticleReply To: Maven / POM setting for HDP 2.2
Hi, I have been successful using the Hortonworks Maven repository by using the following <repository/> and <dependency/> tags in my pom.xml file. You should look at the repository search...
View ArticleReply To: HDP Installation using Ambari 2.2
Yes it was a typo. I am using ambari 2.00 to install hdp 2.2. I will try again today and see if it works.
View ArticleReply To: Unable to start any components on cluster
I resolved the issue. In the .log file I kept seeing: (DataNode.java:2402) 2015-05-14 11:49:51,657 WARN datanode.DataNode (DataNode.java:checkStorageLocations(2284)) - Invalid dfs.datanode.data.dir...
View ArticleReply To: Storage for nodes
Thanks for your answer. Yes that I meant. Is it good practice to have all vms-workers with exactly same size of local disk ? Basically i am not sure how to distribute storage in all vms. I have dual...
View ArticleReply To: LOAD DATA LOCAL INPATH – fail
As it turns out it’s not anywhere else that’s problematic, it’s just that files any sub-directory of /home except for /home/hive are invisible to beeline. As root I created another sub-directory under...
View ArticleReply To: Ranger login
You might want to the check logs in /var/log/ranger/admin. Both portal.log and catalina.out for any errors.
View ArticleReply To: HDP2.2.4.2 Ambari 2.0 changing UID of hbase user and fighting with...
General guidance on integrating HDP and Ambari into a puppet managed environment would also be helpful.
View Articleproblem management job slider
Hello, i install slider 0.61.0 for hadoop 2.6.0 i make resource.json and appConfig.json for install memcached on hadoop i make install my zipfile on hdfs under my user/.slider/package/MEMCACHED – no...
View ArticleReply To: problem management job slider
is slider 0.70.1 compatible with hadoop 2.6.0 ? thx
View ArticleReply To: problem management job slider
i get same error with slider version 0.70.1 something about uf8, hummmm! i must eat the python programfor know what it do and undestand why it doesnt work
View ArticleReply To: problem management job slider
i use python 2.7, wich kind of version is required for hadoop 2.6.0 ?
View ArticleAmbari Env Scripts
Just rolled out a new 2.2 cluster w/ Ambari, which was awesome, but now when I hit the shell with my user, I don’t have the right JAVA_HOME set in my env. Is there something I should source on login...
View Articlebuil falcon 0.70
i try to build project falcon, because no tarball available, i use version 0.70 for hadoop 2.6.0 and oozie 4.1.0 build seem working at begining but after a long while of compilation , but i get error...
View ArticleChange in the DataNode directories !!!
I have installed the HDP 2.2 with Ambari 2.0. I’m facing a big issue – I had kept the DataNode directories as :...
View ArticleHIve-HBase integration
Hello I have HDP sandbox 2.2.4 installed on my laptop. I tried to do Hive HBase integration. However I cannot create a table. Here is the commands I run on Hive: add jar...
View ArticlePig Job hung on accepted State
I have a small hadoop cluster and a bunch of files that I want to do some etl on in using pig, when I have 3 files it works ok, but when I have more (around 30 per folder) is just waiting at the...
View ArticleReply To: Problem upgrading to version 2.2.4.2
Alright motherf*ckers, After reverting back from snapshot, gave it another go, was following exact same procedure from the link above: “Manual HDP Stack Upgrade: HDP 2.2.0 to 2.2.4″ This time, I’ve...
View Article