Reply To: Pig using HCatalog issue with AWS based HDPCD Practice Exam
Jianyong, Thank you. Using “org.apache.hive.hcatalog.pig.HCatLoader” rather than “org.apache.hcatalog.pig.HCatLoader” resolved this issue.
View ArticleReply To: Ranger Hive Repository with Kerberos and LDAP
The issue has been resolved. There was password mismatch.
View ArticleRanger: Group/User Permission import
I have perfectly working Ranger setup synchronized with LDAP/AD and using HDFS repository. I would like to import all existing groups/users permissions as ‘Policy’ in Ranger UI, so that there is not...
View ArticleReply To: sqoop spatial data
I also want to work with spatial data using Hadoop and very keen to learn any way to copy data from Spatial database to Oracle, any one ?
View ArticleReply To: Using Hdfs tiered storage
Hi Arpit, As far as I could understand the usage of tiered storage, it was meant for fast access. Now, in most of the cases the latest data would be the most relevant one and hence it should be in the...
View ArticleReply To: How to recover unhealthy node
@Peter Teunissen Could you please explain step-by-step what did you do to restart yarn? What commands ? I am having an unhealthy node and I cannot use my Hadoop at all. The only solution for me now is...
View ArticleReply To:...
Hi, I am getting similar problem.. My Flume Configuration is like below : # Define a memory channel called ch1 on agent1 agent1.channels.ch1.type = memory # Define an Avro source called avro-source1...
View ArticleReply To: Unable to run any oozie job
Hi I am getting below error. could some help me in fixing this issue even after updating the /etc/hadoop/conf/core-site.xml oozie process is owned by oozie. Thanks Ramabadran [root@sandbox ~]# cd...
View ArticleReply To: How to recover unhealthy node
@andrei: It’s a long time ago and I can’t finde my notes so I can’t give you my step-by-step procedure. But, look at...
View ArticleReply To: How configure eclipse W7 execute map reduce java program on remote...
i get new problem, i launch correctly my job under eclipse, in remote mode on my distant cluster linux hadoop 2.6 but when yarn is executing my job, it fail ? grouink ? something is missing somewhere...
View ArticleReply To: How configure eclipse W7 execute map reduce java program on remote...
Hello, ok, i found, after look some jira task about this problem, but it is very curious how its work, it must know localy all file configurations of cluster for send again the configuration already...
View ArticleReply To: OOzie job not running giving no HDFS schema found
I am trying to use HDP and I am getting the same error to run Ozzie through command line. “2015-06-21 13:00:27,437 INFO PauseTransitService:543 – SERVER[sandbox.hortonworks.com] USER[-] GROUP[-]...
View Articlejava 8
Can I upgrade Java to version 8 for HDP 2.1? Are there any constraints that disallow me to do so? Is there any documentation to guide me through such upgrade? Thanks Doron
View ArticleReply To: hadoop-httpfs install issues in HDP 2.2
Hi Michael, On my 2.2.4.2 Cluster, the httpfs installation went successfully after manual cleaning the old httpfs installation. (incl. configs, etc.) After this, I successfully installed the...
View ArticleReply To: Using Hdfs tiered storage
Ok. I tried using mover but its not working as per expectation. I configured my setup such that /data/arpan-hdd directory has policy set to ALL_SSD. The data dir was set to...
View ArticleReply To: Pig using HCatalog issue with AWS based HDPCD Practice Exam
Yadukishore, I was able to complete step 1 from the practice exam without running into any permissions errors: hadoop fs -mkdir /user/horton/flightdelays This is the command I used to create the...
View ArticleReply To: Setting the group of a MR job
Chris – that is brilliant. Why didn’t I think of that?
View ArticleReply To: Using Hdfs tiered storage
Hi Arpan, do you have the logs from the mover run? Also to address your earlier question, HDFS does not perform auto-tiering. We decided to let administrators manage storage policies. You don’t have...
View ArticleReply To: Using Hdfs tiered storage
Hey Arpit, Thanks for the reply. I have enabled the debug logs and it was large so was not getting fit here. I have uploaded the same on google drive...
View ArticleAdd New Host
Hi all, I have created a cluster on a host. Now I would like to add a new host to this cluster but in the page “confirm hosts” there is a error Registering with the server… Registration with the...
View Article