Reply To: storing data in hive in orc format through Java Spark API
Thanks Ankit for posting the solution, that worked great.
View ArticleComputing the difference between two counters on successive events in Pig
For each user, we need to compute the difference beween the counters of two consecutive events: Input: user_id, counter, time_stamp USER_1, 30000, 2015_03_01 USER_2, 20000, 2015_03_01 USER_1, 40000,...
View ArticleHUE Errors
I installed HUE, following the Hortornworks documentation: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/ch_installing_hue_chapter.html When I first...
View ArticleDoes output-events create file/directory?
In oozie, the input-events are straightforward. It looks for the list of files/folders mentioned in the data-in tags and if those are not available, the action is put in WAITING state. My question is...
View ArticleReply To: Unable to setup Kerberos for my hdfs on Azure
i am finally complete the ‘enable kerberos wizard’ without problems. And restart the corresponding services. However, when i try to access http://xxx.cloudapp.net:50070/webhdfs/v1/?op=liststatus with...
View ArticleReply To: HUE Errors
I have resolved a couple of misconfiguration and tool bar issues, the three remaining are: Misconfiguration: Beeswax (Hive UI) The application won’t work without a running HiveServer2. As far as I can...
View ArticleReply To: Running Wordcount on HDP on Centos 6.3
Hi, I met the same problem. Could you tell me your solution?
View Articleunable to access hdfs with AD account with Kerberos enabled
Dear experts, I have kerberos enabled via ambari. I am able to access hdfs after creating a ticket using any account stored in the kdc database, which uses the kdc realm name. However, I am unable to...
View ArticleReply To: HUE Errors
Being a Hortonworks partner, I am beginning to think that this forum is pretty useless, no one looks at this or cares to respond.
View ArticleStart Ambari Metrics Fails
I have two servers running Ubuntu 14. I have successfully installed and started HDP except for the Metrics Collector Service. When I start the service i get the following output from Ambari trying to...
View ArticleFailed with exception Unable to move source hdfs
Part 1) – The problem description: I have run into an error which I have been able to bypass to a degree (see Part 2), but not completely. The Error message is: Moving data to:...
View ArticleUnable to use webhdfs to access after enabling Kerberos
Hi team, I have no where to go except posting a question here. I am using HDP on Azure. Its verion is 2.3. After several attempts, I’m finally able to enable Kerberos for my HDP deployment. Now I am...
View ArticleReply To: HDP 2.0 – SparkR (Spark 1.4)
I found that R is not compatible with RHadoop, and how about SparkR? can help , what kind R version or how to setup it ? The tutorial doesnt have SparkR. agree with gbo, no R there.
View ArticleReply To: HDP 2.2 Sandbox Kerberos with Hiveserver JDBC
1. As ec2-user can you confirm you can access the directory with key tabs? And that the hive key tab exists and has the correct permissions? ls -la /etc/security/keytabs/hive* 2. Extract the hive...
View ArticleReply To: HDP 2.2 Sandbox Kerberos with Hiveserver JDBC
I followed the following guide.. upto ldap https://github.com/abajwa-hw/security-workshops/blob/master/Setup-kerberos-LDAP.md 1) ls -la /etc/security/keytabs/hive* All keytabs:...
View ArticleReply To: unable to access hdfs with AD account with Kerberos enabled
Did you enable a cross-realm trust between your KDC and the AD following this blog post: http://hortonworks.com/blog/enabling-kerberos-hdp-active-directory-integration/ ? See section: “How to enable...
View ArticleReply To: Kite SDK
run the command in -v mode to see the full stack You can create the missing directory manually (<span style=”font-family: ‘Helvetica Neue’, Helvetica, Arial, ‘Open Sans’, ‘Lucida Grande’,...
View ArticleReply To: HDP 2.2 Sandbox Kerberos with Hiveserver JDBC
We brought up a new instance, and things seemed to work I was able to connect to beeline with a ticket obtained for ec2-user Any pointers towards the error on our previous machine ? Why beeline is...
View ArticleReply To: Ambari agent can't register after machine restart (heartbeat...
Hi all, I know this thread is a bit old, but it might be useful for someone else. I ran in the same problem, in my case I installed the ambari agents manually, so I skipped the set of the agents...
View ArticleHDP 2.2 to 2.3 upgrade fails on yarn-site.xml requirements check
Using the automated upgrade, when I try to upgrade I get: “YARN Timeline state preserving restart should be enabled Reason: YARN should have state preserving restart enabled for the Timeline server....
View Article