Reply To: Importing snapshots from Amazon S3 to HBase
Hello, I am having an issue with exporting to S3, wondering if you could give any advice…. I get an error saying: 2015-04-27 05:39:49,547 INFO [IPC Server handler 0 on 40333]...
View ArticleReply To: Importing snapshots from Amazon S3 to HBase
An update: In my S3 Bucket I can see a folder structure for the “2HBASE-SNAP_X” Snapshot however there is nothing actually written to it…. The process fails after 2015-04-27 08:59:27,305 INFO [main]...
View ArticleDisabling namenode HA
Hi all, I’m getting a lot of trouble with the namenode HA mode I just enabled in my test cluster, and I would like to disable it. Is there an automated way to do it? The only doc I found about this is...
View ArticleReply To: NN HA: Active name node switches
After more research, I found the active NN shut down by itself after failed to write to all the JNs with the following log: 2015-04-24 14:30:09,836 WARN client.QuorumJournalManager...
View ArticleReply To: Ambari config changes blocked
Hi James, Modifying the configuration files manually will not help as when you start the services in Ambari, the configuration will be pushed over the edited file. Can you let me know what version of...
View ArticleReply To: Ambari config changes blocked
Hi Dave, Thanks for the quick reply. I completely forgot to attach version information, sorry. Ambari is 1.7.0-169, and we’re on HDP 2.2.0. I am admin, and I have just logged in again to check the...
View ArticleReply To: Ambari config changes blocked
Hi James, I do not see this happen in Ambari 1.7. If I log into Ambari using admin from 2 machines, then I can edit & save configurations. If I go to Hosts > choose a host > Configs – Then I...
View ArticleSearching the 2.2 docs
Hi, I can’t find the search function for any of the HDP 2.2 documentation. Is there one? Cheers, James
View ArticleReply To: Ambari config changes blocked
Hi Dave, You were right, it only happens if you go via the hosts. Thanks for sorting that out. Cheers, James
View ArticleStorm / Hue port clash
Hi, HDP 2.2.0. I was trying to start Hue without success, and the logs showed it failing to bind to port 8000. Port 8000 was taken by the default Storm config for logging. My solution was to re-assign...
View ArticleReply To: YARN-3227 – Yarn RM not renewing Kerberos Ticket
The fix is shipped with HDP 2.2.4
View ArticleCannot connect to Namenode UI
Hi, HDP 2.2.0 I have a namenode that is not accepting connections on port 50070, although it is actually listening on that port. 015-04-28 13:01:07,162 INFO http.HttpServer2...
View Articleactual physical core used by storm-on-yarn application
I want to fetch the actual physical core used by storm-on-yarn application running in cluster. The ResourceManager & NodeManager rest api’s returns the value of virtual core. I need the value of...
View ArticleReply To: Cannot connect to Namenode UI
Hi James, On the machine where the namenode is running on, can you do a telnet to that port? telnet 50070 If that works, then try that same command from another machine (i.e. datanode) Let us know...
View ArticleCapacityScheduler not being elastic
I am trying to set up YARN MapReduce queues on my system so that I don’t have individual jobs sucking up all the resources on the cluster. However I still want the cluster to be 100% utilised if there...
View ArticleReply To: CapacityScheduler not being elastic
So, I think I may have answered my own question. I was running my test jobs as one user and I see that I have yarn.scheduler.capacity.root.ingestion.user-limit-factor=1 meaning that no one user can...
View ArticleReply To: CapacityScheduler not being elastic
Increase the user-limit-factor About the user-limit-factor: “The multiple of the queue capacity which can be configured to allow a single user to acquire more resources. By default this is set to 1...
View ArticleIssue with HDP repositories
I’m installing HDP 2.2 using Ambari on a 3-node RedHat 6.4 cluster. Everything is working fine, configured the proxy address also, but in the last step when I try to install the packages the...
View ArticleReply To: Issue with HDP repositories
Have you configured yum to also use the proxy under /etc/yum.conf? Guide here: http://www.centos.org/docs/5/html/yum/sn-yum-proxy-server.html
View ArticleIssue with Oozie Start
I have installed OOzie Manually with HDP 2 (Centos 6.6). Everything went well without any error message. But when I try to start OOzie using command: su -l oozie -c...
View Article