Reply To: Can't copy and paste into VI
Are you pasting directly at the virtual machine window? Like the VMWare or Virtual box Window. That might be the issue. Please connect using ssh, and the cut and past should work. Try also this: On a...
View ArticleHadoop for document archiving
Hi, First of l am newbie to Hadoop and the related system. We are looking for a solution for document archiving and possibly in the future use Hive for data warehouse system. Q1: we are solicitor...
View ArticleReply To: KNOX and HDFS on a secure cluster
Thank you! I just needed to add the link ln -s /etc/hadoop/conf/core-site.xml /etc/knox/conf/core-site.xml and it works now. Now to get ranger to accept the self-signed certificate used by Knox :)…
View ArticleReply To: HDP 2.3 Clean Install – "user root cannot impersonate...
Hi: Did you configure the view? Also, can you access the NameNodee UI at port 50070. There in, utilities, you can browse the filesystem. Also for uploading data, I think you should use another method,...
View ArticleReply To: Hadoop for document archiving
Hello, I am not sure if Hadoop is the right choice for you. There are probably more specialised document stores which will satisfy you better. I would be interested to know why you are looking at...
View ArticleReply To: Hadoop maximum Java heap size recommendation?
What is going OOM? The data node process? Are you also running YARN apps on the data node boxes? Are they using up all the memory when the OOM occurs? What does Gangllia tell you is going on? How did...
View ArticleReply To: HDP 2.3 Clean Install – "user root cannot impersonate...
What exactly do you mean by: So maybe just create a hdfs user and give it a password and logon in Ambari with that user. Create a hdfs user where? In Ambari or at the OS level? I already have an OS...
View ArticleReply To: Hadoop maximum Java heap size recommendation?
Sorry for the multiple posts, wanted to get all the logs in. If by magic formula you meant the yarn util, then yes we did. We dont have yarn apps running on the datanodes and we are on HDP 2.3, my...
View ArticleReply To: Sandbox – Pig Basic Tutorial example is nbot working
Hi All, I figured out the small fix for this issue. It seems that it has been appearing in all the images whether new or old. Just do the below. Pig -useHCatalog And once you get into the pig shell...
View ArticleReply To: HDP 2.3 Clean Install – "user root cannot impersonate...
Create the hdfs user on your machine. I suppose you are using linux, so as root run the command: adduser hdfs and then change the password with: passwd hdfs What is running as root is the Ambari...
View ArticleReply To: HDP 2.3 Clean Install – "user root cannot impersonate...
All three of those users can run that command and view the directory tree. I followed the instructions at your link and added the proxy items for root. Success! I can only upload to \tmp at this time....
View ArticleReply To: HDP 2.3 Clean Install – "user root cannot impersonate...
Yes it’s a very steep climb…. I’m on this for around two months, and I have a full kerberized cluster with Hue 3.9, Ranger and Knox, and this time only for setting up, configuring and basic tests:...
View ArticleReply To: Mahout 1.0 spark-itemsimilarity -D:spark.driver.memory setting not...
You need to use multiple -D: params in this case. E.g: -D:spark.driver.memory=8g -D:spark.executor.memory=4g. Re: the NullReferenceException, due to the way that Mahout spin up its Spark context,...
View ArticleHDP 2.3 Sandbox data load tutorial is not working
Hi I am trying to follow the data load tutorial with HDP 2.3 sandbox. However when I am trying to upload any file for ex users I get the following error. Please help .I am stuck with this issue....
View ArticleInstall Spark on HDP Windows
Hi team, From where I can download and install Spark on Windows 2012 HDP? Regards Tapan
View ArticleApache Falcon on Windows Azure HDInsight
Hi All, Can we install Falcon on Windows Azure HDNishgt? Thanks, Kishore
View ArticleData Node does not start and see connection failed to http://fqdn.com:50075
Hi, I installed HDP 2.3 on Azure platform. I’ve installed HDFS, Mapreduce2, YARN, Tez, Hive, PIG,Sqoop, Oozie, Zookeeper,Flume and Ambari Metrics components. I’ve three data nodes on the cluster one...
View ArticleReply To: Connection failed, [Errno 111] Connection refused
Hello folks, It would be great if you could also pl. share how you solved this. Many thanks, -A
View ArticleReply To: Unable to ssh into sandbox using putty
Downloaded 2.3 and tried logging in to my sandbox – connection refused I have several VMs and even an earlier version of hdp 2.2 – but when I try ssh-ing into newly installed 2.3 I get the same error...
View ArticleReply To: Connection failed, [Errno 111] Connection refused
My two cents: Two things for this to be happening: IPv6 is enabled on the machine and the services are binding to the IPv6 address and not to IPv4 address. YARN, as far as I’m aware doesn’t work with...
View Article