HIVE Table Updates/Deletes
Has any one worked on updating/deleting the Hive tables. For some reason it is not working for me. I have created the table with Tableproperties=’transactional’ and ensured that hive.support...
View ArticleReply To: Port in use when starting Name Node
The problem is not with ports but with host configuration. I’m using a cloud system and there are 2 IP addresses one public and one private, this created some confusion (in my analyses) of the...
View ArticleReply To: HBase Hive Integration
As per the documentation provided by Apache HBase they are still not supporting this requirement(accessing HBase time stamp from Hive).
View ArticleSet up of MapReduce JobHistory Server fails.
Hello, I have configured a three node HA cluster on CentOS 7 (hadoop-1,hadoop-2,hadoop-3) with the following services: hadoop-1 –> JournalNode, NameNode, DataNode, DFSZKFailoverController,...
View ArticleReply To: Set up of MapReduce JobHistory Server fails.
Ok, After a general review of all the config files, I found the cause of the problem: It was a misconfiguration in the cluster name declared in hdfs-site.xml in the mentioned entry that should write...
View ArticleHive ORC
I tried creating Hive (0.14) table using stored as ORC. When inserting from query editor it failed. so I tried creating the table using bucket and table properties (transaction true) and insert data...
View ArticleReply To: Hive ORC
Hive 0.14 only requires bucketing and transactional tables if you want to use transactions. A few questions: 1) Is the transaction manager turned on in your cluster? To find out you can ask your hive...
View ArticleReply To: Zookeeper connection refused
Hi, I have been trying to connect to hbase table through Java api. “WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception:...
View ArticleReply To: Hive ORC
Thanks for the response. 1. Yes, hive.txn.manager manager is set to org.apache.hadoop.hive.ql.lockmgr.DbTxnManager 2. Using buckets , my oozie workflow fails with “ERROR : Failed with exception Unable...
View ArticleReply To: Hive ORC
For security reasons. can you please mask the error message after viewing? I quickly hit submit before masking the host name …Thanks.
View ArticleReply To: Hive ORC
I’m confused. Is your goal to get Oozie to work with a transactional table or to get an insert to work on a particular table and you do not care if that table is transactional? The following answer...
View ArticleReply To: Hive ORC
It’s a poc and my goal is to get my insert work via oozie. I have transaction set to true while creating the table. I read that transactional must be set in Hive 0.14 ; otherwise deletes and updates...
View ArticleReply To: HBase dashboard
HBase comes with a Web UI on the master for looking at regions and system level activity, but nothing related to data browsing. The Hue that comes with HDP does not have an HBase dashboard. If you...
View ArticleClik here to view.
Reply To: HDFS Transparent Data Encryption
Okay one more issue many users facing is how to test if your encryption is working properly or not, isn’t it ? okay here is my second and most useful usecase Edit...
View ArticleMALLOC_ARENA_MAX, where to set
I have a yarn application (camus – for reading data from Kafka, and writing to HDFS) which is running out of virtual memory. It is using 4Gb of real, and 11 of virtual memory. I am worried that –...
View ArticleReply To: MALLOC_ARENA_MAX, where to set
In the end I raised the amount of virtual memory allowed and that seemed to be ok. I am not 100% sure whether I am hitting the “exploding virtual memory” problem on RHEL6 or not.
View ArticleReply To: Pig Jobs fail silently in HUE
Can you run the same pig script from the command line? Are you trying to run the script as the hue user, or a different user? What logs did you look in? What does your YARN application UI look like?...
View ArticleHue runsupoervisor
Hi Could any one tell me whats the issue here /usr/lib/hue/build/env/bin/hue runcpserver starting server with options {‘ssl_certificate': None, ‘workdir': None, ‘server_name': ‘localhost’, ‘host':...
View ArticleReply To: What Replication Factor does MR use?
It looks like the setting I was missing is mapreduce.client.submit.file.replication This is 10 by default, but is not automatically lowered if there are fewer than 10 data nodes. (It is different in...
View ArticleBest Match query o/p
Hi All, Need urgent solution. I have a Hive query with 1 AND clause and 10 OR clause. WHen I execute the hive query I get 5 records as O/P. My requirement is to fetch the best matched record. In this...
View Article