Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Insert overwrite for 2 GB data

$
0
0

I am running
insert overwrite table emp_rc partition(year) select *,year_num from table1;

table1 size is 1.8 GB and this table is textfile, while emp_rc is RCFile.
When i run this sql, it takes 1 hour, I have set mapreduce.job.reduces = 30 and now it takes 15 mins.

Can you advise, what else I can do to improve performance.
Can you explain how to analyse explain plan for such type of HQL.


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>