Hi All,
In the link below, we say ” The major compaction will request the lowest inflight transaction id and rewrite the base with the merged transaction that are less than it. ”
http://hortonworks.com/blog/adding-acid-to-apache-hive/
I am curious to know, by rewrite, we mean the entire base file is replaced?, if so, is there any write up round this to showcase how exactly this is done?
Regards,
Sam