Quantcast
Viewing all articles
Browse latest Browse all 3435

HIVE External table – skip trailer issue

I have created an external table with location pointing to a HDFS folder. Have added two level of partition /yyyy/mm. Each mm folder has a hdfs file with header and trailer as first and last row.
In external table DDL, for table properties, have set skip.header and skip trailer = 1.
While reading the external table with select query, the trailer record for few files are not skipped, where as a data record is being skipped. In the select query output I can see the trailer record, where as a data record is skipped.


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>