I have created an external table with location pointing to a HDFS folder. Have added two level of partition /yyyy/mm. Each mm folder has a hdfs file with header and trailer as first and last row.
In external table DDL, for table properties, have set skip.header and skip trailer = 1.
While reading the external table with select query, the trailer record for few files are not skipped, where as a data record is being skipped. In the select query output I can see the trailer record, where as a data record is skipped.
↧
HIVE External table – skip trailer issue
↧