Hi All,
I have a table in Teradata which is loaded with new data on daily basis.
I need to import this data to Hive. I’m trying to use Sqoop but how should I do incremental load using Sqoop?
I checked incremental load options available in Sqoop
–incremental append –check-col err_Date –last-value some_value
This query works for me but the problem is if –last-value is 23rd then it will load data for 24 .but if I’m running on 23rd morning then again on 24th morning will it load data of 23rd evening? If not what will be solution?
How can I do incremental imports to Hive in this case?
Please suggest