Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Incremental loads in Sqoop

$
0
0

Hi All,

I have a table in Teradata which is loaded with new data on daily basis.

I need to import this data to Hive. I’m trying to use Sqoop but how should I do incremental load using Sqoop?

I checked incremental load options available in Sqoop

–incremental append –check-col err_Date –last-value some_value

This query works for me but the problem is if –last-value is 23rd then it will load data for 24 .but if I’m running on 23rd morning then again on 24th morning will it load data of 23rd evening? If not what will be solution?

How can I do incremental imports to Hive in this case?

Please suggest


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>