We will import updated row and already we imported that row in earlier import.so now we will have those 2 rows,how can we avoid this ? ... View more

@ssharma Thank you.. I will try with this ... View more

@Jay Kumar SenSharma Thank u.. do u have any idea abt installation of NiFi on HDP cluster? ... View more

Hi @Aditya Sirna, I want to schedule this job so I can not give value like 3 or something else,dynamically it should take. ... View more

HI @Aditya Sirna, Thanks for response.. I need to load hive table incrementally,in my source table batchid column is there, I tried --incremental append --check-cloumn batchid.. whn I run 2nd time records are getting double.How can I achieve my this with out duplicates. sqoop import --connect "jdbc:sqlserver://10.21.29.15:1433;database=db;username=ReportingServices;password=ReportingServices" --check-column batchid --incremental append -m 1 --hive-table mmidwpresentation.journeypositions_archive --table JourneyPositions --hive-import -- --schema safedrive ... View more

Hi @Shu, Thanks for response.. I need to load hive table incrementally,in my source table batchid column is there, I tried --incremental append --check-cloumn batchid.. whn I run 2nd time records are getting double.How can I achieve my this with out duplicates. sqoop import --connect "jdbc:sqlserver://10.21.29.15:1433;database=db;username=ReportingServices;password=ReportingServices" --check-column batchid --incremental append -m 1 --hive-table mmidwpresentation.journeypositions_archive --table JourneyPositions --hive-import -- --schema safedrive ... View more