Created 02-07-2018 11:12 PM
We’re trying to do bulk loading of data in Teradata using NIFI. Is that possible in NIFI? Currently we noticed that row by row inserts to teradata is possible but that is not scaling well when it comes to loading millions of records. Teradata has their own set of utility operators: FASTLOAD, MULTILOAD, TPTLOAD, TPTUPDATE, etc that we can use to do fast bulk loading of records into Teradata. Does NIFI support any of these operators? So far I only see the option to run SQL against teradata not utility jobs
Please let me know thanks.
Regards.
-Suhail
Created 02-08-2018 06:50 AM
Try to make use of ExecuteScript using python to replicate the jobs you wanted.
Created 02-08-2018 02:25 PM
You can do execute process to run those or execute stream command.
Does it have a Java SDK for those commands?
https://community.hortonworks.com/articles/45427/using-teradata-jdbc-connector-in-nifi.html
You can use sqoop with: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_teradata-connector-user-guide/content/ch...
Created 02-08-2018 02:56 PM
Is it possible to use sqoop or the Hortonworks teradata connector with NIFI?
-Suhail