Member since
06-16-2017
10
Posts
0
Kudos Received
0
Solutions
06-26-2017
03:22 PM
1 Kudo
Hi @Sateesh Mandumula For reading from the RDBMS, you can use processors like QueryDatabaseTable or ExecuteSQL. Hive now supports Merge which should cover your update else insert requirement, you can try using a PutHiveQL and seeing if you can issue the merge command using that. Here are some relevant links to the documentation that should help: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.3.0/org.apache.nifi.processors.standard.QueryDatabaseTable/index.html https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.3.0/org.apache.nifi.processors.standard.ExecuteSQL/index.html https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML#LanguageManualDML-Merge https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-hive-nar/1.3.0/org.apache.nifi.processors.hive.PutHiveQL/index.html
... View more
06-21-2017
12:36 PM
Hi jay I tried above command but it is throwing me below error jdbc:hive2://xxxx.com:10000/default;principal=hive/_HOST@EXAMPLE.COM nifi-kerb.jpg <property>
<name>hive.metastore.kerberos.keytab.file</name>
<value>/etc/security/keytabs/hive.service.keytab</value>
</property>
<property>
<name>hive.metastore.kerberos.principal</name>
<value>hive/_HOST@EXAMPLE.COM</value>
</property>
... View more
06-19-2017
09:04 AM
2 Kudos
@Sateesh Mandumula Obviously You cannot have transactional Properties on top of external table as Hive just reads the file present in HDFS. Its not suppose to change the content of the External files. If you really want to use Transactional Property, Create an internal table select * from external table and use transaction properly on this internal table.
... View more