I tried creating a custom.properties file with a variable for the below and defining that in nifi.properties file (nifi.variable.registry.properties=./conf/custom.properties). However, it invalidates the processor. Is there any other way to parameterize the following? PutHDFS Hadoop Configuration Resources PutHiveQL Database Connection URL Hive Configuration Resources ... View more

If we create HiveConnectionPool controller service outside of any of the process groups, they do not appear in the dropdown of PutHiveQL to be selected, under any of the process groups. The only option is to create a separate HiveConnectionPool controller service within the process group. Is this expected behavior, if so what are the benefits? On another issue, I noticed if we copy the PutHiveQL processor from process group to another, even if the associated HiveConnectionPool controller service is enabled, when the processor is run it throws the below error. 23:56:07 EST ERROR 01581169-e0a4-10e0-eab4-0f04f9d74f16 PutHiveQL[id=01581169-e0a4-10e0-eab4-0f04f9d74f16] PutHiveQL[id=01581169-e0a4-10e0-eab4-0f04f9d74f16] failed to process session due to java.lang.reflect.UndeclaredThrowableException: java.lang.reflect.UndeclaredThrowableException ... View more

Per documentation, the type of each Parameter is to expected to an integer value that represents the JDBC Type. hiveql.args.N.type What are the JDBC numeral type value for the following data types and can you please advise where the corresponding documentation can be found? INTEGER TIMESTAMP DOUBLE LONGVARCHAR ... View more

In Hive script, we can set the variable and use in query. Is there a way to achieve the similar behavior with ReplaceTextWithMapping prior to sending to PutHiveQL processor. If it was one query, I could use the ReplaceText, but for multiple queries with different binding arguments, I am wondering if we could do that with ReplaceTextWithMapping processor. hive> set name='Kumar'; hive> set department='IT'; hive> select * from emp where last_name = '{name}' and dept_name = '${department}'; hive> select * from emp where last_name = '{name}'; ... View more

I have the following insert statements: 1insert into temp1 values (test1, test2) 2insert into temp2 values (test3) Expected results: insert into temp1 values (100, 200) insert into temp2 values (300) Essentially, I wanted to replace the first query literals test1, test2 with value 100, 200 respectively and for the second query replace test3 with value 300. Can someone help with the mapping file for the above use case? I tried with the following, but it doesn't have any effect. Search Value (RegEx) Replacement values (1)(.*values.*)(.*test1)(.*,)(.*test2) $2 val1 $4 val2 (2)(.*values.*)(.*test1) $2 val3 ... View more

For Hive table of type TEXTFILE, a temporary table gets automatically created like below (for each table that we create), at the time when you try to do an INSERT. Can you please advise if this is an expected behavior and the temp table should be left untouched? values__tmp__table__1 values__tmp__table__2 values__tmp__table__3 . . ... View more