question Re: NiFi: Hive dynamic variable in Archives of Support Questions (Read Only)

NiFi: Hive dynamic variable

ashsskum — Thu, 08 Dec 2016 01:00:14 GMT

In Hive script, we can set the variable and use in query. Is there a way to achieve the similar behavior with ReplaceTextWithMapping prior to sending to PutHiveQL processor. If it was one query, I could use the ReplaceText, but for multiple queries with different binding arguments, I am wondering if we could do that with ReplaceTextWithMapping processor.

hive> set name='Kumar';
hive> set department='IT';

hive> select * from emp where last_name = '{name}' and dept_name = '${department}';
hive> select * from emp where last_name = '{name}';

Re: NiFi: Hive dynamic variable

knarayanan — Thu, 08 Dec 2016 01:25:56 GMT

you can use expression language.

in you selecthiveql query you put your query as select * from tmp where last_name=${name}.. name will be replaced by the attribute value from your previous processors flow file. So add an updateAttribute before the selecthiveql processor and add attribute name with whatever value you want to set.

Re: NiFi: Hive dynamic variable

ashsskum — Thu, 08 Dec 2016 14:46:30 GMT

I realized PutHiveQL supports parameterized Hive query and I went for that.