Hi,   We are processing ZIP file contains multiple timestamp files (.hiveql,.csv) in distributed manner . We check the file extension whether it is .hql or .csv then we route the file to execute it PutHiveQL and PutHDFS processor respectively. The files(timestamp order starts with for example t1 or system timestamp)  below contains in ZIP file to be extracted and processed in order. table_info.zip     table_info_t1.hql table_info_t1_1.csv table_info_t1_2.csv table_info_t2.hql table_info_t2_1.csv table_info_t2_2.csv table_info_latest.hql table_info_latest.csv       Please find the below NiFi flow and RouteonAttribute property     Is there any way to make us to wait first puthivesql executes first and give indication to putHDFS execution next for each timestamp file one by one order.   Can we group each timestamp files into group and process the .hql file and the put .csv file into HDFS?     @Nifi ... View more

Hi All,   We are getting the below error intermittently for some tables and we have hive 3.1 . I am passing a sample query like insert into table test as select * from some table in Nifi PutHiveSQL processor .    Hive target table is managed table and stored as avro format   Error : PutHive3QL[id=d1652e76-54f7-30cf-8dc8-b1934cee3c26] Failed to update Hive for StandardFlowFileRecord[uuid=7447e7f0-4d1e-40fa-9965-5c98f7d11341,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1618924236521-4, container=default, section=4], offset=154416, length=3631],offset=0,name=20210421_test_branch_info,size=3631] due to java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask. MetaException(message:Cannot change stats state for a transactional table ra_test.test_branch_info without providing the transactional write state for verification (new write ID -1, valid write IDs null; current state {"BASIC_STATS":"true","COLUMN_STATS":{}; new state {"BASIC_STATS":"true","COLUMN_STATS":{}); it is possible that retrying the operation will succeed, so routing to retry: java.sql.SQLException: Error while compiling statement: FAILED: Execution Error,   Option tried : if we rerun the query for the same table through Nifi PutHiveSQL , then Nifi processor executes the query fine . sometimes it fails in the first run.   Hive version : 3.0 and Nifi 1.11.4 Please assist what option to be checked in Hive side on this error.     Thanks ... View more

Hi All,   I am trying to build JSON string using Ifelse condition in ReplaText processor but i am getting error as invalid Invalid Expression .   Working Ifelse condition :  ${status:contains('0'):ifElse('Success','Failed')}   This below string is not working and it is throwing invalid expression . Please assist on this .   ${status:contains('0'):ifElse('{ "filename":"${overall_filename}", "status":"${status}", "message":"${overall_message}" }', '{ "filename":"${overall_filename}", "status":"${exc_status}", "message":"${overall_message}" }' ) }   Thanks ... View more