Hello all,  I am trying to get a rowcount from hdfs location, then depending on the number, send out an email to flag that directory.    So here is my flow: GETHDFSFILEINFO -> COUNTTEXT -> EXTRACTTEXT -> ROUTEONCONTENT -> PUTEMAIL I need help with the EXTRACTTEXT configuration for this flow, here is the contents of the flowfile coming from the extracttext: { "objectName" : "**************", "path" : "************", "type" : "directory", "owner" : "***********", "group" : "hdfs", "lastModified" : "************", "length" : "5501268", "replication" : "0", "countFiles" : "38", "countDirs" : "6", "permissions" : "***********" }   So I am using the "countFiles" and want to just extract this value with the EXTRACTTEXT processor. Can someone please help me with the proper configurations?     @Matt    ... View more

Hello, I want to perform a simple mathematical operation on a json attribute. I simply want to subtract 30 from the value.  Any help would be appreciated ... View more

Hello Experts, I would like to create a NiFi flow to output the count of files in a hdfs. The file is coming out in parquet format. I have 2 critical needs: 1) filename/yearmonthday 1a) I want expression language to pick up all days  1b) So it'll look like filename/201912*...... where * is any of the days (1-31) 2) I want to count how many files are within that time frame.    Thank you for any help @mburgess        ... View more

I'm curious about how a flow would look. So I have written a spark program to determine missing data between my source(Oracle,keeps deleting files) and my destination(IBM DB2).  I bring in the data into my nifi flow with GETHDFS and it brings in the primary keys of the data that is missing, I want to then use these primary keys to run a process that will delete them from destination(IBM Db2).  Any help would be appreciated.     ... View more

Hello, I am curious if it's capable through scripting or another measure to start NiFi Processors/process groups in a specific manner. Any help or leads will be appreciated.   ... View more

Good Morning,  Is it possible to simultaneously clear the state of multiple processors? I have 108 different process groups and I want to see if there is a way to clear the state of the QueryDatabaseTable in each process group without manually going into each one and clearing it. Any ideas/suggestions would be appreciated.   ... View more

Hey, I have received this error from my SELECTHIVEQL, it routes the failures to a putemail and routes the successes to a CONVERTAVROTOJSON I've researched this error code but haven't found anything useful.. ... View more

Hey so when I configure a controller service, can I specify it down to one process group? I have a sitetositebulletinreportingtask and it's located outside of the 3 major process groups for my company, I only want it to be located in my process group, process_group_A @mattburgess ... View more

Good Morning, So I am getting a batch error when data flows into my PUTSQL, I believe it's because of the data coming in from one column, that column contains line formatting such as "\n" and "\r" so I believe that's what's causing the issues. I just need help on formatting the column to return, I've tried replace(COLUMN_NAME, '\n', ' ') as COLUMN_NAME but this still fails. please help ... View more

Hey, so I want to use a flow(open to change) that goes like this: QueryDatabaseTable(Oracle source) => ExecuteSQL=> RouteonAttribute => [ PutDatabaseRecord(insert) => PutdatabaseRecord(update)](IBM/DB2) I want to use the Route on Attribute to flow directly to the PutDatabaseRecord based on the Primary Key of the Tables. i.e if the PK exists, route to Update and if it doesn't route to Insert. Any Help would be greatly appreciated. ... View more

I want to configure the mergecontent processor so that when it flows to the putemail processor, it lists all the individual flowfiles within the email that it sends out. As of now I am getting just one line of text from the putemail and it has one line of text " Greetings, 172927055__________ has failed to load in into ______________________ at but succesfully loaded into HDFS" I would like to receive a list of files that failed to load, not just one new flowfile number. Please help. ... View more

Hey, I'm receiving a special character error in Apache Nifi, I have 4 columns that could be causing it: UCR_COST_IN_$, ACTUAL_COST_IN_$ or REQUESTED#, ASSIGNED# any help or solutions would be greatly appreciated! ... View more

Good afternoon from your inept Jr. Developer, I am trying to create a NiFi flow from ORACLE to IBM DB2 z/OS. I am encountering issues when it's coming into the PutDataBaseRecord form the QueryDataBase Table. I have a column named "notes" that is of data type CLOB. I have read this can cause serious issues. I could be incorrect on that being the issue, I have the error message posted below. Any help is appreciated. ... View more

Hello, so I am stuck on this NiFi flow, everything will flow correctly until I get to the PutSQL, when the flowfiles are queued between the CONVERTJSONTOSQL AND PUTSQL, 'view' content looks like: "INSERT INTO [new_table_name] (Column_name1,Column_name2,Column_name3,Column_name4,Column_name5,Column_name6,Column_name7,Column_name8,Column_name9,Column_name10,Column_name11,Column_name12,Column_name13,Column_name14 ) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?) The ??????? are where I believe my error is and it's probably due to my SQL Statement in the 2nd picture below, any advice or help would be greatly appreciated. ... View more

Good Morning, I have a problem with conversions in NiFi. I have a large amount of tables in Oracle that I need to transfer via NiFi into one of ten set tables. I am very new to NiFi and am running into a big problem in which I have a column name in Nifi i.e "Birthday_Date" but the column name for that type of value is "B_Day_Date" in the new preset tables. How would I go about converting this in Nifi? ... View more