This worked great, thank you! ... View more

why do I have "LogAttribute" with QueryDatabasetable processor? its showing a red block on the corner which normally indicates issues I think. from QueryDatabaseTable there are two relations one going to PutHiveStreaming and one going to LogAttribute . why do I need two relationships for success ? (please see attached) capture.jpg ... View more

Hi @Shu, It worked like charm. Thanks a lot for the quick response. ... View more

Hi Shu, that Works Great. Tanx for your sollution. 🙂 ... View more

@Constantin Stanca could you please explain the approach in detail. ... View more

@Jyoti Ambi Instead of doing all this convertrecord processor choose either of below methods. Method1:- Executesql Processor properties SQL Query:- select MAX(CREATE_DATE) CREATE_DATE from one table Then use ConvertAvrotoJSON processor so we are converting Avro data to json Configs:- Your data would be like this [{"CREATE_DATE": "2018-10-12 09:09:09"}] Then use EvaluateJsonPath Processor to get the create_date value as flowfile content Configs:- Output flowfile content from evaljsonpath processor would be 2018-10-12 09:09:09 Then you can use PutFile processor to store your file into Local directory. Flow:- (or) Method2:- If you want header while keeping file into your directory, then in EvaluateJsonpath processor change the property Destination flowfile-attribute Then add ReplaceText processor Configs:- Now we are creating new contents of flowfile by keeping header as CREATE_DATE and in new line we are keeping our create_date attribute value (i.e. 2018-10-12 09:09:09) Output:- CREATE_DATE 2018-10-12 09:09:09 Then use PutFile processor to store above file into your local. Flow:- Executesql --> ConvertAvrotoJSON --> EvaluateJSONpath(destination as flowfile attribute) --> Replace text -->putfile ... View more

@Gopal Mehakare you can use either of execute stream command processor which accepts incoming connections (or) Execute process which won't accept incoming connections based on your requirements to execute linux commands Execute Stream Command configs:- let's consider your input flowfile content is as follows hi hcc nifi output from Execute stream command processor would be just hi because we are executing bash command head -1 on the input flowfile content and output stream relation will transfer hi as new content of flowfile content. Output:- hi Execute Process configs:- The Success relation flowfile content will have just hi in it, as we are executing echo and this processor can run on own(no need of any incoming connections). Output:- hi For More reference:- https://community.hortonworks.com/questions/150122/zip-folder-using-nifi.html https://stackoverflow.com/questions/42443101/nifi-how-to-reference-a-flowfile-in-executestreamcommand ... View more

@Shu Thanks, that works. ... View more

@Chris R To match white space use the below regex ID "ID":\s(.*?), \s matches any whitespace character (equal to [\r\n\t\f\v ]). You can validate your regex here regex We need to match whitespaces if we are using extract text processor,don't need to match any whitespace characters if you are using Evaluatejson path processor to extract content and keep it as attribute to the flowfile. ... View more

Hi @@dhieru singh Thank you for the post , but I am unable to get the values of $.component.backPressureObjectThreshold $.status.aggregateSnapshot.flowFilesQueued after processing the EvaluateJsonPath. ... View more