@Carlos Try with below spec: [{ "operation": "shift", "spec": { "*": "data.&", "ID": ["ID", "data.ID"] } }, { "operation": "default", "spec": { "dataset": "${dataset:toLower()}", "date": "${date}" } }] Output: { "ID" : "123", "data" : { "ID" : "123", "Text1" : "aaa", "Text2" : "aaa", "Text3" : "aaa" }, "date" : "${date}", "dataset" : "${dataset:toLower()}" } ... View more

@Sampath Kumar ALTER TABLE table SET SERDEPROPERTIES ("timestamp.formats"="yyyy-MM-dd'T'HH:mm:ss"); Works only in case of Textformat,CSV format tables. If you are having other format table like orc..etc then set serde properties are not got to be working. - Tested by creating text format table: Data: 1,2019-06-15T15:43:12 2,2019-06-15T15:43:19 create table i(id int,ts timestamp) row format delimited fields terminated by ',' stored as textfile; ALTER TABLE i SET SERDEPROPERTIES ("timestamp.formats"="yyyy-MM-dd'T'HH:mm:ss");  select * from i; 1       2019-06-15 15:43:12 2       2019-06-15 15:43:19 - incase if we have orc file with 2019-06-15T15:43:12 format then altering the serde properties still results null format for timestamp field. ... View more

@Jayashree S ListS3 processor is stateful processor once the processor runs it will store the state in the processor and then runs incrementally,if we don't have any new files added to S3 directory then processor won't list any files. How to Clear state: Stop the ListS3 processor and Right click on ListS3processor and select state and clear the state that is saved in the processor. Then start ListS3 processor, now processor will list all the files in S3 directory. ... View more

@chauvin christophe You can use NiFi RestApi /processors/{id}/state/clear-requests call, to clear the state stored in the processor. We can make restapi call by using invokehttp processor (or) groovy script and triggered by using NiFi. ... View more

@vinay p Try with CountText,CalculateRecordStats processors will gives what you are looking for. To get one summary flowfile from 3 flowfiles then first you should merge 3 flowfilee into one by using MergeRecord/MergeContent processor then use CountText,CalculateRecordStats processors to get the summary of the flowfile. Then use PutEmail processor to send to send the flowfile as an attachment. ... View more