@Suresh Dendukuri EvaluateJsonPath processor accepts only valid json path's(ex:$.<key>..) as you are specifying Regex if you want to extract the values using Regex then use ExtractText processor and add your regex path in that processor. Configure EvaluateJsonPath processor as shown below and keep Destination as flowfile-attributes and add new properties projectid $.[0].projectid projetname $.[0].projetname startdate $.[0].startdate Output: As you see in the above screenshot attributes are added to the flowfile, This way we are assuming there are only one json message in array and extracting the first message values and storing as flowfile attributes. Cleaner way to do this task as follows: as you are having array of json messages and want's to extract the values of the json key's so split the array of json messages into individual messages by using SplitJson processor. SplitJsonConfigs: Then use EvaluateJsonPath processor: Configure the processor as show above this will work if you are having more than one json message in an array also. ... View more

@Pepelu Rico Use MonitorActivity processor for this case and Configure the processor as Cron Driven to run at 10:00AM,10:01AM Processor configs: CronDriven * 0,1 10 1/1 * ? * Threshold Duration 1 min //consider how much time elapse before considering the flow is inactive Continually Send Messages false Inactivity Message Lacking activity as of time: ${now():format('yyyy/MM/dd HH:mm:ss')}; flow has been inactive for ${inactivityDurationMillis:toNumber():divide(60000)} minutes //change this message as per your requirements Activity Restored Message Activity restored at time: ${now():format('yyyy/MM/dd HH:mm:ss')} after being inactive for ${inactivityDurationMillis:toNumber():divide(60000)} minutes Copy Attributes false //include all the flowfile attributes in the content of flowfile Monitoring Scope cluster //determine activeness of flow Reporting Node primary //specify which node to send mail in this way we are running Monitor Activity processor at 10:00AM,10:01AM, at 10:00AM processor runs every second and check is there any flowfile. at 10:01AM is to sent out mail for inactivity. In the same way use another monitorActivity processor to run at 12 to send alert mail. Flow: Use inactivity relationship to send out the alert email and Configure PutEmail processor. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues. ... View more

@Hariprasanth Madhavan There are lot of ways to insert data into `HiveORC` table from NiFi. Method1: Using PutHiveStreaming Processor: Create transactional table and then feed the avro data to PutHivestreaming table. As HiveStreaming processor converts the avro format data into ORC format and regards to all delta files you can use major compaction to create one base file. Method2: ConvertAvroToORC in NiFi and store into HDFS: Use ConvertAvroToORC processor to convert the avro format data into ORC format. Store the data into HDFS and create an External hive table pointing to the same HDFS directory. Method3: Create Avro table and load from Avro table to ORC table: Based on the avro file we are having in NiFi we can create avro tables dynamically based on avro.schema. Create an orc table and after storing the avro data into HDFS use PutHiveQL processor to run insert into ORC table select * from Avro table Refer to this link for more details regards to create avro table dynamically. - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues. ... View more

@Pepelu Rico You can achieve this by using ReplaceText processor (or) UpdateRecord processor Method1:Using UpdateRecord processor: If you are working on larger number of rows then use UpdateRecord processor and define CSV Reader controller service with ; as value seperator. Define CSV writer controller service add new property in the Processor as /link3column as concat(/col_4,/col5,/col6) Refer to this link for configure/Usage of UpdateRecord processor. Method2:Using ReplaceText processor: Use this method if you are dealing with less number of records Search Value ^((?:[^;]+;\s*){3})(.*) Replacement Value $1${'$2':replace(";","")} Character Set UTF-8 Maximum Buffer Size 1 MB //change this value according to your flowfile size Replacement Strategy Regex Replace Evaluation Mode Line-by-Line In this method we are using regex to match until third ; to first capture group($1) and rest of the data into $2 capture group. Making use of NiFi expression language we are replacing ";" in $2 capture group with "" OutputFlowfile: column1;column2;column3;20180927column1_1;column2_1;column3_1;20180927column1_2;column2_2;column3_2;20180927 - If the Answer helped to resolve your issue, Click on Accept button below to accept the answer, That would be great help to Community users to find solution quickly for these kind of issues. ... View more