Thanks ... View more

You can use EvaluateJsonPath. You only have to add an extra attribute and name it as you want (e.g. count) and set as value "$.my.array.size.length()". Then select Destination and change it to flowfile-attribute. This processor will produce a flowfile which has your extra attribute ... View more

Followed your steps but getting error on ConvertRecord processor /partition_dt is invalid because 'partition_dt' is not an associated property or has no validator associated with it. How can I resolve? ... View more

This solution will not work. The failure flow does not go to next putDatabaseRecord processor because the error is exception. Failure flow files will go nowhere ... View more

Hi @calonsca! Please have a look at this spec as well! [ { "operation": "shift", "spec": { "@": "data", "ID": "&", "#${date}": "date", "#${dataset:toLower()}": "dataset" } } ] ... View more

@Shu_ashu  this approach works has a problem that clear-state is working only on stopped processor.  I am using  ScrollElasticsearch processor and it needs to be cleared before it can be executed again.  I tried    curl -i -X POST http://localhost:8080/nifi-api/processors/0172101b-be82-11aa-1249-d1383cb1ceba/state/clear-requests    but it end-up with conflict status  I must stop processor in order to clear-state Do I really have to stop processor? manually or via API - it doesn't seems to me as a good design. Could you Help or give any advice please? Thank u.  Petr ... View more

I have written a blog on this,  Kindly refer to blog to setup dbcp connection pool Lookup controller service and execute same query in multiple databases.   Please follow this link, it is with an example with step by step instructions to setup the same: https://bigdata-galaxy.blogspot.com/2020/04/nifi-querying-multiple-databases-using.html      ... View more

@Shu_ashu Great!. With the instructions you have given me, the output file is created correctly. I also tried the option: CREATE TABLE AS scenariox_out AS SELECT select count (*) from scenariox; And the output file was created in: /user/hive/warehouse/scenariox.db/scenariox/scenariox_out/000000_0 Thank you. You have a good day ... View more