Thanks @adhishankarit   for your help.    The value of H gross amount is in List  ["55.00","58.00"] it's coming from flowfile attribute.   Will, it is possible to get the attribute value of H gross amount to use Jolt transformation JSON NiFi processor with the same as last element of H gross amount?   Thanks In advance.       ... View more

Hi, Once you extracted the header into Flowfile attribute using ExtractText processor, next you are going to convert the header flowfile attribute  into Flow file content OR you can keep the header value as in attribute ..The stack overflow explains about extracting header into flowfile attribute and next they have pass the headers as file into destination .To convert flowfile attribute to file/flowfile content ,we will have to use ReplaceText processor where you can pass flowfile attributes .. The success relationship of ReplaceText will only contains header in flowfile content and the original csv file will be replaced with header as content . The flowfile content, you can transfer to destination or next processor in the flow.   Hope this information you are looking for ..   Thanks ... View more

@jg6  There is no direct relationship between the DistributedMapCacheServer and the DistributedMapCacheClientService.  Meaning that the client is simply configured with a hostname and a port.  This hostname and port could be a DistributedMapCacheServer running on an entirely different NiFi cluster somewhere. Additionally there is no component that registers a dependency on the DistributedMapCacheServer controller service.  They only have a dependency on the DistributedMapCacheClientService.  So when constructing a template only the interconnected and dependent pieces are included. That being said, using the DistributedMapCache is not the cache I would recommend using anyway.  IT offers no high Availability (HA).  While a DistributedMapCacheServer is being started on every node in a NiFi cluster, they do not talk to one another and the DistributedMapCacheClientService can only be configured to point at one of them.  So if you lose the NiFi node were your clients point, you lost all your cache.  There are better options for external cache services that do offer HA. Hope this is helpful, Matt ... View more

 Hi alexmarco,   I did not find the 'Upload/Attach' option to upload the template file . Could you please follow the steps/screenshots mentioned , it should work for your example well.   thanks   ... View more

Hi adhisankrit,   thanks a lot for help, i am new to NIFI.  this solution worked. Basically their are write attributes present in processor where status and response etc stuff are present which can be accessed. ... View more

Hi ,   Thanks for the reply . As i mentioned that i have run the insert ino tableA select * from tableB (Assume Delta calculation query). Yes , we have managed table in hive and hive version is 3.0 where ACID are enabled by default .We have created the Hive managed table through HUE and executed the delta query via NiFi PutHQL processor and we got the error intermittently .     ... View more

@adhishankarit  When moving on to a new issue, I recommend always starting a new query for better visibility. (for example, someone else in the community may have more experience with new issue then me). As far as your new query, your screenshots do not show any stats on the processor to get an idea of what we are talking about here in terms of performance.  How many fragments are getting merged?  How large are each of these fragments? NiFi nodes are only aware and have access to the FlowFiles on the individual node.  So if node a is "out" (not sure what that means), any FlowFiles still on node "a" that are part of the same fragment will not yet be transferred to node b or c to get binned for merge.  The Bin can not be merged until all fragments are present on the same node.  Since you mention that bin eventually happens after 10 minutes, tells me that eventually all fragments eventually make it on to the same node. I suggest the first thing to address here is your space issue on your nodes. Also keep in mind that while you have noticed that node "a" has always been your elected primary node, there is no guarantee that will always be the case.  A new Cluster Coordinator and Primary node can be elected by Zookeeper at anytime.  If you shutdown or disconnect currently elected primary node "a" you should see another node get elected as primary node.  Adding node "a" back in will not force ZK to elect it back as primary node.  So don't build your flow around a dependency on any specific node being primary node all the time. Matt ... View more

My input JSON will be like below   [ { "filename":"test1.csv", "message":"HiveSQL query executed Sucessfull!", "status":"Success" }, { "filename":"test2.csv", "message":"HiveSQL query executed Sucessfull!", "status":"Success" }, { "filename":"test3.csv", "message":"HiveSQL query executed Sucessfull!", "status":"Success" } ] ... View more