Member since
06-09-2017
7
Posts
0
Kudos Received
0
Solutions
11-08-2017
02:11 PM
Even driven is also very useful (or rather the only solution), in some cases. For example in our case, we have a sequence of HTTP calls that result in multiple flow files, each flow file is collected and also forks into a separate flow to create a new flow file. This kind of works like a linked list. So what we gotta do is merge all of these individual flow files into a single archive at the end using the MergeContent processor. This must only happen when we've collected all the flow files, we don't really know the number of flow files we may be getting until the last flow file is collected. So the MergeContent processor should only be triggered when all the flow files are collected, not before that. While the Timer based and CRON based triggers do not have such a provisioning. We tried to solve this issue with Wait and Notify but apparently, there is no way to block the MergeContent Processor from being triggered until the last flow file has been queued to the MergeContent processor. As flow file transfer and queuing to the MergeContent processor in large number of files say 200,000 files itself takes some time, and it is possible that the MergeContent processor gets triggered halfway through the queuing.
... View more
06-09-2017
02:38 PM
If you want to get the HBaseClientService outside of onTrigger you can do the following... private volatile HBaseClientService service;
@OnScheduled
public void onScheduled(ProcessContext context) {
this.service = context.getProperty(HBASE_CLIENT_SERVICE)
.asControllerService(HBaseClientService.class);
}
A method annotated with @OnScheduled will be called one time when the processor is first started. Also, keep in mind that getting the HBaseClientService every time in onTrigger is totally fine because its not making a new connection every time. The connection is made when HBaseClientService is first started, and then you would just be getting access to that existing connection each time in onTrigger.
... View more
09-29-2017
03:20 PM
Hi, Hanu V Can u please share the attributes example or flow file as an example to explain how extract text to assign the entire row as an attribute ??? I am searching for it from a while.
... View more