Member since
04-29-2018
3
Posts
0
Kudos Received
0
Solutions
05-06-2018
08:39 AM
Hi, I'm designing a system that does some work triggered by HTTP requests. Requests are distributed via remote group to different nodes and each node runs the "FetchAndSaveFromHDFS" process group. I have two questions: 1. What is the best way to define dynamic configuration per process group per Node. Each http request contains some configuration in addiction to the data , each process group should run according to this configuration (I know i can add the configuration to the flowfile as attribute but is there a better way ? 2. How can i guarantee that process group will handle only one flowfile at a time (will not take file from the input queue until all processors in this group has finished) Thanks
... View more
04-29-2018
02:05 PM
worked. Thanks @Shu
... View more
04-29-2018
01:30 PM
Hi, As mentioned in the documentation the "PartitionRecord" processor should automatically add the partitioning property name and value as attribute to the flowfile. I have a simple input file contains an array of three json records. I partition the json records according to "AgencyID" property( type string) I do see the downstream partitioned flowfiles but without "AgencyID" attribute. Am i missing some configuration ? Thanks input2.txt
... View more