Hi @Ben Morris I understand the requirement, I have the same needs for few use cases. Unfortunately, there's no ETA for this feature yet. This is something the community is aware of. Getting this done depends on priorities as well as the complexity of this feature. Regarding migration, data queued in a node can be used again if the node is brought back again. If this is not possible, you can spin up a new node and configure it to use the existing repos from the old node (they are not specific to a NiFi node). IMO this migration process will depend on your infrastructure. If you are on baremetal node with RAID local storage, this will take time as you need to bring back a new physical node with the old disks (if node recovery is not possible). If you are on virtual infrastructure, the task will be easier since you can create new VM, install NiFi and make it use the existing repos. Here also, time and complexity will depend on your storage type (local or network). Working on HA/fault tolerance with realtime is not an easy task. You have lot of things to consider around data duplication. I am thinking out loud here but If you can afford at-least-once strategy, you can may be design your flow to achieve it (using state backend). There's no easy standard solution though. This will depend you data source, your ability to deduplicate data and so on. This is something I am working currently. ... View more

Hi @Kiem Nguyen What will be the rest of the flow after routing? can you give more details? ... View more

Hi @Ben Morris This feature is still on the roadmap and it's not available yet: https://cwiki.apache.org/confluence/display/NIFI/High+Availability+Processing What are you trying to achieve? does RAID disk an acceptable solution for you? ... View more

@xav webmaster You can use one UpdateAttribute with several rules. if x then topic = 'A', if y then topic = 'B' etc You can add rules and define an action for each rule which set the correct topic value ... View more

@xav webmaster to have an idea on how this works, look at this answer https://community.hortonworks.com/questions/140060/nifi-how-to-load-a-value-in-memory-one-time-from-c.html It's not the same subject but it can give you an idea on how you can use this feature ... View more

Hi @xav webmaster Have you looked to rules feature in the UpdateAttribute processor ? it's available in the advanced configuration section : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-update-attribute-nar/1.4.0/org.apache.nifi.processors.attributes.UpdateAttribute/additionalDetails.html You can extract information that you want and add them as an attribute (using extract processors). Once you have information that you want as an attribute, you can use UpdateAttribute with rules to add/update a new attribute 'topic' and set the value following you conditions. Is this helpful ? ... View more

@msumbul I don't know of any standard error attribute in NiFi. This depends on the processor and usually is not provided. You can always use UpdateAttribute to add an error type following your needs. If a processor has three possible errors relations, you can have 3 update processors which add an attribute error and populate it with the type of error. ... View more

@suresh krish What are you trying to use? Keystore on HDFS or in local ? You can read in the doc the following : The JavaKeyStoreProvider, which is represented by the provider URI jceks://file|hdfs/path-to-keystore, is used to retrieve credentials from a Java keystore. The underlying use of the Hadoop filesystem abstraction allows credentials to be stored on the local filesystem or within HDFS. and The LocalJavaKeyStoreProvider, which is represented by the provider URI localjceks://file/path-to-keystore, is used to access credentials from a Java keystore that is must be stored on the local filesystem. You are using localjceks. So your URI should be localjceks://file/path-to-your-jceks. The file keyword is important. Also, the /user/hdfs in this case is a local so it should exist in your OS. If you want to use HDFS then you need jceks and URI jceks://hdfs/path-to-your-file ... View more

@Yair Ogen Have you tried the Hive-JDBC available on Hortonworks Add-ons download page ? https://hortonworks.com/downloads/#addons ... View more