Hi @dyadav1   Thanks for pointing out the direction for Kafka topic but I need little more help to determine the strategy, as I mentioned if every topic is putting 100 different types of command and I need to transform each type of command into new type (assuming Jolt transformation and have jolt spec for 100 different command types), how do I store those spec and make generalize flow so that new command types get added I just need to update Spec and flow didn;t require any changes. In more terms need to dynamically figure out which command type coming in the flow file and transform it based on spec, now I feel I need to use lookup and if I store all spec in database but then for each transformation I need to do database trip which I want to avoid. ... View more

Hi Steven,   I used @bingo 's solution to get Nifi to find my JAVA_HOME.   But you mention that Nifi does not need this to run. Do you know what is the impact for running nifi without it knowing where Java is installed? ... View more

thank you for the post   but another question - according to the document - https://docs.cloudera.com/HDPDocuments/Ambari-2.7.0.0/administering-ambari/content/amb_changing_host_names.html   The last stage is talking about – in case NameNode HA enabled , then need to run the following command on one of the name node     hdfs zkfc -formatZK -force     thank you for the post   but since we have active name node and standby name node we assume that our namenode is HA enable   example from our cluster   but we want to understand  what are the risks when doing the following cli on one of the namenode   hdfs zkfc -formatZK -force   is the below command is safety to run without risks ? ... View more

Just to close this thread, we've detected that we miss a configuration inside the new configuration group (nifi.zookeeper.root.node). This parameter should be different in each configuration group in order to set a new path base where to save the new cluster configuration in Zookeeper (we didn't need to create the path, it was created as soon as we change the config). Now we have both groups of nifi instances up and running. Thanks for the help! ... View more

Great! thanks! ... View more