@Avish Saha Some processors work in NiFi FlowFiles in batches. In your case one of the FlowFiles is failing to match on the regex which is causing a session roll back of the entire session. Also seeing as how the processor reports 8,000,000+ tasks in the last 5 minutes, it does not look like it is penalizing that one bad FlowFile. While all FlowFiles routed to a "failure" relationship are penalized, this is not true for all processors when a session rollback occurs. ... View more

@Dmitro Vasilenko The ConsumeKafka processor will only accept dynamic properties for Kafka consumers only. max.message.bytes is a server configuration property. I believe what you are really looking for on the consumer side is: max.partition.fetch.bytes This property will be accepted by the consumeKafka processor and you will not see the "Must be a known configuration parameter for this Kafka client" invalid tooltip notification. Thanks, Matt Just as an FYI, I don't get pinged about any new answers/comments you make without the @<username> notation. ... View more

@Blake Colson If you found my initial response helpful in answering your question, please accept the answer. ... View more

@Matt Clarke Hi Matt, i am trying to secure my nifi-1.1.1 instance using kerberos, i have set up the truststore, keystore in nifi home directory using nifi-tls-toolkit, also set the truststore and keystore passwords in the nifi.properties, provided kerberos-provider as the login-identity-provider. have set up the authorizers.xml with the same CN as i used in certificates. But after restarting nifi, the UI is not coming up, i am getiing "site can't be reached:refuse to connect error" , i also tried importing .p12 cert to my browser but that also didn't helped. could you please suggest what is wrong in the process i followed? ... View more

Thanks matt for your guidance. ... View more

@Matt Clarke After adding the property "nifi.security.encrypt.configuration.password" in Custom nifi-ambari-config it is working as expected. Thank you very much for your help. nifi.jpg Regards Chaitanya ... View more

@Emmanouil Petsanis Was there some error or condition that occurred prior to this issue (Out of disk space issues, repo corruption, etc...)? Do you run into the same issue if you switch to a newer release version? The latest HDF release is HDF 2.1.2 http://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.2/index.html Thanks, Matt ... View more

@Simon Jespersen Posted answer to above question here: https://community.hortonworks.com/questions/98384/listsftp-failed-to-obtain-connection-to-remote-hos.html ... View more

@Matt Clarke thank you, it worked perfectly. And thanks for the explanation as well. In the post I was using as reference, both instances were hosted on the same machine, so I couldn't quite figure out this difference that you elaborated on. ... View more

@Matt Clarke : thanks 🙂 ... View more