Hi All, Thanks a lot to this awesome community. I was reading this blog by @Bryan Bende, and in the last paragraph, as per my interpretation in order to have better performance we should have 1 large flowfile as in output from listenTCP which can be achieved by using configuring "Max Batch size I set it to "100 000" . this will collect 100000 messages in a flowfile and input it to PublishKafka and in the Publish kafka the "Message Demaractor" is set to new line (shift+enter) this will send each message from the flow file thus increasing throughput Am I correct in my understanding? Thanks Dheeru ... View more

Hi All, Thanks a lot to this awesome community There is a use case where my processor should run daily at time 9:01 am cst. question 1. Does it follow any time zone, do I need to provide it? In addition after reading the docs here https://docs.hortonworks.com/HDPDocuments/HDF1/HDF-1.2/bk_UserGuide/content/scheduling-tab.html my value for Run schedule would look like for every day at 9:01 am cst * 01 09 * * * does the above value look correct? ... View more

Hi All, Thanks to this awesome community. From my understanding the listSFTP and fetchSFTP is using Secure FTP protocol behind the scenes. Am I correct in my understanding? Thanks Dheeru ... View more

Hi All, Thanks a lot to this community. I am working on building data flows, and i have 40 to 50 data flows to be configured. some of them are like 15000 events per second. If I have some of the data flows configured and then a very high event per second data source is being configured, and some how fills up the JVM, everything crashes because of the disk space, or sudden event burst occurs Does it mean we will have to proactively watch for any space issues such as JVM heap size, content repo and provenance repo. etc Thanks Dheiru ... View more