Hi, I wanted to be able to track how many message (files) were consumed by the ConsumeKafka process and size of it, for a particular time window. With reference to that, please advise on the below: 1) Can we be able to find the list of items (see attached, such as file size, queued duration) that got processed, even when they are no longer in the queue? 2) Can we query items in queue specific to a particular processor? 3) Is it possible to retrieve and post the above to a custom Amabari metrics? The objective is to maintain a trend of the average message size and the number of messages, specific to a particular topic (configured in the ConsumeKafka processor). ... View more

How to capture the filesize and the filename, which can be found in the details section of the flowfile? I understand that the filename is listed in the attribute section, but is there a way to know the variable name for filesize? kafka-flow-file.jpg ... View more

Hi, Can someone confirm if the hash function would always result with unique integer value, say even for millions of unique account numbers, and the same number would not repeat again? ... View more

I get the following error. Any suggestions? Hive Version: 1.5.0 hive> select md5(name) from account limit 1; FAILED: SemanticException [Error 10011]: Line 1:7 Invalid function 'md5' https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-Misc.Functions ... View more

I wanted to be able to execute some hdfs shell commands. However, it gives the following error even for the normal file listing. Can you please suggest? sh: ls -lrt: No such file or directory executeprocess.jpg ... View more

What is the relationship between the templates and the process group? Why is there a restriction to remove the process group? Please see attached.processor-group-removal.jpg ... View more