question Re: Flume - Polling of data continuously in Archives of Support Questions (Read Only)

Flume - Polling of data continuously

laule75 — Fri, 14 Oct 2016 18:08:37 GMT

Hello,

I have installed and configured a websocket-type source on Flume.

It works fine...except that the data is retrieved just once (only when we start the Flume agent), and not continuously !

Is there any particular parameter to setup in order to get Flume continuously retrieving some data feed ?

thanks in advance.

Re: Flume - Polling of data continuously

bhagan — Wed, 19 Oct 2016 03:33:34 GMT

Can you provide the details of the websocket-type source? Perhaps also provide the agent configuration too.

Re: Flume - Polling of data continuously

laule75 — Fri, 21 Oct 2016 15:53:14 GMT

Hello,

Actually I've fixed the issue; I have corrected the Source agent in order to re-establish the connection in case of connection cut triggered by the provider of data.

Re: Flume - Polling of data continuously

kristianbnk — Sun, 10 Feb 2019 22:40:19 GMT

Hi @Laurent lau,

could you please provide further information how you solved it? What configuration you used, what parameters you set for source agent? What websocket plugin you used? I am struggling with the same issue, but I probably use different implementation (different websocket plugin), so the configuration parameters will be most probably different..

Re: Flume - Polling of data continuously

laule75 — Mon, 11 Feb 2019 16:51:44 GMT

Hello,

To fix this issue, I used to stop/start the Flume process on a daily basis.

Recently we have migrated from Flume to NiFi; much more stable.

Rgds

Laurent