question Re: Can't start flume agent via Ambari. in Support Questions

Can't start flume agent via Ambari.

s_novik — Mon, 19 Aug 2019 10:10:16 GMT

Hello everyone.

I have succesfully started flume agent via shell, but I faced with troubles while started agent in Ambari.

I did as explained here: http://cleverowl.uk/2015/09/30/ingesting-files-with-apache-flume/

I added an agent to Ambari, but it didn't doing anything.

Re: Can't start flume agent via Ambari.

sshimpi — Mon, 02 May 2016 16:07:19 GMT

@Siarhei Novik

Did you installed Flume agent via Ambari ?
Can you attached the error logs.

Re: Can't start flume agent via Ambari.

s_novik — Mon, 02 May 2016 16:30:52 GMT

1. Yes, I set up a Flume agent using Ambari like this article

2. Where can I found logs for Ambari Flume agents? /var/log/flume/flume.log doesn't contain any info about this agent.

Re: Can't start flume agent via Ambari.

MrBee — Mon, 02 May 2016 18:03:51 GMT

I assume you are using the ambari-metrics-system to collect statistics. You need to add a jar to the flume classpath in order to make the charts work. Edit the 'Advanced flume-env' config in Ambari.

Make sure that the flume-env template contains:

...
if [ -e "/usr/lib/flume/lib/ambari-metrics-flume-sink.jar" ]; then
  export FLUME_CLASSPATH=$FLUME_CLASSPATH:/usr/lib/flume/lib/ambari-metrics-flume-sink.jar
fi
...

Restart flume, now you should be able to see the collected metrics.

Re: Can't start flume agent via Ambari.

s_novik — Mon, 02 May 2016 18:24:36 GMT

Thank you for responce.

My 'Advanced flume-env' config in Ambari already contain this section.

The problem is not only in the lack of metrics, but also in the fact that the agent does not run through Ambari, and does not handle files. Although through the shell everything works well

flume-ng agent --conf conf --conf-file /home/ambari-qa/flume/example4.conf --name agent -Dflume.root.logger=INFO,console

Re: Can't start flume agent via Ambari.

s_novik — Mon, 02 May 2016 20:18:24 GMT

The issue was commonplace:unsufficient permissions on directories.

Thank you everyone!