Support Questions
Find answers, ask questions, and share your expertise

Can't start flume agent via Ambari.

New Contributor

Hello everyone.

I have succesfully started flume agent via shell, but I faced with troubles while started agent in Ambari.

I did as explained here: http://cleverowl.uk/2015/09/30/ingesting-files-with-apache-flume/

I added an agent to Ambari, but it didn't doing anything.

3906-ambari.png

1 ACCEPTED SOLUTION

New Contributor

The issue was commonplace:unsufficient permissions on directories.

Thank you everyone!

View solution in original post

5 REPLIES 5

@Siarhei Novik
  1. Did you installed Flume agent via Ambari ?
  2. Can you attached the error logs.

New Contributor

1. Yes, I set up a Flume agent using Ambari like this article

2. Where can I found logs for Ambari Flume agents? /var/log/flume/flume.log doesn't contain any info about this agent.

Contributor

I assume you are using the ambari-metrics-system to collect statistics. You need to add a jar to the flume classpath in order to make the charts work. Edit the 'Advanced flume-env' config in Ambari.

Make sure that the flume-env template contains:

...
if [ -e "/usr/lib/flume/lib/ambari-metrics-flume-sink.jar" ]; then
  export FLUME_CLASSPATH=$FLUME_CLASSPATH:/usr/lib/flume/lib/ambari-metrics-flume-sink.jar
fi
...

Restart flume, now you should be able to see the collected metrics.

New Contributor

Thank you for responce.

My 'Advanced flume-env' config in Ambari already contain this section.

The problem is not only in the lack of metrics, but also in the fact that the agent does not run through Ambari, and does not handle files. Although through the shell everything works well

flume-ng agent --conf conf --conf-file /home/ambari-qa/flume/example4.conf --name agent -Dflume.root.logger=INFO,console

New Contributor

The issue was commonplace:unsufficient permissions on directories.

Thank you everyone!

; ;