Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Can't start flume agent via Ambari.

avatar
Explorer

Hello everyone.

I have succesfully started flume agent via shell, but I faced with troubles while started agent in Ambari.

I did as explained here: http://cleverowl.uk/2015/09/30/ingesting-files-with-apache-flume/

I added an agent to Ambari, but it didn't doing anything.

3906-ambari.png

1 ACCEPTED SOLUTION

avatar
Explorer

The issue was commonplace:unsufficient permissions on directories.

Thank you everyone!

View solution in original post

5 REPLIES 5

avatar
Super Guru
@Siarhei Novik
  1. Did you installed Flume agent via Ambari ?
  2. Can you attached the error logs.

avatar
Explorer

1. Yes, I set up a Flume agent using Ambari like this article

2. Where can I found logs for Ambari Flume agents? /var/log/flume/flume.log doesn't contain any info about this agent.

avatar
Expert Contributor

I assume you are using the ambari-metrics-system to collect statistics. You need to add a jar to the flume classpath in order to make the charts work. Edit the 'Advanced flume-env' config in Ambari.

Make sure that the flume-env template contains:

...
if [ -e "/usr/lib/flume/lib/ambari-metrics-flume-sink.jar" ]; then
  export FLUME_CLASSPATH=$FLUME_CLASSPATH:/usr/lib/flume/lib/ambari-metrics-flume-sink.jar
fi
...

Restart flume, now you should be able to see the collected metrics.

avatar
Explorer

Thank you for responce.

My 'Advanced flume-env' config in Ambari already contain this section.

The problem is not only in the lack of metrics, but also in the fact that the agent does not run through Ambari, and does not handle files. Although through the shell everything works well

flume-ng agent --conf conf --conf-file /home/ambari-qa/flume/example4.conf --name agent -Dflume.root.logger=INFO,console

avatar
Explorer

The issue was commonplace:unsufficient permissions on directories.

Thank you everyone!