Support Questions
Find answers, ask questions, and share your expertise

having problem in flume

hi,

i have a problem in flume which i cann't able to understand. whenever i'm executing this command

./bin/flume-ng agent -c conf -f conf/flume.conf -Dflume.root.logger=DEBUG,console -n TwitterAgent

it shows the error :

[ERROR - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:142)] Failed to load configuration data.

anybody knows the solution for this problem.flum1.pngflume2.pngflume4.png

thanks in advance.

2 REPLIES 2

Super Mentor

@nathi anuraag

Can you try passing the complete path for the "conf" directory as following:

flume-ng agent -c /etc/flume/conf -f /etc/flume/conf/flume.conf

Please see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/startin...

.

Regarding the following error, Please make sure that the "flume-sources*.jar" is present in the "lib" directory of your flume installation. Means the CLASSPATH is set correctly to include the mentioned jar.

Caused by: java.lang.ClassNotFoundException: com.cloudera.flume.source.TwitterSource

.

- As we see the message "com.cloudera.flume.source" in this error you posted. Are you using CDH or HDP?

- You might want to use the following property in your "flume" conf instead of the above class.

TwitterAgent.sources.Twitter.type = org.apache.flume.source.twitter.TwitterSource

.

- If you are using HDP (Hortonworks Data Platform) then you should refer to the following article :

https://community.hortonworks.com/content/supportkb/49166/conflicting-flume-documentation-regarding-...

.

Explorer

Please give some background like which tutorial, user guide or github repo you are following. Also attaching your flume conf file might help answering your question.

; ;