Flume twitter analysis

[#1]

Unhandled error
java.lang.NoSuchMethodError: twitter4j.conf.Configuration.isStallWarningsEnabled()Z
         at twitter4j.TwitterStreamImpl.<init>(TwitterStreamImpl.java:60)
         at twitter4j.TwitterStreamFactory.<clinit>(TwitterStreamFactory.java:40)
         at com.cloudera.flume.source.TwitterSource.<init>(TwitterSource.java:64)
         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
         at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
         at java.lang.Class.newInstance0(Class.java:355)
         at java.lang.Class.newInstance(Class.java:308)
         at org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:42)
         at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:327)
         at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
         at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
         at java.lang.Thread.run(Thread.java:662)

Hi All,

I am using Cloudera manager to Configure the flume to do ywitter analysis.I making the all the required changes I am getting the above error after restarting the agent

[#2]

This error says your twitter4j.jar is not on the classpath for your flume agent. Check your flume agent log, the classpath should be dumped out in the log when you start the agent. Check if twitter4j.jar is in there.  If not, you can simple add it in.  Are you using cloudera manager? 

[#3]

Hi Helen,

Thanks for reply.Yes I am using Cloudera Manager.

Thanks&Regards

Vishal

[#4 · Accepted solution]

Then go to cloudera manager and in configuration for flume agent, under Advanced, you should see "Java Configuration Options for Flume Agent", add jars you need in there like : 

--classpath /.../.../twitter4j.jar 

The jar needs to be uploaded to the server of the flume agent. 

[#5]

Where to get twitter4j.jar?

[#6]

hi, 

i am facing the same problem. 

i am very new to cloudera and am using cloudera quickstart, not the cloudera manager.

could you give me a beginners advice for overcoming this issue?

As well I am wondering if the issue to the problem is still the same as this post was made a few years ago. 

thanks a whole lot!