Support Questions

Find answers, ask questions, and share your expertise

Flume twitter analysis

avatar
Explorer

Unhandled error
java.lang.NoSuchMethodError: twitter4j.conf.Configuration.isStallWarningsEnabled()Z
         at twitter4j.TwitterStreamImpl.<init>(TwitterStreamImpl.java:60)
         at twitter4j.TwitterStreamFactory.<clinit>(TwitterStreamFactory.java:40)
         at com.cloudera.flume.source.TwitterSource.<init>(TwitterSource.java:64)
         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
         at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
         at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
         at java.lang.Class.newInstance0(Class.java:355)
         at java.lang.Class.newInstance(Class.java:308)
         at org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:42)
         at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:327)
         at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
         at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
         at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
         at java.lang.Thread.run(Thread.java:662)

 

Hi All,

I am using Cloudera manager to Configure the flume to do ywitter analysis.I making the all the required changes I am getting the above error after restarting the agent

1 ACCEPTED SOLUTION

avatar
Contributor

Then go to cloudera manager and in configuration for flume agent, under Advanced, you should see "Java Configuration Options for Flume Agent", add jars you need in there like : 

 

--classpath /.../.../twitter4j.jar 

 

The jar needs to be uploaded to the server of the flume agent. 

View solution in original post

5 REPLIES 5

avatar
Contributor

This error says your twitter4j.jar is not on the classpath for your flume agent. Check your flume agent log, the classpath should be dumped out in the log when you start the agent. Check if twitter4j.jar is in there.  If not, you can simple add it in.  Are you using cloudera manager? 

avatar
Explorer

Hi Helen,

 

Thanks for reply.Yes I am using Cloudera Manager.

 

Thanks&Regards

Vishal

avatar
Contributor

Then go to cloudera manager and in configuration for flume agent, under Advanced, you should see "Java Configuration Options for Flume Agent", add jars you need in there like : 

 

--classpath /.../.../twitter4j.jar 

 

The jar needs to be uploaded to the server of the flume agent. 

avatar
New Contributor

Where to get twitter4j.jar?

avatar
New Contributor

hi, 

 

i am facing the same problem. 

i am very new to cloudera and am using cloudera quickstart, not the cloudera manager.

 

could you give me a beginners advice for overcoming this issue?

As well I am wondering if the issue to the problem is still the same as this post was made a few years ago. 

 

thanks a whole lot!