issue - flume twitter

[#1]

Hi all,

I am getting an issue when I try to load data from twitter,

here is the log :

14/12/19 15:56:36 INFO node.Application: Starting Channel MemChannel
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: CHANNEL, name: MemChannel: Successfully registered new MBean.
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Component type: CHANNEL, name: MemChannel started
14/12/19 15:56:36 INFO node.Application: Starting Sink HDFS
14/12/19 15:56:36 INFO node.Application: Starting Source Twitter
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: SINK, name: HDFS: Successfully registered new MBean.
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Component type: SINK, name: HDFS started
14/12/19 15:56:36 INFO twitter4j.TwitterStreamImpl: Establishing connection.
14/12/19 15:56:38 INFO twitter4j.TwitterStreamImpl: Connection established.
14/12/19 15:56:38 INFO twitter4j.TwitterStreamImpl: Receiving status stream.
Exception in thread "Twitter4J Async Dispatcher[0]" java.lang.NoSuchMethodError: twitter4j.json.JSONObjectType.determine(Ltwitter4j/internal/org/json/JSONObject;)Ltwitter4j/json/JSONObjectType;
    at twitter4j.AbstractStreamImplementation$1.run(AbstractStreamImplementation.java:100)
    at twitter4j.internal.async.ExecuteThread.run(DispatcherImpl.java:116)
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Stream closed.
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Stream closed.
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Waiting for 250 milliseconds
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Establishing connection.
14/12/19 16:00:11 INFO twitter4j.TwitterStreamImpl: Connection established.
14/12/19 16:00:11 INFO twitter4j.TwitterStreamImpl: Receiving status stream.

I had a look into hdfs directory : no data is loaded !!

Could someone help me please !?

Tkx,

Adda

[#2 · Accepted solution]

I resolve it 🙂

I used a bad version of : flume-sources-1.0-SNAPSHOT.jar

The better is to generate your own JAR by executing the bellow commands :

git clone git://github.com/cloudera/cdh-twitter-example.git
cd cdh-twitter-example
mvn install

[#3]

Hey @quikyser!

Same issue here. I was trying to create a new JAR file by following your instructions but I'm getting an error with Maven. Can you please help? Can you upload your working JAR file?