Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

issue - flume twitter

Solved Go to solution

issue - flume twitter

New Contributor

Hi all,

 

I am getting an issue when I try to load data from twitter,

here is the log :

 

 

14/12/19 15:56:36 INFO node.Application: Starting Channel MemChannel
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: CHANNEL, name: MemChannel: Successfully registered new MBean.
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Component type: CHANNEL, name: MemChannel started
14/12/19 15:56:36 INFO node.Application: Starting Sink HDFS
14/12/19 15:56:36 INFO node.Application: Starting Source Twitter
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: SINK, name: HDFS: Successfully registered new MBean.
14/12/19 15:56:36 INFO instrumentation.MonitoredCounterGroup: Component type: SINK, name: HDFS started
14/12/19 15:56:36 INFO twitter4j.TwitterStreamImpl: Establishing connection.
14/12/19 15:56:38 INFO twitter4j.TwitterStreamImpl: Connection established.
14/12/19 15:56:38 INFO twitter4j.TwitterStreamImpl: Receiving status stream.
Exception in thread "Twitter4J Async Dispatcher[0]" java.lang.NoSuchMethodError: twitter4j.json.JSONObjectType.determine(Ltwitter4j/internal/org/json/JSONObject;)Ltwitter4j/json/JSONObjectType;
    at twitter4j.AbstractStreamImplementation$1.run(AbstractStreamImplementation.java:100)
    at twitter4j.internal.async.ExecuteThread.run(DispatcherImpl.java:116)
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Stream closed.
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Stream closed.
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Waiting for 250 milliseconds
14/12/19 16:00:10 INFO twitter4j.TwitterStreamImpl: Establishing connection.
14/12/19 16:00:11 INFO twitter4j.TwitterStreamImpl: Connection established.
14/12/19 16:00:11 INFO twitter4j.TwitterStreamImpl: Receiving status stream.

 

I had a look into hdfs directory : no data is loaded !!

 

Could someone help me please !?

 

Tkx,

Adda

1 ACCEPTED SOLUTION

Accepted Solutions

Re: issue - flume twitter

New Contributor

I resolve it :)

I used a bad version of : flume-sources-1.0-SNAPSHOT.jar

 

The better is to generate your own JAR by executing the bellow commands :

 

git clone git://github.com/cloudera/cdh-twitter-example.git
cd cdh-twitter-example
mvn install

 

2 REPLIES 2

Re: issue - flume twitter

New Contributor

I resolve it :)

I used a bad version of : flume-sources-1.0-SNAPSHOT.jar

 

The better is to generate your own JAR by executing the bellow commands :

 

git clone git://github.com/cloudera/cdh-twitter-example.git
cd cdh-twitter-example
mvn install

 

Re: issue - flume twitter

New Contributor

Hey @quikyser!

Same issue here. I was trying to create a new JAR file by following your instructions but I'm getting an error with Maven. Can you please help? Can you upload your working JAR file?

 

error.png

Don't have an account?
Coming from Hortonworks? Activate your account here