Created 11-03-2016 03:01 PM
I have used this flume-ng command dozens of times but now its failing with the error below.
16/11/03 10:58:46 INFO twitter.TwitterSource: Access Token Secret: 'xxxxxxxxxxxxxxxxxxxxxxxxxx' 16/11/03 10:58:46 ERROR node.AbstractConfigurationProvider: Source Twitter has been removed due to an error during configuration java.lang.IllegalStateException: consumer key/secret pair already set.
the command is
flume-ng agent --conf ./conf/ -f conf/twitter-to-hdfs.properties --name TwitterAgent -Dflume.root.logger=WARN,console -Dtwitter4j.http.proxyHost=dotatofwproxy.tolls.dot.state.fl.us -Dtwitter4j.http.proxyPort=8080
Created 11-03-2016 05:37 PM
Created 11-03-2016 04:19 PM
I removed twitter4j 4.0.4 version and put twitter4j 3.0.3 but now I am getting another error
16/11/03 12:17:47 INFO twitter.TwitterSource: Twitter source Twitter started. 16/11/03 12:17:47 INFO twitter4j.TwitterStreamImpl: Establishing connection. 16/11/03 12:17:47 INFO twitter4j.TwitterStreamImpl: 404:The URI requested is invalid or the resource requested, such as a user, does not exist.
Created 11-03-2016 05:37 PM
this post fixed the issue
http://stackoverflow.com/questions/19189979/cannot-run-flume-because-of-jar-conflict