question Re: working flume command failing now in Archives of Support Questions (Read Only)

working flume command failing now

aliyesami — Thu, 03 Nov 2016 22:01:59 GMT

I have used this flume-ng command dozens of times but now its failing with the error below.

16/11/03 10:58:46 INFO twitter.TwitterSource: Access Token Secret: 'xxxxxxxxxxxxxxxxxxxxxxxxxx'
16/11/03 10:58:46 ERROR node.AbstractConfigurationProvider: Source Twitter has been removed due to an error during configuration
java.lang.IllegalStateException: consumer key/secret pair already set.

the command is

flume-ng agent --conf ./conf/ -f conf/twitter-to-hdfs.properties --name TwitterAgent  -Dflume.root.logger=WARN,console -Dtwitter4j.http.proxyHost=dotatofwproxy.tolls.dot.state.fl.us -Dtwitter4j.http.proxyPort=8080

Re: working flume command failing now

aliyesami — Thu, 03 Nov 2016 23:19:30 GMT

I removed twitter4j 4.0.4 version and put twitter4j 3.0.3 but now I am getting another error

16/11/03 12:17:47 INFO twitter.TwitterSource: Twitter source Twitter started.
16/11/03 12:17:47 INFO twitter4j.TwitterStreamImpl: Establishing connection.
16/11/03 12:17:47 INFO twitter4j.TwitterStreamImpl: 404:The URI requested is invalid or the resource requested, such as a user, does not exist.

Re: working flume command failing now

aliyesami — Fri, 04 Nov 2016 00:37:46 GMT

this post fixed the issue

http://stackoverflow.com/questions/19189979/cannot-run-flume-because-of-jar-conflict