Support Questions
Find answers, ask questions, and share your expertise

After upgrade to CDH 4.5 capturing Twitter Data with Flume is not working

Explorer

Tailing flume-ng.log does not contain errors:

 

2014-01-09 08:06:11,988 INFO org.apache.flume.node.Application: Starting Sink HDFS
2014-01-09 08:06:11,989 INFO org.apache.flume.node.Application: Starting Source Twitter
2014-01-09 08:06:11,995 INFO org.apache.flume.instrumentation.MonitoredCounterGroup: Monitored counter group for type: SINK, name: HDFS: Successfully registered new MBean.
2014-01-09 08:06:11,995 INFO org.apache.flume.instrumentation.MonitoredCounterGroup: Component type: SINK, name: HDFS started
2014-01-09 08:06:12,085 INFO twitter4j.TwitterStreamImpl: Establishing connection.
2014-01-09 08:06:12,175 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2014-01-09 08:06:12,287 INFO org.mortbay.log: jetty-6.1.26
2014-01-09 08:06:12,431 INFO org.mortbay.log: Started SelectChannelConnector@0.0.0.0:41416
2014-01-09 08:06:13,530 INFO twitter4j.TwitterStreamImpl: Connection established.
2014-01-09 08:06:13,530 INFO twitter4j.TwitterStreamImpl: Receiving status stream.

When I twitt any string in keywork does not is created the file in HDFS.

 

I make a test using CDH 4.4 binary (in repository parcels) and the same flume.conf and works.

 

What happened ?

 

 

1 REPLY 1

Re: After upgrade to CDH 4.5 capturing Twitter Data with Flume is not working

Explorer

Can you post your flume.conf pls ?

--
Lefevre Kevin