Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Flume Twitter: Could not configure channel MemChannel

avatar
Rising Star

I am trying to fetch twitter feed in using hortonworks ambari cluster.

But getting below error:

19 Mar 2016 03:54:49,969 WARN [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateChannels:486) - Could not configure channel MemChannel due to: Component has no type. Cannot configure. MemChannel org.apache.flume.conf.ConfigurationException: Component has no type. Cannot configure. MemChannel at org.apache.flume.conf.ComponentConfiguration.configure(ComponentConfiguration.java:76) at org.apache.flume.conf.channel.ChannelConfiguration.configure(ChannelConfiguration.java:32) at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateChannels(FlumeConfiguration.java:470) at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:334) at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.access$000(FlumeConfiguration.java:212) at org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:126) at org.apache.flume.conf.FlumeConfiguration.<init>(FlumeConfiguration.java:108) at org.apache.flume.node.PropertiesFileConfigurationProvider.getFlumeConfiguration(PropertiesFileConfigurationProvider.java:193) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:94) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 19 Mar 2016 03:54:49,971 WARN [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid:336) - Agent configuration for 'TwitterAgent' does not contain any valid channels. Marking it as invalid. 19 Mar 2016 03:54:49,971 WARN [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration.validateConfiguration:127) - Agent configuration invalid for agent 'TwitterAgent'. It will be removed. 19 Mar 2016 03:54:49,971 INFO [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration.validateConfiguration:140) - Post-validation flume configuration contains configuration for agents: [] 19 Mar 2016 03:54:49,972 WARN [conf-file-poller-0] (org.apache.flume.node.AbstractConfigurationProvider.getConfiguration:138) - No configuration found for this host:TwitterAgent 19 Mar 2016 03:54:49,981 INFO [conf-file-poller-0] (org.apache.flume.node.Application.startAllComponents:138) - Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} } 19 Mar 2016 03:54:50,177 INFO [conf-file-poller-0] (org.apache.hadoop.metrics2.sink.flume.FlumeTimelineMetricsSink.configure:76) - Context parameters { parameters:{node=masbidw2.usa.corp.ad:6188, type=org.apache.hadoop.metrics2.sink.flume.FlumeTimelineMetricsSink} } 19 Mar 2016 03:54:50,186 INFO [conf-file-poller-0] (org.apache.hadoop.metrics2.sink.flume.FlumeTimelineMetricsSink.start:59) - Starting Flume Metrics Sink

flume-conf.jpgflume-env.jpg

Also download cloudera source jar file but not luck. Please help

1 ACCEPTED SOLUTION

avatar
Master Mentor

I don't see type in your channel

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

View solution in original post

2 REPLIES 2

avatar
Master Mentor

I don't see type in your channel

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

avatar
Rising Star

@Artem Ervits Thanks. It is working now.