Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Flume Twitter: Could not configure channel MemChannel

avatar
Rising Star

I am trying to fetch twitter feed in using hortonworks ambari cluster.

But getting below error:

19 Mar 2016 03:54:49,969 WARN [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateChannels:486) - Could not configure channel MemChannel due to: Component has no type. Cannot configure. MemChannel org.apache.flume.conf.ConfigurationException: Component has no type. Cannot configure. MemChannel at org.apache.flume.conf.ComponentConfiguration.configure(ComponentConfiguration.java:76) at org.apache.flume.conf.channel.ChannelConfiguration.configure(ChannelConfiguration.java:32) at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateChannels(FlumeConfiguration.java:470) at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:334) at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.access$000(FlumeConfiguration.java:212) at org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:126) at org.apache.flume.conf.FlumeConfiguration.<init>(FlumeConfiguration.java:108) at org.apache.flume.node.PropertiesFileConfigurationProvider.getFlumeConfiguration(PropertiesFileConfigurationProvider.java:193) at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:94) at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 19 Mar 2016 03:54:49,971 WARN [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid:336) - Agent configuration for 'TwitterAgent' does not contain any valid channels. Marking it as invalid. 19 Mar 2016 03:54:49,971 WARN [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration.validateConfiguration:127) - Agent configuration invalid for agent 'TwitterAgent'. It will be removed. 19 Mar 2016 03:54:49,971 INFO [conf-file-poller-0] (org.apache.flume.conf.FlumeConfiguration.validateConfiguration:140) - Post-validation flume configuration contains configuration for agents: [] 19 Mar 2016 03:54:49,972 WARN [conf-file-poller-0] (org.apache.flume.node.AbstractConfigurationProvider.getConfiguration:138) - No configuration found for this host:TwitterAgent 19 Mar 2016 03:54:49,981 INFO [conf-file-poller-0] (org.apache.flume.node.Application.startAllComponents:138) - Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} } 19 Mar 2016 03:54:50,177 INFO [conf-file-poller-0] (org.apache.hadoop.metrics2.sink.flume.FlumeTimelineMetricsSink.configure:76) - Context parameters { parameters:{node=masbidw2.usa.corp.ad:6188, type=org.apache.hadoop.metrics2.sink.flume.FlumeTimelineMetricsSink} } 19 Mar 2016 03:54:50,186 INFO [conf-file-poller-0] (org.apache.hadoop.metrics2.sink.flume.FlumeTimelineMetricsSink.start:59) - Starting Flume Metrics Sink

flume-conf.jpgflume-env.jpg

Also download cloudera source jar file but not luck. Please help

1 ACCEPTED SOLUTION

avatar
Master Mentor

I don't see type in your channel

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

View solution in original post

2 REPLIES 2

avatar
Master Mentor

I don't see type in your channel

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

avatar
Rising Star

@Artem Ervits Thanks. It is working now.