04-21-2016 08:52 PM
I started my Flume services, check Flume logs in /var/logs/flume-ng, agent started, everything seems fine. However, the data in ActiveMQ is not stored in my HDFS. May I know what other logs I can check to see where went wrong?
Also, do we need to specify the activeMQ topic in the Flume configuration? The example from Flume user guide does not have a topic.
a1.sources = r1 a1.channels = c1 a1.sources.r1.type = jms a1.sources.r1.channels = c1 a1.sources.r1.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory a1.sources.r1.connectionFactory = GenericConnectionFactory a1.sources.r1.providerURL = tcp://mqserver:61616 a1.sources.r1.destinationName = BUSINESS_DATA a1.sources.r1.destinationType = QUEUE
04-22-2016 09:03 AM
04-24-2016 05:54 PM
Yes, the topic is causing the problem. Now I am able to see data inserted to hdfs after changing the topic.
If I have more than 1 topic in activemq, how do I specify it in the flume configuration?