Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3368 | 05-03-2017 05:13 PM | |
2801 | 05-02-2017 08:38 AM | |
3080 | 05-02-2017 08:13 AM | |
3009 | 04-10-2017 10:51 PM | |
1525 | 03-28-2017 02:27 AM |
01-20-2016
05:36 PM
@Swapnil Prabhu there's no such thing as HDP 2.6. Just make sure your HDP repo coincides with the HDP version you're running in your /etc/yum.repos.d/. Make sure you have connectivity, try to run yum clean all yum repolist yum update
... View more
01-20-2016
05:02 PM
@Ancil McBarnett Have you looked at this guide?
... View more
01-20-2016
05:02 PM
1 Kudo
storm supervisors on their own nodes, kafka brokers can be collocated with datanodes, that's my findings from our recent POC. I can give you more detail on phone. @Ancil McBarnett
... View more
01-20-2016
04:54 PM
@Vikas Gadade you will need to refer to the hue release notes for that.
... View more
01-20-2016
04:18 PM
@vijay patel you need to open a new thread as this is different requirement from the original question. This can become messy as you will have to chain Flume agents. The only way to chain the agents is to use Avro RPC. We recommend you look at HDF powered by Apache Nifi. It will be a lot simpler to do.
... View more
01-20-2016
04:12 PM
@vijay patel I suggest doing a tutorial on flume, there are no other jars necessary.
... View more
01-20-2016
04:04 PM
there are examples at the links I provided a1.sources = r1
a1.channels = c1
a1.sources.r1.type = jms
a1.sources.r1.channels = c1
a1.sources.r1.initialContextFactory = org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.connectionFactory = GenericConnectionFactory
a1.sources.r1.providerURL = tcp://mqserver:61616
a1.sources.r1.destinationName = BUSINESS_DATA
a1.sources.r1.destinationType = QUEUE
a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSink
a1.sinks.k1.topic = mytopic
a1.sinks.k1.brokerList = localhost:9092
a1.sinks.k1.requiredAcks = 1
a1.sinks.k1.batchSize = 20
a1.sinks.k1.channel = c1 again you also need to add a channel, there are tons of examples on the same site. @vijay patel
... View more
01-20-2016
03:53 PM
excellent, just FYI, marking your own answer as best will not earn you points.
... View more
01-20-2016
03:49 PM
there must be an explanation but on reference page it does not clarify, I feel your pain. Perhaps it has to do with namespace permissions also. @Enis @Devaraj Das @vrodionov @nmaillard
... View more
01-20-2016
03:47 PM
@vijay patel
you need JMS Source also need Kafka Sink and a channel of your choice
... View more