Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Apache Flume required to be run in CDP environment

avatar

Hi,

 

I have done migration from CDH to CDP 7.1.7. We were using Apache Flume previously. But since Flume is removed from CDP, our data flow is broken. I want to know if there is any documents available for setting up standalone Flume that can connect CDP Kafka consumer and save data to HBase tables.

Also want to note that I am using Kerberos for my cluster. 

 

2 ACCEPTED SOLUTIONS

avatar

Hi @Uday_Singh2022 , yes, Flume is not a supported component in CDP.

You can find documentations on Flume on it's official website:

https://flume.apache.org/

Have you considered to use CDF / Nifi for this usecase?

https://docs.cloudera.com/cdf-datahub/latest/nifi-hbase-ingest/topics/cdf-datahub-nifi-hbase-ingest.... 

Thanks, Miklos

View solution in original post

avatar

@Uday_Singh2022 There won't be any documentation available from Cloudera regarding Flume because that lack of availability is part of what "not a supported component" means. If you must use Flume, then the documentation on the Apache site that @mszurap pointed you to above is your only option.

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post

4 REPLIES 4

avatar

Hi @Uday_Singh2022 , yes, Flume is not a supported component in CDP.

You can find documentations on Flume on it's official website:

https://flume.apache.org/

Have you considered to use CDF / Nifi for this usecase?

https://docs.cloudera.com/cdf-datahub/latest/nifi-hbase-ingest/topics/cdf-datahub-nifi-hbase-ingest.... 

Thanks, Miklos

avatar

hi @mszurap ,

Thanks for you reply.

 

Yes I am aware of NiFi but client is not ready to migrate to it. They want to use Flume itself. So I am looking if there is any documentation from Cloudera side that can help.

 

 

avatar

@Uday_Singh2022 There won't be any documentation available from Cloudera regarding Flume because that lack of availability is part of what "not a supported component" means. If you must use Flume, then the documentation on the Apache site that @mszurap pointed you to above is your only option.

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

avatar

Thanks Guys.