Support Questions
Find answers, ask questions, and share your expertise

Apache Flume required to be run in CDP environment

New Contributor

Hi,

 

I have done migration from CDH to CDP 7.1.7. We were using Apache Flume previously. But since Flume is removed from CDP, our data flow is broken. I want to know if there is any documents available for setting up standalone Flume that can connect CDP Kafka consumer and save data to HBase tables.

Also want to note that I am using Kerberos for my cluster. 

 

2 ACCEPTED SOLUTIONS

Expert Contributor

Hi @Uday_Singh2022 , yes, Flume is not a supported component in CDP.

You can find documentations on Flume on it's official website:

https://flume.apache.org/

Have you considered to use CDF / Nifi for this usecase?

https://docs.cloudera.com/cdf-datahub/latest/nifi-hbase-ingest/topics/cdf-datahub-nifi-hbase-ingest.... 

Thanks, Miklos

View solution in original post

@Uday_Singh2022 There won't be any documentation available from Cloudera regarding Flume because that lack of availability is part of what "not a supported component" means. If you must use Flume, then the documentation on the Apache site that @mszurap pointed you to above is your only option.

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

View solution in original post

4 REPLIES 4

Expert Contributor

Hi @Uday_Singh2022 , yes, Flume is not a supported component in CDP.

You can find documentations on Flume on it's official website:

https://flume.apache.org/

Have you considered to use CDF / Nifi for this usecase?

https://docs.cloudera.com/cdf-datahub/latest/nifi-hbase-ingest/topics/cdf-datahub-nifi-hbase-ingest.... 

Thanks, Miklos

New Contributor

hi @mszurap ,

Thanks for you reply.

 

Yes I am aware of NiFi but client is not ready to migrate to it. They want to use Flume itself. So I am looking if there is any documentation from Cloudera side that can help.

 

 

@Uday_Singh2022 There won't be any documentation available from Cloudera regarding Flume because that lack of availability is part of what "not a supported component" means. If you must use Flume, then the documentation on the Apache site that @mszurap pointed you to above is your only option.

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

New Contributor

Thanks Guys.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.