Skip to main content
Uday_Singh2022
Uday_Singh2022
Silver ⭐️⭐️
June 17, 2022
Solved

Apache Flume required to be run in CDP environment

Hi,

 

I have done migration from CDH to CDP 7.1.7. We were using Apache Flume previously. But since Flume is removed from CDP, our data flow is broken. I want to know if there is any documents available for setting up standalone Flume that can connect CDP Kafka consumer and save data to HBase tables.

Also want to note that I am using Kerberos for my cluster. 

 

mszurap
mszurapAnswer
Platinum ⭐️
June 17, 2022

Hi @Uday_Singh2022 , yes, Flume is not a supported component in CDP.

You can find documentations on Flume on it's official website:

https://flume.apache.org/

Have you considered to use CDF / Nifi for this usecase?

https://docs.cloudera.com/cdf-datahub/latest/nifi-hbase-ingest/topics/cdf-datahub-nifi-hbase-ingest.html 

Thanks, Miklos

View in thread

4 replies

mszurap
Platinum ⭐️
mszurapAnswer
Platinum ⭐️
June 17, 2022

Hi @Uday_Singh2022 , yes, Flume is not a supported component in CDP.

You can find documentations on Flume on it's official website:

https://flume.apache.org/

Have you considered to use CDF / Nifi for this usecase?

https://docs.cloudera.com/cdf-datahub/latest/nifi-hbase-ingest/topics/cdf-datahub-nifi-hbase-ingest.html 

Thanks, Miklos

Translate
Uday_Singh2022
Uday_Singh2022Author
Silver ⭐️⭐️
June 17, 2022

hi @mszurap ,

Thanks for you reply.

 

Yes I am aware of NiFi but client is not ready to migrate to it. They want to use Flume itself. So I am looking if there is any documentation from Cloudera side that can help.

 

 

Translate
ask_bill_brooks
Platinum ⭐️
ask_bill_brooks
Platinum ⭐️
June 17, 2022

@Uday_Singh2022 There won't be any documentation available from Cloudera regarding Flume because that lack of availability is part of what "not a supported component" means. If you must use Flume, then the documentation on the Apache site that @mszurap pointed you to above is your only option.

 

 

Translate
Bill Brooks, Community Moderator Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
Uday_Singh2022
Uday_Singh2022Author
Silver ⭐️⭐️
June 17, 2022

Thanks Guys.

Translate
Terms & ConditionsAccessibility statement