Created 09-18-2024 01:49 PM
Hello community,
I want to get the from hdfs to confluent cloud kafka is there any suggestion how to do that.
Created 09-23-2024 11:35 PM
Hello @Israr ,
Cloudera provides the easiest ways and options to configure such setups through Cloudera Manager (CM) and Streams Messaging Manager (SMM) [1]
You can configure this pipeline with HDFS or Stateless NiFi Source and Sink connectors [2] & [3].
[2] Public Cloud: https://docs.cloudera.com/runtime/7.2.18/kafka-connect/topics/kafka-connect-connector-nifi-stateless...
HDFS: https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/kafka-connect/kafka-connect.pdf
If you found this response assisted with your query, please take a moment to log in and click on KUDOS 🙂 & ”Accept as Solution" below this post.
Thank you.
Created 09-18-2024 02:26 PM
@Israr Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our Kafka experts @ChethanYM @paras who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Created 09-21-2024 11:28 AM
anyone can help ?
Created 09-23-2024 04:08 PM
Hi! @Babasaheb @rki_ Do you have any insights here? Thanks!
Regards,
Diana Torres,Created 09-23-2024 11:35 PM
Hello @Israr ,
Cloudera provides the easiest ways and options to configure such setups through Cloudera Manager (CM) and Streams Messaging Manager (SMM) [1]
You can configure this pipeline with HDFS or Stateless NiFi Source and Sink connectors [2] & [3].
[2] Public Cloud: https://docs.cloudera.com/runtime/7.2.18/kafka-connect/topics/kafka-connect-connector-nifi-stateless...
HDFS: https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/kafka-connect/kafka-connect.pdf
If you found this response assisted with your query, please take a moment to log in and click on KUDOS 🙂 & ”Accept as Solution" below this post.
Thank you.
Created on 09-24-2024 10:26 AM - edited 09-24-2024 10:27 AM
i have install smm on my cdp priavate cluster connector option is not showing , is any other service also need i am using cdp 7.4.4 or i have chnage cdp version
Created 09-25-2024 06:02 AM
Hello @Israr ,
You should verify that both Kafka and Kafka Connect are running and in a healthy state.
Thank you.
Created 09-25-2024 06:05 AM
Yes, It is running i am able to create the topic