Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

I want to load the multiple Kafka messages to multiple HDFS folders in Nifi

Highlighted

I want to load the multiple Kafka messages to multiple HDFS folders in Nifi

New Contributor

Currently I am using ConsumeKafkaRecord, Merge Content and PutHDFS to load the data from kafka to Hive. We need to automate this for multiple kafka topics. Is there any way to do it in nifi.


Eg : If I give topic names as abc,xyz the data from abc topic should be moved to /abc and data from xyz should be moved to /xyz folder.


Please suggest.

Don't have an account?
Coming from Hortonworks? Activate your account here