Support Questions
Find answers, ask questions, and share your expertise

right approach for consuming log from kafka to insert into hdfs/ hive and further insert filtered column into elastic-search

New Contributor

I am receiving logs from kafka-consumer and inserting into HDFS now i want to put same data in elastic search with some condition.Can anyone help me how should i first insert data from hdfs to hive then pull some of the column from hive and insert into elastic search.