Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Remove Duplicate Record values without cache services

avatar
Explorer

Hi All, Good Morning!

 

Please help me in removing Duplicate Records without using cache services (Apache NIFI)Error LogError Log

1 ACCEPTED SOLUTION

avatar
Explorer

No, Not yet and I am waiting from the client end for confirmation since my clients are abroad and they have access for the same, Would check and let you know the results by tomorrow 10th May 2022. Thanks for the help SAMSAL.

View solution in original post

11 REPLIES 11

avatar
Super Guru

I never worked with Hive DB, but if it only takes avro format and you have csv you can use processor ConvertRecrod to convert a record from one format to another. In this processor you create CSV Reader service and the writer is Avro

avatar
Explorer

 Sure SAMSOL, In Hive DB, I am having a table and no need for any SQL INSERT STATEMENT.

Say HIVE DB Table has XXX, in that I have to put these Data and Error Field, Just convert to Avro works or ??? have to call insert statement processor