Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Change delimiter in flume

avatar
Contributor
 

I am trying to learn flume and for this I am creating some rows to ingest. I have a row like

"ted";"27";"hi, i am good; you?";"ok"

With the delimiter as ; it separates me also the hi, i am good you? I want only to change field when the ; has a " next to it. Is this possible?

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Hello,

 

I haven't used Flume myself, but there is some mention of serializer.delimiter parameter in the Flume documentation. It would be helpful to know what the source of the data is (e.g. file on hdfs) and what the destination is (e.g. Hive).

 

Also you should know that in Cloudera Data Platform, Flume is no longer a supported component. If you are just starting to learn it, I would recommend saving yourself some time and exploring NiFi, Kafka, and Flink (good starter blog post).

 

 

Regards,

Alex

View solution in original post

1 REPLY 1

avatar
Master Collaborator

Hello,

 

I haven't used Flume myself, but there is some mention of serializer.delimiter parameter in the Flume documentation. It would be helpful to know what the source of the data is (e.g. file on hdfs) and what the destination is (e.g. Hive).

 

Also you should know that in Cloudera Data Platform, Flume is no longer a supported component. If you are just starting to learn it, I would recommend saving yourself some time and exploring NiFi, Kafka, and Flink (good starter blog post).

 

 

Regards,

Alex