Skip to main content
drgenious
drgenious
Silver ⭐️⭐️⭐️
May 25, 2021
Solved

Change delimiter in flume

 

I am trying to learn flume and for this I am creating some rows to ingest. I have a row like

"ted";"27";"hi, i am good; you?";"ok"

With the delimiter as ; it separates me also the hi, i am good you? I want only to change field when the ; has a " next to it. Is this possible?

aakulov
aakulovAnswer
Platinum ⭐️
May 25, 2021

Hello,

 

I haven't used Flume myself, but there is some mention of serializer.delimiter parameter in the Flume documentation. It would be helpful to know what the source of the data is (e.g. file on hdfs) and what the destination is (e.g. Hive).

 

Also you should know that in Cloudera Data Platform, Flume is no longer a supported component. If you are just starting to learn it, I would recommend saving yourself some time and exploring NiFi, Kafka, and Flink (good starter blog post).

 

 

Regards,

Alex

View in thread

1 reply

aakulov
Platinum ⭐️
aakulovAnswer
Platinum ⭐️
May 25, 2021

Hello,

 

I haven't used Flume myself, but there is some mention of serializer.delimiter parameter in the Flume documentation. It would be helpful to know what the source of the data is (e.g. file on hdfs) and what the destination is (e.g. Hive).

 

Also you should know that in Cloudera Data Platform, Flume is no longer a supported component. If you are just starting to learn it, I would recommend saving yourself some time and exploring NiFi, Kafka, and Flink (good starter blog post).

 

 

Regards,

Alex

Translate
Terms & ConditionsAccessibility statement