Member since
06-26-2021
2
Posts
0
Kudos Received
0
Solutions
06-28-2021
05:35 PM
Hi vdadhich, 1. Thanks for your reply. But I still have not the answer about Spark Structure Streaming simple and Kafka to using the avro in the CDH 6.3.2. 2. I saw the version of spark about CDH 6.3.2 is 2.4.0. I remembered that in spark 2.4.0 that should embedded avro. I mean that should used the avro format like the json. I used the to_json and from_json function that be provided by the spark framework,It’s good. But I changed to avro from json, that’s can be analyzing,but the data have some wrong. Could you help us to check the code, or give me an example about Spark structure streaming 2.4.0 version with Kafka using avro ? Thanks.
... View more