Hi vdadhich, 1. Thanks for your reply. But I still have not the answer about Spark Structure Streaming simple and Kafka to using the avro in the CDH 6.3.2. 2. I saw the version of spark about CDH 6.3.2 is 2.4.0. I remembered that in spark 2.4.0 that should embedded avro. I mean that should used the avro format like the json. I used the to_json and from_json function that be provided by the spark framework,It’s good. But I changed to avro from json, that’s can be analyzing,but the data have some wrong. Could you help us to check the code, or give me an example about Spark structure streaming 2.4.0 version with Kafka using avro ? Thanks. ... View more

I will check our spark 2.4.5 application code compatibility with spark 2.3.2 version. Is Ambari & HDP going to be discontinued in near future as part of cloudera and hortonworks merger going ? We need to plan our choice of softwares accordingly. ... View more