Member since
07-02-2018
5
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2753 | 06-25-2020 02:03 AM |
06-28-2021
08:06 AM
Hi @bruce_yang, Thank you for reaching out. As I see the query you need assistance to read AVRO using Kafka. Cloudera has a way to achieve it and that is very well explained in the thread[1],[2] and [3]. Please let me know if this helped.
... View more
06-25-2020
02:03 AM
Hi, Thanks for the reply the approach that you have shared as below, is not supported with HDP cluster. "Can we install hadoop & spark 2.4.5 packages on multi node cluster without using hdp, ambari & cloudera" So option here is to use the Spark 2.3.2 version that comes with HDP 3.1.5, we can also involve the technical support team of cloudera, if you are hitting any issue with the Spark 2.3.2. Thanks and Regards, Vikas Dadhich
... View more
06-25-2020
01:33 AM
Hi, Thanks for creating a new thread seems you need help to setup spark 2.4.5 with Ambari. As you already mentioned that HDP does not support the spark 2.4.5. I agree, we do have latest HDP 3.1.5 at this moment that comes with the Apache Spark 2.3.2 for more information you can refer the link[1]. Also, installing the upstream component versions is not supported so we are very limited with the resources. Please follow the support matrix to use the supported configuration as mentioned under the link[2]. link[1]: https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/content/comp_versions.html link[2]: https://supportmatrix.hortonworks.com/ Thanks and Regards, Vikas Dadhich
... View more