Member since
11-12-2018
189
Posts
177
Kudos Received
32
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
511 | 04-26-2024 02:20 AM | |
665 | 04-18-2024 12:35 PM | |
3221 | 08-05-2022 10:44 PM | |
2937 | 07-30-2022 04:37 PM | |
6415 | 07-29-2022 07:50 PM |
07-29-2022
07:08 PM
Hi @paulo_klein, To access the Livy, Zeppelin requires its own SSL certificate imported in the trustore to be configured. You can refer to the documentation, Livy Interpreter for Apache Zeppelin SSL configuration
... View more
07-29-2022
06:51 PM
1 Kudo
Hi @paulo_klein, Apache Spark by default request a delegation token for all 4 services: HDFS, YARN, Hive, and HBase. It is printed as a WARN message but it does no harm. It is captured due to the fact that no HBase jars are in the Spark classpath, hence, it's unable to get the HBase DelegationToken. To fix this issue you start spark-shell or pyspark or spark-submit via --conf spark.security.credentials.hbase.enabled=false Example: # spark-shell --conf spark.security.credentials.hbase.enabled=false
... View more
07-29-2022
06:42 PM
@jeromedruais Cluster is affected by the CVE-2022-33891 if only when the GroupMappingServiceProvider is called, i.e., when spark.history.ui.acls.enable / spark.acls.enable is enabled. Please make sure you have not enabled any Spark ACLs in your cluster. To verify you can check parameter settings via Ambari or Cloudera Manager UI -> spark configurations -> search for parameter spark.history.ui.acls.enable / spark.acls.enable and check if the value is enabled or disabled. To mitigate this issue you can disable Spark ACLs.
... View more
07-23-2022
07:06 AM
Hi @jeyaguna for upgrading the RHEL OS version from 7.7 to 7.9 you can refer to this discussion in the RedHat community portal. For upgrading the CDH version from 6.2.1 to 6.3.3 you can refer to Cloudera CDH upgrade documentation. You can easily fill in the form to create a customized set of instructions for your environment. Please note that, the version of CDH you can upgrade to depends on the version of Cloudera Manager that is managing the cluster. You may need to upgrade Cloudera Manager before upgrading CDH.
... View more
07-23-2022
06:56 AM
Hi @jeromedruais, this is a snown security issue CVE-2022-33891: Apache Spark shell command injection vulnerability via Spark UI reported in https://spark.apache.org/security.html For mitigation, update to Spark 3.1.3, 3.2.2, or 3.3.0 or later
... View more
07-12-2022
09:15 AM
Hi @dmharshit, once you have set hive.execution.engine=mr; what error are you getting? Please can you attach the screenshot?
... View more
07-09-2022
04:50 PM
1 Kudo
Hi @Vickywaran312, Latest release of Cloudera Data Platform (CDP) supports RHEL 8.4. Please see the Cloudera Support Matrix for detailed information about supported operating systems.
... View more
07-09-2022
04:37 PM
1 Kudo
This seems known bug NIFI-9079. Apache Atlas client library used by the Atlas Reporting Task (ReportLineageToAtlas) emits a large amount of INFO logs. Setting the log level to WARN in NiFi logback will fix this issue. ----- <logger name="org.apache.atlas" level="WARN"/> -----
... View more
07-07-2022
08:30 PM
Hi @dmharshit, if possible can you try running the insert query after changing the execution engine to MapReduce by setting the below parameter? set hive.execution.engine=mr;
... View more
07-05-2022
05:31 PM
Hi @Jessica_cisco, it looks like conflicts in the versions/classes. Kindly locate duplicate dependencies and then clean rebuild again.
... View more