Member since
12-23-2021
3
Posts
0
Kudos Received
0
Solutions
02-01-2022
05:27 AM
Hello, We need advise about advanced Kafka configuration in Cloudera We are using cloudera env installed on 6 servers per following distribution: Namenode1-2 Datanode1-3 Application node kafka service is installed on data nodes 1-3 and we would like to know: How can we configure Kafka port per hostname and not per service? we would like to have following outcome for example: datanode1 - remain with kafka default port 9092 datanode2 - will be configured with new port # datanode3 - will be configured with new port # Thanks Noam
... View more
Labels:
01-02-2022
04:26 AM
Thanks @GangWar , we run patch for log4j provided at https://github.com/cloudera/cloudera-scripts-for-log4j However, how can we verify our env is out from log4j risk? is there some java classes we should verify inside? Per what we see: 1. log4shell-backup directory is empty 2. log4j V1 jars are not removed e.g. [root@host cloudera-scripts-for-log4j]# cat output_run_log4j_patcher.hVIY8n Using tmp directory '/tmp' Removing JNDI from jar files Running on '/opt/cloudera' Backing up files to '/opt/cloudera/log4shell-backup' Completed removing JNDI from jar files Completed removing JNDI from nar files Removing JNDI from tar.gz files Found an HDFS namenode on this host, removing JNDI from HDFS tar.gz files for platform='common' Keytab file is not found or is empty: /var/run/cloudera-scm-agent/process/153-hdfs-NAMENODE/hdfs.keytab. Considering this as a non-secure cluster deployment. Tar ball is not available in /user/tez/*. tez is not installed. Keytab file is not found or is empty: /var/run/cloudera-scm-agent/process/153-hdfs-NAMENODE/hdfs.keytab. Considering this as a non-secure cluster deployment. Tar ball is not available in /user/yarn/mapreduce/mr-framework/. mr is not installed. [root@host cloudera-scripts-for-log4j]# ll /opt/cloudera/log4shell-backup total 0 [root@host cloudera-scripts-for-log4j]# ll /opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.34/jars/log4j* -rwxr-xr-x 1 root root 481535 Apr 6 2017 /opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.34/jars/log4j-1.2.16.jar -rw-r--r-- 1 root root 489884 Apr 6 2017 /opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.34/jars/log4j-1.2.17.jar [root@host cloudera-scripts-for-log4j]# ll /usr/share/cmf/common_jars/log4j* -rw-r--r-- 1 root root 481535 Apr 12 2017 /usr/share/cmf/common_jars/log4j-1.2.16.jar -rw-r--r-- 1 root root 489884 Mar 30 2017 /usr/share/cmf/common_jars/log4j-1.2.17.jar Thanks
... View more
12-23-2021
04:29 AM
Hello, We are using Cloudera V5.1.1 with log4j v1.2.17, without option to upgrade Cloudera to later version at this moment. Does anyone has suggestion or solution how can we upgrade log4j component to latest version(2.16.0) on CDH V5.1.1? Thanks
... View more
Labels:
- Labels:
-
Cloudera Manager