Member since
02-28-2022
171
Posts
14
Kudos Received
17
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 676 | 07-07-2025 06:35 AM | |
| 738 | 06-17-2025 09:42 AM | |
| 2352 | 04-02-2025 07:43 AM | |
| 778 | 10-18-2024 12:29 PM | |
| 12562 | 09-05-2024 09:06 AM |
04-25-2022
01:33 PM
accidentally deleted /config/topics directory within zookeeper zkcli. so far the kafka cluster is operational, but we need to know what this directory can interfere with in the future? Is it possible to restore this /config/topics directory in zookeeper?
... View more
Labels:
- Labels:
-
Apache Kafka
-
Cloudera Manager
04-18-2022
10:31 AM
I would like to know how to calculate the number of coordinators and executors in the impala cluster? today I have 23 nodes with only impala daemon, what would be the best division of coordinators for and executors for impala?
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Manager
04-14-2022
01:35 PM
hi @bbahamondes, thank you for the explanation
... View more
04-14-2022
09:30 AM
hi, @mszurap, in the file "/run/cloudera-scm-agent/process/24750-nifi-NIFI_NODE/supervisor.conf" has the following parameter "KRB5CCNAME=krb5cc_cldr" the "KRB5CCNAME" parameter is in the "environment" line of the "/run/cloudera-scm-agent/process/24750-nifi-NIFI_NODE/supervisor.conf" file as shown below: environment=CDH_PARQUET_HOME='/usr/lib/parquet',CDH_MR2_HOME='/usr/lib/hadoop-mapreduce',CMF_PACKAGE_DIR='/opt/cloudera/cm-agent/service',CM_STATUS_CODES='STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE',MGMT_HOME='/opt/cloudera/cm',CGROUP_ROOT_CPU='/sys/fs/cgroup/cpu,cpuacct',CDH_IMPALA_HOME='/usr/lib/impala',CDH_YARN_HOME='/usr/lib/hadoop-yarn',nifi_service_principal='nifi/host-nifi-16.domain.local@TESTE.INT.BR',CGROUP_GROUP_CPU='system.slice/cloudera-scm-agent.service',CSD_JAVA_OPTS='-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/nifi_nifi-NIFI_NODE-ae57679df54eef6fea3afc54d3cb40ad_pid{{PID}}.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh',CDH_HDFS_HOME='/usr/lib/hadoop-hdfs',CSD_HOST='host-nifi-16.domain.local',HADOOP_CREDSTORE_PASSWORD='6d1ddiyksatrp1nwubz27h5jp',PATH='/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin',CDH_HUE_PLUGINS_HOME='/usr/lib/hadoop',PARCEL_DIRNAMES='CDH-6.3.4-1.cdh6.3.4.p0.6751098:CFM-1.0.1.0',CDH_HADOOP_BIN='/usr/bin/hadoop',KEYTRUSTEE_KP_HOME='/usr/share/keytrustee-keyprovider',CDH_KUDU_HOME='/usr/lib/kudu',CLOUDERA_ORACLE_CONNECTOR_JAR='/usr/share/java/oracle-connector-java.jar',CONF_DIR='/var/run/cloudera-scm-agent/process/24750-nifi-NIFI_NODE',CDH_SQOOP2_HOME='/usr/lib/sqoop2',KEYTRUSTEE_SERVER_HOME='/usr/lib/keytrustee-server',JSVC_HOME='/usr/libexec/bigtop-utils',HOME='/var/lib/nifi',HIVE_DEFAULT_XML='/etc/hive/conf.dist/hive-default.xml',CUSTOM_JAVA_HOME='/usr/java/default',JAVA_HOME='/usr/java/jdk1.8.0_162',CLOUDERA_POSTGRESQL_JDBC_JAR='/opt/cloudera/cm/lib/postgresql-42.2.14.jre7.jar',CGROUP_GROUP_CPUACCT='system.slice/cloudera-scm-agent.service',CM_CSD_SCRIPT='scripts/control.sh',PARCELS_ROOT='/opt/cloudera/parcels',CDH_KMS_HOME='/usr/lib/hadoop-kms',ZK_QUORUM='host-nifi-14.domain.local:2183,host-nifi-15.domain.local:2183,host-nifi-16.domain.local:2183',CDH_HBASE_HOME='/usr/lib/hbase',CDH_SQOOP_HOME='/usr/lib/sqoop',CDH_HCAT_HOME='/usr/lib/hcatalog',CDH_OOZIE_HOME='/usr/lib/oozie',CDH_HIVE_HOME='/usr/lib/hive',CDH_ZOOKEEPER_HOME='/usr/lib/zookeeper',CDH_HUE_HOME='/usr/lib/hue',nifi_spnego_principal='HTTP/host-nifi-16.domain.local@TESTE.INT.BR',CGROUP_GROUP_DEVICES='system.slice',CGROUP_ROOT_MEMORY='/sys/fs/cgroup/memory',CLOUDERA_MYSQL_CONNECTOR_JAR='/usr/share/java/mysql-connector-java.jar',CDH_SPARK_HOME='/usr/lib/spark',CGROUP_GROUP_MEMORY='system.slice/cloudera-scm-agent.service',KRB5CCNAME='krb5cc_cldr',CDH_MR1_HOME='/usr/lib/hadoop-0.20-mapreduce',TOMCAT_HOME='/usr/lib/bigtop-tomcat',CDH_PIG_HOME='/usr/lib/pig',CDH_SENTRY_HOME='/usr/lib/sentry',CDH_VERSION='6',CGROUP_GROUP_BLKIO='system.slice/cloudera-scm-agent.service',NIFI_LOG_DIR='/var/log/nifi',CGROUP_ROOT_BLKIO='/sys/fs/cgroup/blkio',CDH_CRUNCH_HOME='/usr/lib/crunch',CDH_LLAMA_HOME='/usr/lib/llama/',CDH_HTTPFS_HOME='/usr/lib/hadoop-httpfs',CDH_HADOOP_HOME='/usr/lib/hadoop',ORACLE_HOME='/usr/share/oracle/instantclient',CMF_SERVER_ROOT='/opt/cloudera/cm',WEBHCAT_DEFAULT_XML='/etc/hive-webhcat/conf.dist/webhcat-default.xml',CDH_KAFKA_HOME='/usr/lib/kafka',CGROUP_ROOT_DEVICES='/sys/fs/cgroup/devices',CDH_HBASE_INDEXER_HOME='/usr/lib/hbase-solr',SCM_DEFINES_SCRIPTS='/opt/cloudera/parcels/CDH-6.3.4-1.cdh6.3.4.p0.6751098/meta/cdh_env.sh:/opt/cloudera/parcels/CFM-1.0.1.0/meta/nifi_bundle_env.sh',CDH_SOLR_HOME='/usr/lib/solr',CGROUP_ROOT_CPUACCT='/sys/fs/cgroup/cpu,cpuacct',CDH_FLUME_HOME='/usr/lib/flume-ng' so the cloudera manager itself is distributing this file "krb5cc_cldr"? PS: this file is in /tmp/krb5cc_cldr
... View more
04-14-2022
09:18 AM
hi @jeremymolina , how are you? thank you very much for the explanation.
... View more
04-14-2022
08:35 AM
hi @smdas, @shubham_sharma, @RangaReddy, @mszurap, can help with this queue issue on YARN in Ambari?
... View more
04-14-2022
08:31 AM
can we delete the files that exist in the directory configured in the "Heap Dump Directory" option of the services in CDH/CM?
... View more
Labels:
04-14-2022
08:16 AM
hi @mszurap , in the file "/run/cloudera-scm-agent/process/24750-nifi-NIFI_NODE/supervisor.conf" has exactly the parameter "KRB5CCNAME='krb5cc_cldr'" do we need to know where he is getting this information from? we already looked in the .bashrc and .bash_profile of the root user and other users, nothing was found.
... View more
04-14-2022
06:57 AM
hi @mszurap, how are you? right, in the file "supervisor.conf" there is a parameter called "KRB5CCNAME=/tmp/kbr5cc_dffe", I would like to know where this information is coming from.
... View more
04-13-2022
01:27 PM
we need to know if nifi is responsible for the file below: /run/cloudera-scm-agent/process/24750-nifi-NIFI_NODE/supervisor.conf because this file contains information that we are not finding in the nifi settings in the CDM
... View more
Labels:
- Labels:
-
Apache NiFi