Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1944 | 06-15-2020 05:23 AM | |
| 15823 | 01-30-2020 08:04 PM | |
| 2093 | 07-07-2019 09:06 PM | |
| 8175 | 01-27-2018 10:17 PM | |
| 4639 | 12-31-2017 10:12 PM |
08-14-2018
05:45 PM
dose ambari 2.7 version is the latest ambari version ?
... View more
08-14-2018
08:00 AM
we want to know if we can to upgrade to HDP 3.0 from HDP 2.6.4 ( regarding the disks aspect ) and we want to know if current disks configuration enable this upgrade we have the following RAID configuration 1) Worker-> (OS) Raid1 + ( data disks ) Raid 5
2) Master -> (OS) Raid1 + ( data disks ) Raid10
3) Kafka-> (OS) Raid1 + ( data disk ) Raid10 about the kafka - each kafka has one data disk about the workers ( data-node ) - each worker has 10 data disks based on that configuration , can we upgrade to HDP 3.0 version ?
... View more
Labels:
08-13-2018
10:23 PM
for HDFS now its more clear , but for kafka , where I need to set the "-XX:+UseGCLogFileRotation-XX:NumberOfGCLogFiles=5-XX:GCLogFileSize=2M" ?
... View more
08-13-2018
09:01 PM
Not understand about the HDFS , why not put all properties in variable as KAFKA_GC_LOG_OPTS="-XX:+UseGCLogFileRotation-XX:NumberOfGCLogFiles=5-XX:GCLogFileSize=2M"
... View more
08-13-2018
08:33 PM
what we are thinking but we are not sure is that: for kafka KAFKA_GC_LOG_OPTS="-XX:+UseGCLogFileRotation-XX:NumberOfGCLogFiles=5-XX:GCLogFileSize=2M" for hdfs JAVA_OPTS="-XX:+UseGCLogFileRotation-XX:NumberOfGCLogFiles=5-XX:GCLogFileSize=2M"
... View more
08-13-2018
08:21 PM
@amarnath reddy pappu regarding my details above , can you suggest with which variable I can use in order to set the properties ? , of maybe I need to append variable that represented the - JVM parameters , if yes what is the name of the variable ?
... View more
08-13-2018
07:42 PM
this is what we have in hadoop-end from amabri GUI in HDFS service hadoop-env-hdfs.txt
... View more
08-13-2018
07:39 PM
this is what we have in kafka-end ( in ambari GUI ) #!/bin/bash
# Set KAFKA specific environment variables here.
# The java implementation to use.
export JAVA_HOME={{java64_home}}
export PATH=$PATH:$JAVA_HOME/bin
export PID_DIR={{kafka_pid_dir}}
export LOG_DIR={{kafka_log_dir}}
export KAFKA_KERBEROS_PARAMS={{kafka_kerberos_params}}
export JMX_PORT=9997
# Add kafka sink to classpath and related depenencies
if [ -e "/usr/lib/ambari-metrics-kafka-sink/ambari-metrics-kafka-sink.jar" ]; then
export CLASSPATH=$CLASSPATH:/usr/lib/ambari-metrics-kafka-sink/ambari-metrics-kafka-sink.jar
export CLASSPATH=$CLASSPATH:/usr/lib/ambari-metrics-kafka-sink/lib/*
fi
if [ -f /etc/kafka/conf/kafka-ranger-env.sh ]; then
. /etc/kafka/conf/kafka-ranger-env.sh
fi
... View more
08-13-2018
07:24 PM
@amarnath reddy pappu the problem is that I not sure what is JVM parameters variable for HDFS and kafka - which Variable I need to search ? if not defined should I add this variable ?
... View more
08-13-2018
07:08 PM
on the following answer , we have explain how to rotate gc.log ( logs ) for metrics collector service https://community.hortonworks.com/questions/194534/automatic-deletion-of-rotated-gclog-files.html Now we need to do the same on the following services HDFS KAFKA what should be the approach on that services ?
... View more
Labels: