another one question please , I see that ambari-metrics-collector.log created with huge size , can we rote it also and zipped it ? -rw-r--r-- 1 ams hadoop 2008 Aug 16 18:32 ambari-metrics-collector.out -rw-r--r--. 1 ams hadoop 40776116 Aug 16 18:33 ambari-metrics-collector.log ... View more

its works -:) ... View more

I copy the file and restart the service but without good results ... View more

under /usr/hdp/current , we have only the follwing links ( not hbase-master folder ) hadoop-client hadoop-hdfs-portmap hadoop-yarn-client hive-server2 livy-client spark2-thriftserver zookeeper-server hadoop-hdfs-client hadoop-hdfs-secondarynamenode hadoop-yarn-nodemanager hive-server2-hive2 pig-client spark-client hadoop-hdfs-datanode hadoop-hdfs-zkfc hadoop-yarn-resourcemanager hive-webhcat shc spark_llap hadoop-hdfs-journalnode hadoop-httpfs hadoop-yarn-timelineserver kafka-broker slider-client storm-slider-client hadoop-hdfs-namenode hadoop-mapreduce-client hive-client livy2-client spark2-client tez-client hadoop-hdfs-nfs3 hadoop-mapreduce-historyserver hive-metastore livy2-server spark2-historyserver zookeeper-client ... View more

this are the new logs that I get now -rw-r--r-- 1 hive hadoop 389 Aug 15 19:28 hivemetastore.log-.10.log.gz -rw-r--r--. 1 hive hadoop 0 Aug 15 19:29 hive.err -rw-r--r--. 1 hive hadoop 31 Aug 15 19:29 hive.out -rw-r--r--. 1 hive hadoop 0 Aug 15 19:29 hive-server2.out -rw-r--r--. 1 hive hadoop 0 Aug 15 19:29 hive-server2.err -rw-r--r-- 1 hive hadoop 1719 Aug 15 19:34 hivemetastore.log-.9.log.gz -rw-r--r-- 1 hive hadoop 4357 Aug 15 19:34 hiveserver2-report.json -rw-r--r-- 1 hive hadoop 4315 Aug 15 19:34 hivemetastore-report.json -rw-r--r-- 1 hive hadoop 1240 Aug 15 19:42 hiveserver2.log-.10.log.gz -rw-r--r-- 1 hive hadoop 1038 Aug 15 19:43 hivemetastore.log-.8.log.gz -rw-r--r-- 1 hive hadoop 1159 Aug 15 19:48 hiveserver2.log-.9.log.gz -rw-r--r-- 1 hive hadoop 1038 Aug 15 19:49 hivemetastore.log-.7.log.gz -rw-r--r-- 1 hive hadoop 1150 Aug 15 19:54 hiveserver2.log-.8.log.gz -rw-r--r-- 1 hive hadoop 1019 Aug 15 19:58 hivemetastore.log-.6.log.gz -rw-r--r-- 1 hive hadoop 1168 Aug 15 20:00 hiveserver2.log-.7.log.gz -rw-r--r-- 1 hive hadoop 1174 Aug 15 20:06 hiveserver2.log-.6.log.gz -rw-r--r-- 1 hive hadoop 1016 Aug 15 20:07 hivemetastore.log-.5.log.gz -rw-r--r-- 1 hive hadoop 1156 Aug 15 20:12 hiveserver2.log-.5.log.gz -rw-r--r-- 1 hive hadoop 1019 Aug 15 20:13 hivemetastore.log-.4.log.gz -rw-r--r-- 1 hive hadoop 1159 Aug 15 20:18 hiveserver2.log-.4.log.gz -rw-r--r-- 1 hive hadoop 1028 Aug 15 20:22 hivemetastore.log-.3.log.gz -rw-r--r-- 1 hive hadoop 1171 Aug 15 20:24 hiveserver2.log-.3.log.gz -rw-r--r-- 1 hive hadoop 1167 Aug 15 20:30 hiveserver2.log-.2.log.gz -rw-r--r-- 1 hive hadoop 1017 Aug 15 20:31 hivemetastore.log-.2.log.gz -rw-r--r-- 1 hive hadoop 233 Aug 15 20:36 hiveserver2.log -rw-r--r-- 1 hive hadoop 1166 Aug 15 20:36 hiveserver2.log-.1.log.gz -rw-r--r-- 1 hive hadoop 1003 Aug 15 20:37 hivemetastore.log-.1.log.gz -rw-r--r-- 1 hive hadoop 1218 Aug 15 20:37 hivemetastore.log -rw-r--r-- 1 hive hadoop 4248 Aug 15 20:39 hivemetastore-report.json.tmp -rw-r--r-- 1 hive hadoop 4363 Aug 15 20:39 hiveserver2-report.json.tmp [root@master01 hive]# [root@master01 hive]# [root@master01 hive]# [root@master01 hive]# du -sh * 0 hive.err 4.0K hivemetastore.log 4.0K hivemetastore.log-.10.log.gz 4.0K hivemetastore.log-.1.log.gz 4.0K hivemetastore.log-.2.log.gz 4.0K hivemetastore.log-.3.log.gz 4.0K hivemetastore.log-.4.log.gz 4.0K hivemetastore.log-.5.log.gz 4.0K hivemetastore.log-.6.log.gz 4.0K hivemetastore.log-.7.log.gz 4.0K hivemetastore.log-.8.log.gz 4.0K hivemetastore.log-.9.log.gz 8.0K hivemetastore-report.json 8.0K hivemetastore-report.json.tmp 4.0K hive.out 0 hive-server2.err 4.0K hiveserver2.log 4.0K hiveserver2.log-.10.log.gz 4.0K hiveserver2.log-.1.log.gz 4.0K hiveserver2.log-.2.log.gz 4.0K hiveserver2.log-.3.log.gz 4.0K hiveserver2.log-.4.log.gz 4.0K hiveserver2.log-.5.log.gz 4.0K hiveserver2.log-.6.log.gz 4.0K hiveserver2.log-.7.log.gz 4.0K hiveserver2.log-.8.log.gz 4.0K hiveserver2.log-.9.log.gz 0 hive-server2.out 8.0K hiveserver2-report.json 8.0K hiveserver2-report.json.tmp ... View more

ok , let me try to set it on my ambari , I will update .... ... View more

second my ambari is based on linux machines cluster so what is the line: log4j.appender.DRFA.rollingPolicy=org.apache.log4j.rolling.FixedWindowRollingPolicy ... View more

do you mean that I need to replace my lines as log4j.appender.DRFA=org.apache.log4j.RollingFileAppender log4j.appender.DRFA.rollingPolicy.FileNamePattern=${hive.log.dir}/${hive.log.file}-.%i.log.zip log4j.appender.DRFA.MaxBackupIndex=10 log4j.appender.DRFA.MaxFileSize=1KB to log4j.appender.DRFA.layout=org.apache.log4j.PatternLayout log4j.appender.DRFA=org.apache.log4j.rolling.RollingFileAppender log4j.appender.DRFA.rollingPolicy=org.apache.log4j.rolling.FixedWindowRollingPolicy log4j.appender.DRFA.triggeringPolicy=org.apache.log4j.rolling.SizeBasedTriggeringPolicy log4j.appender.DRFA.rollingPolicy.ActiveFileName=${hive.log.dir}/${hive.log.file}.log log4j.appender.DRFA.rollingPolicy.FileNamePattern=${hive.log.dir}/${hive.log.file}-.%i.log.gz log4j.appender.DRFA.triggeringPolicy.MaxFileSize=10000 log4j.appender.DRFA.rollingPolicy.maxIndex=10 ? ... View more