Hello,   We have a 12 node cluster with 4 data drives in them each. We added 1 additional disk to each data node but are having a hard time getting data to be placed on these additional drives. For example:   node01 -  /hdfs/01 - 1.4 TiB/1.8 TiB /hdfs/02 - 1.5 TiB/1.8 TiB /hdfs/03 - 1.5 TiB/1.8 TiB /hdfs/04 - 1.5 TiB/1.8 TiB /hdfs/05 - 18 GiB/1.8 TiB   node03 -  /hdfs/01 - 1.5 TiB/1.8 TiB /hdfs/02 - 1.5 TiB/1.8 TiB /hdfs/03 - 1.5 TiB/1.8 TiB /hdfs/04 - 1.5 TiB/1.8 TiB /hdfs/05 - 181.9 GiB/1.8 TiB   We've run the rebalancer for a few weeks now. Would it be easier to just wipe one data node at a time and introduce it back into the cluster?   Thanks, Eric ... View more

New version of Cloudera installed. Everytime I type Hive, I get the following log4j errors and conf.Hiveconf warnings. I've researched including these forums but can't seem to find an answer. Any ideas? Thanks.   [devnode01 ~]$ hive log4j:ERROR Could not find value for key log4j.appender.NullAppender log4j:ERROR Could not instantiate appender named "NullAppender". log4j:ERROR Could not find value for key log4j.appender.NullAppender log4j:ERROR Could not instantiate appender named "NullAppender". 15/01/08 08:34:53 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore. Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/jars/hive-common-0.13.1-cdh5.2.0.jar!/hive-log4j.properties ============================= Versions: [devnode01 ~]$ hive --version log4j:ERROR Could not find value for key log4j.appender.NullAppender log4j:ERROR Could not instantiate appender named "NullAppender". log4j:ERROR Could not find value for key log4j.appender.NullAppender log4j:ERROR Could not instantiate appender named "NullAppender". Hive 0.13.1-cdh5.2.0 Subversion file:///data/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hive-0.13.1-cdh5.2.0 -r Unknown Compiled by jenkins on Sat Oct 11 15:39:25 PDT 2014 From source with checksum 70f3e1e917c1170d860323d777706e22   [devnode01 ~]$ hadoop version Hadoop 2.5.0-cdh5.2.0 Subversion http://github.com/cloudera/hadoop -r e1f20a08bde76a33b79df026d00a0c91b2298387 Compiled by jenkins on 2014-10-11T21:00Z Compiled with protoc 2.5.0 From source with checksum 309bccd135b199bdfdd6df5f3f4153d This command was run using /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/jars/hadoop-common-2.5.0-cdh5.2.0.jar ... View more

Hi there, I set up flume for the first time and per an example, put ~/.flume/file-channel/checkpoint for the checkpointDir parameter.   Well, it filled up the /var/run/cloudera-scm-agent/process tempfs.   [root@node08 process]# du -sh *flume* 3.8G 1004-flume-AGENT 3.8G 1009-flume-AGENT 3.8G 1021-flume-AGENT 4.9G 1022-flume-AGENT 3.8G 1031-flume-AGENT etc..   Question for you. I've since fixed this and what would be the easiest way to delete these files? Just delete them or will they be removed after a reboot of the node?   Thanks, Eric ... View more