Member since
01-04-2015
10
Posts
1
Kudos Received
0
Solutions
01-29-2015
05:15 PM
hi, we have a hdfs cluster that have 7 datanodes at first, every datanode have 2TB disk. lately we add datanode to 20, those new datanodes have 500GB disk. and then the hdfs cluster had already been balanced. now the problem is disk used percentage is always not symmetric when the cluster works a period of time, those 2TB datanodes disk used percentage are about 50%, but the 500GB datanodes disk used percentage are about 90% , which made disk used percentage warning occurs. we have to balance the cluster manually. how do I configure the cluster so as to it keep balance automatic? any help would be appreciated.
... View more
Labels:
- Labels:
-
HDFS
01-13-2015
08:32 PM
what I found just now proves your point, thank you very much.
... View more
01-13-2015
07:31 PM
1 Kudo
hi, In one of our CDH cluster (v5.0.0-beta1), zookeeper max connections are set to 60. Now I found zookeeper logs out too many connections from Cloudera Manager. view the connections by four-letter command 'cons', output show as follows: /192.168.56.80:36983[1](queued=0,recved=23475,sent=23475,sid=0x24ab7bb4e4d3abc,lop=PING,est=1420970377026,to=30000,lcxid=0x3d,lzxid=0x1d0002f281,lresp=1421204775170,llat=0,minlat=0,avglat=0,maxlat=17) /192.168.56.80:35647[1](queued=0,recved=39836,sent=39836,sid=0x24ab7bb4e4d2724,lop=PING,est=1420806577434,to=30000,lcxid=0x3d,lzxid=0x1d0002f281,lresp=1421204770544,llat=0,minlat=0,avglat=0,maxlat=320) /192.168.56.80:37019[1](queued=0,recved=14665,sent=14665,sid=0x24ab7bb4e4d457e,lop=PING,est=1421058577925,to=30000,lcxid=0x3d,lzxid=0x1d0002f281,lresp=1421204775172,llat=0,minlat=0,avglat=0,maxlat=39) ...... view Cloudera Manager log, error information below occurs many times. 2015-01-12 11:50:32,445 ERROR [Parcel Update Service:components.ParcelDownloaderImpl@371] (3 skipped) Failed to download manifest. Status code: 404 URI: http://archive.cloudera.com/cdh5/parcels/latest/manifest.json I wonder what conditions would cause Cloudera Manager to create massive connections to zookeeper. and how do I solve it? thanks in advance.
... View more
Labels:
01-07-2015
12:45 AM
It works. Thank you so much.
... View more
01-06-2015
12:13 AM
Great issue. I still hope Cloudera Manager can take over a cluster that managed by other Cloudera Manager. That is different Problem but same Request.
... View more
01-05-2015
02:29 AM
hi, According to the guide, I had already set both Cloudera Manager and chrome language as English, but the web UI still displays as Chinese. btw: The OS is Windows 7 (Chinese Simplified). I want to the whole UI display as English, how do I get it? any help would be appreciated, thanks.
... View more
Labels:
- Labels:
-
Cloudera Manager
01-04-2015
03:49 AM
http://archive.cloudera.com/cm5/installer/5.2.1 http://archive.cloudera.com/cm5/installer/5.3.0 I download cm5 (v5.2.1 & v5.3.0) from above url, however, I found the version is still v5.2.0 when I installed it.
... View more
01-04-2015
12:53 AM
CDH 5.3.0, unable to add Spark service, the webui display 'SparkUploadJarServiceCommand failed'. check log file, found error as follows, [Cannot find the assembly on local filesystem: /opt/cloudera/parcels/CDH-5.3.0-1.cdh5.3.0.p0.30/lib/spark/assembly/lib/spark-assembly*cdh*.jar] To view the local filesystem, the Jar file does not exists indeed. CDH5.2.x has no this problem cause the Jar file exists.
... View more
Labels: