Member since
10-07-2018
16
Posts
0
Kudos Received
0
Solutions
11-05-2020
12:09 AM
Hi All, I am Venkatram, working as a Java developer for about 16 years. Recently I started working on Kafka and Spark. This is about me. I am interested to learn distributed computing. thanks Venkatram
... View more
05-16-2019
10:47 PM
I checked the failed job log and found that there was one such item, java.lang.NoSuchField Error: HBASE_CLIENT_PREFETCH. Then I look at the classpath of the failed job, find different versions of the jar package of HBase in hive. aux. jars. path, delete the jar package here, restart hiveserver2, and everything returns to normal.
... View more
03-27-2019
04:24 AM
Hello @zbz, It is nice to hear that. A side node: CM version 5.7.6 is a stable release for CM 5.7. If you don't plan to upgrade to next major release then you may want to consider to upgrade to CM 5.7.6 version atleast. Have a good day.
... View more
03-05-2019
07:03 PM
1 Kudo
This may then be explained by open HDFS writer files perhaps, as those would've closed during a restart. Next time this occurs, try checking the count of open files via fsck '-openforwrite'? What is your configured block size for HDFS files. There were a few issues in past such as https://issues.apache.org/jira/browse/HDFS-8072 (5.5+) and https://issues.apache.org/jira/browse/HDFS-9038 (5.10+) that may be relevant to the issue observed here and an upgrade can help address these.
... View more
01-23-2019
06:01 PM
Hi ,when you look at the error ' Caused by: java.io.IOException: Cannot obtain block length for LocatedBlock{BP-19720802xxxxxxxxxx-xxxx-xxxx1:blk_1326223979_253064188 ' run those cmd : 1. hdfs fsck -blockId blk_1326223979 then you will see one file path that bock belong. 2. hdfs debug recoverLease -path theFilePath retries 3 and all is ok.
... View more
12-10-2018
09:23 AM
One easy option in old CDH versions is just to change the shebang at the beginning of the script to: #!/usr/bin/env python2 Actually this will be more precise than the default, because the script is actually a python 2 script and ... python 3 is coming ... so it is good to be specific about the given version of the interpreter the script needs. We could be even more explicit and require python2.7.
... View more
11-21-2018
12:54 AM
Hi @zbz, Good!! Thanks for the informatons tips. Regards, Manu.
... View more
10-22-2018
06:43 PM
Thank you so munch! I change the group of '/tmp/logs' to hadoop , and restart the JobHistoryServer role, everything being OK. So happy !
... View more
10-08-2018
08:56 AM
@JoaoBarreto, It is possible to do so, but it is not something we document or test exactly. The closest steps would be only doing the Cloudera Manager steps here: https://www.cloudera.com/documentation/enterprise/5-15-x/topics/install_singleuser_reqts.html#concept_ivr_lng_2v Since the agent runs as "root" by default, you shouldn't need to do any of the agent-specific steps there. Also, the Management Service "System User" and "System Group" are "cloudera-scm" by default. You may need to do a little trial and error to get everything working, but I don't think it would be too bad.
... View more