Member since
03-23-2015
1288
Posts
114
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3275 | 06-11-2020 02:45 PM | |
5010 | 05-01-2020 12:23 AM | |
2813 | 04-21-2020 03:38 PM | |
2611 | 04-14-2020 12:26 AM | |
2311 | 02-27-2020 05:51 PM |
01-02-2020
02:02 PM
Sorry, forgot to mention that you might need to stop YARN service first before step 2. Cheers Eric
... View more
01-02-2020
02:01 PM
@ssk26 , Can you please check the value of below settings? yarn.app.mapreduce.am.resource.mb yarn.app.mapreduce.am.resource.cpu-vcores Cheers Eric
... View more
01-02-2020
01:55 PM
1 Kudo
@backlashhardik , Please try below: 1. update HDFS path permissions to make sure: hdfs dfs -chmod 755 /user/yarn hdfs dfs -chmod 755 /user/yarn/mapreduce you might need to run as "hdfs" user 2. Then install the Yarn MapReduce Frame jar CM -> YARN -> Actions -> Install YARN MapReduce frame jar Please let me know if that helps. Cheers Eric
... View more
12-30-2019
03:31 PM
@Eediej, I believe that you are looking for this feature: https://issues.apache.org/jira/browse/IMPALA-2083 But it is still not resolved, so I guess not supported in Impala. Not sure if below can help you to implement in Hive, I haven't tried myself: https://community.cloudera.com/t5/Support-Questions/Hive-Transpose-the-set-of-rows/td-p/148685 If you end up get it working, please share result here so that other members can benefit. Cheers Eric
... View more
12-29-2019
08:49 PM
@Cl0ck Have you updated CM's DB configuration file under /etc/cloudera-scm-server/db.properties? You need to change the value for com.cloudera.cmf.db.host from taco.net to dev.taco.net, and see if that helps. Cheers Eric
... View more
12-29-2019
08:41 PM
@Cl0ck Each host's name is stored in CM's backend database with an UUID attached, please refer to table HOSTS. Example as below: HOST_ID: 12
OPTIMISTIC_LOCK_VERSION: 148
HOST_IDENTIFIER: bfaf4b71-01e2-4157-b46f-d1c13566b69a
NAME: host-xxx-xxx.xxx
IP_ADDRESS: xx.xx.xx.xx
RACK_ID: /default
STATUS: NA
CONFIG_CONTAINER_ID: 1
MAINTENANCE_COUNT: 0
DECOMMISSION_COUNT: 0
CLUSTER_ID: 1
NUM_CORES: 1
TOTAL_PHYS_MEM_BYTES: 1929342976
PUBLIC_NAME: NULL
PUBLIC_IP_ADDRESS: NULL
CLOUD_PROVIDER: NULL Where HOST_IDENTIFIER is the UUID, and is stored under /var/lib/cloudera-scm-agent/uuid on each host. Maybe you can try to update the table here for NAME field and see if that can help? Cheers Eric
... View more
12-18-2019
08:59 PM
@sagittarian , Thanks for sharing the finding and solution. Yes, the error message means that the JDBC driver JAR files were missing. So adding them can resolve the issue. Cheers Eric
... View more
12-18-2019
04:53 PM
@sagittarian , Can you please share the full stacktrace of the error? Both from HS2 log and yarn application logs? Thanks Eric
... View more
12-12-2019
01:28 PM
Hi @sahilk I worked on this last year, and it turned out at the time, it was not supported, as HS2 and HMS will generate the credentials themselves, please see my blog post using below link: Access S3 in Hive Through hadoop.security.credential.provider.path However, it was based on CDH, looks like you are on HDP, so stories might be different, but might need other Hive guys' input here. Cheers Eric
... View more
12-11-2019
11:37 PM
@kvinod CM 5.8.x is very old, is there any reason that you do not want to upgrade? As @lwang mentioned, higher version of CM supported downgrade back to Express version, so I guess the option is for you to upgrade first. But personally I don't see any issues if you don't want to do anything. After expiry, the only difference would be that Enterprise features won't be available, but cluster should still function. Unless Li can provide more insights. Cheers Eric
... View more