Member since
03-23-2015
1288
Posts
114
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3295 | 06-11-2020 02:45 PM | |
5012 | 05-01-2020 12:23 AM | |
2815 | 04-21-2020 03:38 PM | |
2619 | 04-14-2020 12:26 AM | |
2315 | 02-27-2020 05:51 PM |
11-20-2019
05:27 PM
1 Kudo
@wert_1311, Yes, @bgooley is right, it is 3-4 times of fsimage, documentation here: https://docs.cloudera.com/documentation/enterprise/release-notes/topics/hardware_requirements_guide.html#sizing_cm_rman What's the current heap setting for RM? Cheers Eric
... View more
11-14-2019
04:10 PM
@Timothyw0 , No, you can't update or delete in DF. You have to use filter/transform DF and create a new DF. Cheers Eric
... View more
11-14-2019
04:01 PM
@deekshant , Please also check in the JournalNode log to see if there is any messages related at the time. Cheers Eric
... View more
11-12-2019
10:48 PM
1 Kudo
Hi @ckk, I believe that we started supporting Sqoop import into S3A since CDH6.1 https://docs.cloudera.com/documentation/enterprise/6/6.1/topics/admin_sqoop_s3_import.html and you need to use "--target-dir". Can you share the full Sqoop command you used when using "--target-dir"? Can you also attach "--verbose" output file for review? Thanks Eric
... View more
11-06-2019
09:35 PM
1 Kudo
@Kevin_Z Try this one: https://archive.cloudera.com/cm6/6.0.0/generic/jar/cm_api/apidocs/resource_AllHostsResource.html And the config name is "host_agent_log_directory_free_space_absolute_thresholds", set the value and update it via PUT. Sample payload like below: "items" : [ { "name" : "host_agent_log_directory_free_space_absolute_thresholds", "value" : "{\"warning\":3221225472,\"critical\":1073741824}", "sensitive" : false }] Hope this can help. Cheers Eric
... View more
10-31-2019
09:25 PM
Hi @DataMike, Yes, once CM is down, you can't update the configuration unless you "hack" into CM's backend database, which is also down in our scenario. So if you setup MySQL in such a way that CM will connect to LB / VIP host, which will route to the MySQL host that you want to, so in the event of one MySQL instance is down, simply update LB to only go to the working one. This avoids the needs to update the CM config. Hope that can help. Cheers Eric
... View more
10-31-2019
03:15 PM
OK, can you log into your cluster host that runs Oozie sharelib installation that failed, change to directory /opt/cloudera/parcels/CDH and run: find . -name *redactor* What will you get?
... View more
10-31-2019
03:13 PM
1 Kudo
@DataMike, If MySQL is out of service, all roles that need to use MySQL will stop to function, this includes roles like CM itself, Hive, Sentry, Oozie, Hue etc. HDFS and YARN should still function. You should have Database HA setup, as mentioned here: https://docs.cloudera.com/documentation/enterprise/latest/topics/admin_cm_ha_dbms.html So if MySQL master is down, at least the read from Slave can still function, while you fix the master. Or have the MySQL backup and replicated to another MySQL instance that is ready to take over should the current one fail. Cheers Eric
... View more
10-31-2019
03:02 PM
@wert_1311 , Can you confirm what's the location of the log that is filled up? Can you go to CM to confirm if it is really the container log directory?
... View more
10-31-2019
02:59 PM
@nmarcell, Do you get ClassNotFoundException error or "No log4j2 configuration file found"?
... View more