Member since
07-11-2016
35
Posts
10
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2153 | 10-19-2018 09:22 AM | |
3264 | 10-07-2016 02:57 AM | |
1176 | 10-06-2016 07:34 PM | |
5481 | 10-01-2016 02:44 PM | |
2092 | 10-01-2016 12:20 PM |
11-30-2018
05:51 PM
Hello sbpothineni, Based on the limited log snippet, it appears you may need to increase the heap size for your NodeManager. You can increase the NodeManager's heap size by doing the following: 1. In CM UI, go to YARN -> Configuration -> NodeManager -> Java Heap Size of NodeManager in Bytes. 2. Change the value. 3. Save changes and redeploy configuration.
... View more
11-30-2018
10:41 AM
1 Kudo
Hello Saayak, The only impact in moving your MySQL instance to another server is that if you do not update your CM/CDH configuration to point to the new MySQL instance. After you stop your cluster, export and import the MySQL databases, you will need to make the following configration changes: 1. For Cloudera Manager: a. Go to /etc/cloudera-scm-server/ b. Backup the following file: - db.properties c. In the db.properties file, change the following attribute to point to your new MySQL host: - com.cloudera.cmf.db.host= 2. For Hive Metastore: a. In Cloudera Manager, go to Hive -> Configuration. b. Search for the following property: "Hive Metastore Database Host" c. Change the value for "Hive Metastore Database Host" to your new host's fully qualified domain name. d. Save changes. 3. For Oozie: a. In Cloudera Manager, go to Oozie -> Configuration. b. Search for the following property: "Oozie Server Database Host" c. Change the value for "Oozie Server Database Host" to your new host's fully qualified domain name d. Save changes. 4. Cloudera Navigator: a. In Cloudera Manager, go to Cloudera Management Service -> Configuration. b. Search for the following property: Navigator Audit Server Database Hostname c. Change the value for "Navigator Audit Server Database Hostname" to your new host's fully qualified domain name. d. Search for the following property: "Navigator Metadata Server Database Hostname" e. Change the value for "Navigator Metadata Server Database Hostname" to your new host's fully qualified domain name. f. Save changes. 5. For Sentry: a. In Cloudera Manager, go to Sentry -> Configuration. b. Search for the following property: "Sentry Server Database Host" c. Change the value for "Sentry Server Database Host" to your new host's fully qualified domain name d. Save changes. 6. For Hue: a. In Cloudera Manager, go to Hue -> Configuration. b. Search for the following property: "Hue Database Hostname" c. Change the value for "Hue Database Hostname" to your new host's fully qualified domain name d. Save changes.
... View more
10-23-2018
10:12 AM
Hello Hrishi, Since Cloudera Navigator cannot authenticate this specific user, the issue may lie with its inability to find the user in Active Directory. You should compare the location of the user in Active Directory with Navigator's External Authenication "LDAP User Search Base" property. The user's AD location may not be within the scope of the "LDAP User Search Base" property. If that is the case, you may need to widen the property's scope.
... View more
10-23-2018
10:01 AM
Hello Nukala, When configured correctly, lineage diagrams for Spark and Yarn should be visible under Navigator's Search Tab -> Source Type -> Spark -> (Select Yarn application number) -> (Select Lineage Tab). If you do not see the Spark Source Type, then check to see if Spark is configured to allow Navigator auditing by doing the following: 1. Go to Cloudera UI. 2. Select Spark Service -> Configuration -> Cloudera Navigator. 3. For the "Enable Lineage Collection" property, select the checkbox to enable the property.
... View more
10-23-2018
09:35 AM
Hello Jwood, The audit sources for the Navigator audit data is as follows: OS File System: Each service has audit data in the OS file system, under the following path: /var/log/<service>/audit For example, the HDFS audit data would be located in the following path: /var/log/hadoop-hdfs/audit From there you would view the "hdfs-audit.log" file. MySQL: The audit data is propagated from the aforementioned audit files to Navigator Audit Server's underlying database. The data is located in the following tables: <SERVICENAME>_AUDIT_EVENTS For example, the can find the HBASE, HDFS, and HUE audit data in the following tables: - HBASE_AUDIT_EVENTS - HDFS_AUDIT_EVENTS - HUE_AUDIT_EVENTS
... View more
10-22-2018
11:53 AM
Hello Vitali1, The file count by directory can be accessed in Cloudera Navigator via the HDFS Analytics feature. To access HDFS Analytics, please do the following: 1. From the Cloudera Navigator main menu, go to Analytics -> HDFS. 2. On the HDFS Analytics page, select the "Size" chart. 3. After selecting the Size chart, under the HDFS Files, select the "By Directory" option/radio button. 4. The results will sort by "Directory" and "Number of Files" in decending order.
... View more
10-19-2018
09:22 AM
Hello Nukala, YARN (MapReduce 2 Included) is the recommended for usage. MapReduce is included in YARN for backward compatibility. The only configuration to access MapReduce is to change the "Alternatives Priority" property under YARN's configuration from 92 to 91. To change the Alternatives Priority property , do the following: 1. Go to the MapReduce or YARN service. 2. Click the Configuration tab. 3. Select Scope > Gateway Default Group. 4. Select Category > All. 5. Type Alternatives in Search box. 6. In the Alternatives Priority property, set the priority value. 7. Click Save Changes to commit the changes. 8. Redeploy the client configuration. The link to the document covering changing of priorities is located here: Configuring Alternatives Priority for Services Dependent on MapReduce
... View more
10-07-2016
02:57 AM
The error states: "Either your MetaData is incorrect, or you need to enable "datanucleus.autoCreateTables"" You need to do one of two things: 1. Uninstall and reinstall Hive. or 2. On the Hive MetaStore server, add the following to the "/etc/hive/conf.cloudera.hive/hive-site.xml" file: <property>
<name>datanucleus.autoCreateTables</name>
<value>True</value>
</property> Restart the Hive service.
... View more
10-06-2016
07:34 PM
1 Kudo
Hello, The AD certificate goes in the JVM keystore on CM: 1. On the domain controller, export the certificate in the "Base-64 encoded X.509 (.CER) format. 2. Copy the file to the Cloudera Manager host using an SCP/SSH tool such as WinSCP. 3. Import the certificate into your JVM keystore: keytool -import -alias <alias-for-cert> -file <path-to-cert> -keystore <path-to-keystore> -storepass <keystore password> Note: The truststore is usually located at: $JAVA_HOME/jre/lib/security/cacerts.
... View more
10-06-2016
06:11 PM
Hello, cat db.properties file and note the database name and username: cat /etc/cloudera-scm-server/db.properties You psql command looks a bit odd. Use the information from the db.properites file to run the following command: psql -d <database-name> -U <username> -h localhost -p 7432 If you still get the same error, then you probably missed a step and should perform a reinstallation. If you still have issues after a reinstallation, I can give step-by-step instructions for an AWS install.
... View more
10-06-2016
03:06 PM
Hello, Can you tell me what OS (and its version) you are using in your attempt to deploy a CM cluster in AWS?
... View more
10-03-2016
09:12 AM
Hello, I have a couple of questions: 1. Have you checked the value of your datanode directory in Cloudera Manager (CM -> HDFS -> Configuration-> DataNode Data Directory)? It should state /dfs/dn. 2. Run the following command: sudo chown -R hdfs:hdfs /dfs/dn 3. If that does not fix the issue, delete /dfs/dn, and restart HDFS.
... View more
10-01-2016
07:11 PM
Hello, The version of Java you are attempting to install is unsupported in CM 5.8.x. http://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#pcm_jdk
... View more
10-01-2016
02:44 PM
4 Kudos
Hello, The hash and salt for CM versions 5.0.1 and above are the following: Password Hash: 9f7e3270b1aaa4931d38845a0334e66b2dd93f916439006fac4e5e2535a444b3 Password Salt: -5357030608435271136
... View more
10-01-2016
12:20 PM
Hello, Perform the following: 1. SSH to your instance of Cloudera Manager. 2. After the proper modifications, enter the following command: curl -X PUT -H "Content-Type:application/json" -u admin:admin -d '{ "items": [ { "name": "hbase_regionserver_msginterval", "value": "25" } ] }' 'http://localhost:7180/api/v10/clusters/Cluster%201/services/HBASE-1/roleConfigGroups/HBASE-1-REGIONSERVER-BASE/config' Proper modifications: - If your credentials are not "admin:admin," then replace "admin:admin" with the credentials you are using. - If your cluster name is not "Cluster 1," then change "Cluster%201" to the name of your cluster. If you don't know the name of your cluster, issue the following command: curl -u admin:admin 'http://localhost:7180/api/v10/clusters' - If your HBASE service name is not "HBASE-1," then change it to the name you are using. If you do not know the name of your HBASE service, issue the following command: curl -u admin:admin 'http://localhost:7180/api/v10/clusters/Cluster%201/services' | grep displayName - If your RoleConfigGroupName is not "HBASE-1-REGIONSERVER-BASE," then change it to the name you are using. If you do not know your RoleConfigGroupName, then enter the following command: curl -u admin:admin 'http://localhost:7180/api/v10/clusters/Cluster%201/services/HBASE-1/roleConfigGroups' | grep name 3. Go to the home page of Cloudera Manager. On the page, you should see a stale configuration icon next to the HBASE service. Click the icon to refresh the configuration.
... View more
09-07-2016
08:35 AM
Check the status of your underlying database service. Is it running? If it is running, try to restart the service.
... View more
09-07-2016
08:29 AM
1 Kudo
In the BIOS, possibly under CPU setting, enable virtualization: enable VT-x/AMD-V.
... View more
07-11-2016
07:25 PM
3 Kudos
@SriniD wrote: I am getting the same error "No Database Server Running on the Host". This solutions is not helped me because it does not mentioned any specific changes. Can you please post the steps to resolve this issue. 1. Open the /etc/cloudera-scm-server/db.properties file. 2. Change the com.cloudera.cmf.db.host value from localhost to the fully qualified domain name (FQDN) cited in the Database Setup page.
... View more