Member since
01-19-2017
3676
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 609 | 06-04-2025 11:36 PM | |
| 1173 | 03-23-2025 05:23 AM | |
| 579 | 03-17-2025 10:18 AM | |
| 2182 | 03-05-2025 01:34 PM | |
| 1373 | 03-03-2025 01:09 PM |
10-10-2020
11:31 AM
@lxs I have helped resolve this kind of issue a couple of times. Can you help with screenshots of your configuration of the sandbox? Memory Network Splash screen After restarting the sandbox and any other screenshot you deem important
... View more
10-10-2020
11:26 AM
@vinod_artga The first step is to check the Cloudera upgrade path using the My environment matrix calculator See screenshot below After filling in all the information request this generates for you a report and warnings like Warning Upgrades from CDH 5.12 and lower to CDP Private Cloud Base are not supported. You must upgrade the cluster to CDH versions 5.13 - 5.16 before upgrading to CDP Private Cloud Base. Warning For upgrades from CDH 5 clusters with Sentry to Cloudera Runtime 7.1.1 (or higher) clusters where Sentry privileges are to be transitioned to Apache Ranger, the cluster must have Kerberos enabled before upgrading It also gives you comprehensive details about the best approach and component incompatibilities, this is your source of true I would suggest you try it and revert HTH
... View more
10-10-2020
10:50 AM
1 Kudo
@bvishal SmartSense Tool (HST) gives all support subscription customers access to a unique service that analyzes cluster diagnostic data, identifies potential issues, and recommends specific solutions and actions. These analytics proactively identify unseen issues and notify customers of potential problems before they occur. That is okay as you are just testing and you don't need to buy support which is advised when running a production environment To configure SmartSense you will need to configure the /etc/hst/conf/hst-server.ini the inputs/values you will get from Hortonworks support if you have paid for a subscription customer.smartsense.id
customer.account.name
customer.notification.email
customer.enable.flex.subscription The error you are encountering is normal and won't impact your cluster Hope that helps
... View more
10-08-2020
10:40 AM
@pazufst How Ranger policies work for HDFS Apache Ranger offers a federated authorization model for HDFS. Ranger plugin for HDFS checks for Ranger policies and if a policy exists, access is granted to user. If a policy doesn’t exist in Ranger, then Ranger would default to the native permissions model in HDFS (POSIX or HDFS ACL). This federated model is applicable for HDFS and Yarn service in Ranger. For other services such as Hive or HBase, Ranger operates as the sole authorizer which means only Ranger policies are in effect. The option for the fallback model is configured using a property in Ambari → Ranger → HDFS config → Advanced ranger-hdfs-security xasecure.add-hadoop-authorization=true The federated authorization model enables to safely implement Ranger in an existing cluster without affecting jobs that rely on POSIX permissions to enable this option as the default model for all deployments. org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=XXXXX, access=READ, inode="/user/.snapshot/user_201806150000":w93651:hdfs:drwx------ Is self-explanatory does the user w93651 exist on both clusters with valid Kerberos tickets if the cluster is kerberized? Ensure the CROSS-REALM is configured and working. Is your ranger managing the 2 clusters? HTH
... View more
10-07-2020
11:00 PM
From what I've investigated, it may be due to the version of the mysql-connector-java. The class com.mysql.jdbc.jdbc2.optional.MysqlDataSource is present in version 5 and the one that I have installed is the 8. I tried installing explicitly the version 5 but I got different errors. What I've done and got it working is changing that class to the one available in version 8, which is com.mysql.cj.jdbc.MysqlXADataSource. For Schema Registry you have to modify 2 files: /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.4.1.1-4/common-services/REGISTRY/0.3.0/package/scripts/params.py /var/lib/ambari-agent/cache/common-services/REGISTRY/0.3.0/package/scripts/params.py There change the variable registry_storage_java_class to the value com.mysql.cj.jdbc.MysqlXADataSource Note: the variable should appear twice. The same for Streaming Analytics, you have to modify 2 files. This time: /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.4.1.1-4/common-services/STREAMLINE/0.5.0/package/scripts/params.py /var/lib/ambari-agent/cache/common-services/STREAMLINE/0.5.0/package/scripts/params.py There change the variable streamline_storage_java_class also to the value com.mysql.cj.jdbc.MysqlXADataSource You should then be able to start the services. I just solved this, so I'm not aware if any other errors will show up by using these services.
... View more
09-30-2020
11:50 AM
Can you please help here. When I give "-protocol https", getting below error Connecting to https://HOST:PORT/logLevel?log=BlockStateChange Exception in thread "main" java.io.IOException: Server returned HTTP response code: 403 for URL: https://HOST:PORT/logLevel?log=BlockStateChange at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1894) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:263) at org.apache.hadoop.log.LogLevel$CLI.process(LogLevel.java:297) at org.apache.hadoop.log.LogLevel$CLI.doGetLevel(LogLevel.java:234) at org.apache.hadoop.log.LogLevel$CLI.sendLogLevelRequest(LogLevel.java:127) at org.apache.hadoop.log.LogLevel$CLI.run(LogLevel.java:110) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90) at org.apache.hadoop.log.LogLevel.main(LogLevel.java:72)
... View more
09-27-2020
10:55 PM
Thanks for your reply. I have already tried but still getting the same error.
... View more
09-11-2020
04:22 PM
@wert_1311 Domain name changes will affect the KDC database. Kerberos is super sensitive to domain changes according to experience you will have to recreate the KDC database and regenerate the keytabs/principals to enable you applications to reconnect. Cluster hostname If the hosts in the cluster were re-named ie host1.old.com to host1.new.com then ensure those changes are also reflected or resolved by the DNS. This is going a tricky one but fortunately, CM or Ambari will make your work easy now that your domain has changed the earlier generated keytabs have the old domain name . A keytab contains a pair of principals and an encrypted copy of that principal's key it's unique to each host since the principal names include the hostname and may be concatenated with the domain name Delete the old KDC database Usually, as the root user call the Kerberos database utility kdb5_util destroy assuming the old domain was OLD.COM this should delete the keytabs and principals linked to the old REALM, # kdb5_util -r OLD.COM destroy You will need to manually delete the keytabs liked to the old REALM on the file system /etc/security/keytabs/ [HDP] or /etc/hadoop/conf/[CDH]. You will be prompted to confirm before destroying the database, usually, this is a better option if you have second thought rather than using the kdb5_util destroy -f will naturally not prompt you for a confirmation Recreate the New KDC database Use the Kerberos database utility kdb5_util create [-s] assuming the new domain was NEW.COM # kdb5_util NEW.COM create
# kdb5_util -r NEW.COM create -s With the -s option, kdb5_util will stash a copy of the master key in a stash file this allows a KDC to authenticate itself to the database utilities, such as kadmin, kadmind, krb5kdc, and kdb5_util best option. Update Kerberos files. Make sure you update the below files to reflect the new REALM assuming your MIT KDC server's domain isn't changed. krb5.conf
kdc.conf
kadm5.acl
Auth-to-local Rules
jaas.conf files [if being used by applications] Enable Kerberos Using CM or Ambari the process is straight forward. Please let me know if you need more help
... View more
09-10-2020
08:28 PM
It's best to run: ambar-server setup-security and use Option1 to update https certificates. It will ask for crt and key files, and automatically updates relevant files behind the scene. The solution mentioned above doesn't work for me. After security setup, restart ambari server: ambari-server restart
... View more
08-28-2020
12:06 PM
@mahfooz The property value can be modified only in hive-site.xml cluster configuration file. This will oblige you to restart the stale hive configuration and becomes a cluster-wide change rather than a runtime change. HTH
... View more