This video describes a way to hide the plain text passwords in Knox topology. The passwords are basically the Bind User passwords when used in ShiroProvider and LDAP/AD authentication.   ... View more

The kubectl tool provides direct administrative access to the Kubernetes cluster underlying a CDE service, which is useful for troubleshooting, among other things. This video will demonstrate how to set up kubectl access. To enable kubectl, we will need a couple of prerequisites. We will need the kubeconfig file from the CDE service. We will need to get and authorize the IAM user, and then we will need to make sure that everything is set up correctly, both for kubectl and some other tools like k9s.   There are a couple of prerequisites for this operation, and we are not going to cover their installation in this video. You will need to follow the process relevant to your platform of choice to get the AWS CLI installed and configured with an IAM user. You will also need to get kubectl installed.   Key steps: Download the kubeconfig file from the CDE service Retrieve the ARN for the chosen IAM user Grant administrative access for the IAM user Verify kubectl access is successfully authorized (Optional) Use the kubeconfig file with other tools, such as k9s You need to download and install aws-iam-authenticator separately. Check this install guide.  ... View more

Hello everyone, I have such a problem, a small task that runs for about two minutes, after loading in yarn hung for 40 minutes, there was no load on the cluster, the restart was without problems and the task was completed in 2 minutes, someone faced such a problem and how to fix it? I can provide logs if necessary.   Originally posted by @Infectus as a community article. Re-posting it on the Support Questions board for Community members to answer. ... View more

This video provides instructions on how to SSH keys in CDP Public Cloud data hub clusters. It touches on how to generate a new SSH key pair and steps through the process of deploying it for a workload user through the Cloudera Management Console Web UI, as well as using the CDP command-line tool. It discusses the security implications of using the Cloudbreak user for login purposes on data hub hosts and explains why workload user credentials should be used instead in most cases. It also demonstrates using the deployed SSH keys for login to data hub hosts. ... View more

In this video, we'll briefly discuss what is Hive locking mechanism, what are the type of locks and how they work. We will also demonstrate with the help of a query about validation on the locks and removal of obsolete Hive locks from backend. Query used: CREATE TABLE ABORTED_TXNS AS SELECT A.TXN_ID AS HL_TXNID FROM TXNS A , HIVE_LOCKS B WHERE A.TXN_ID=B.HL_TXNID AND A.TXN_STATE='a'; DELETE FROM HIVE_LOCKS WHERE HL_TXNID IN (SELECT HL_TXNID FROM ABORTED_TXNS); Reference Link: https://cwiki.apache.org/confluence/display/Hive/Locking     Open YouTube video here ... View more