Member since
01-15-2019
274
Posts
23
Kudos Received
29
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
757 | 01-29-2024 03:30 AM | |
1124 | 02-21-2023 05:50 AM | |
893 | 01-17-2023 05:53 AM | |
828 | 12-29-2022 03:07 AM | |
3351 | 06-28-2022 08:16 AM |
09-21-2020
03:44 AM
1 Kudo
@Mondi Please refer below document, you can setup a local package repository for Cloudera Manager upgrade. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_create_local_package_repo.html#internal_package_repo For CDH upgrade you can follow below document https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/installation/topics/cdpdc-using-local-parcel-repository.html Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
08-12-2020
08:24 AM
@Mondi It is not compulsory to enable SSL but recommended to prevent the passage of plain text key material between the KMS and HDFS data nodes. You can continue to install Java Keystore KMS without adding SSL configurations. Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
08-11-2020
06:53 AM
@Mondi KMS service should be installed on your CDH cluster. Before installing KMS, you should have a dedicated cluster added using the Cloudera manager Add Cluster option which has the KTS service roles installed. If you are installing default Hadoop KMS Java Keystore KMS, the above can be ignored since the default Hadoop KMS included in CDH uses a file-based Java KeyStore (JKS) for its backing keystore. You can simply add the service from Cloudera Manager. Cloudera strongly recommends that you enable TLS for both the HDFS and the Key Trustee KMS services to prevent the passage of plain text key material between the KMS and HDFS data nodes. Refer below document https://docs.cloudera.com/documentation/enterprise/latest/topics/sg_hdfs_encryption_wizard.html#concept_fcq_phr_wt Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
08-10-2020
06:25 AM
@Mondi Cloudera provides two implementations of the Hadoop KMS. Refer below document for more details. https://docs.cloudera.com/documentation/enterprise/latest/topics/cdh_sg_kms.html You need to install Key Trustee KMS only when using KTS as backing keystore instead of the file-based Java KeyStore (JKS) used by the default Hadoop KMS. There should be a separate cluster for keytrustee server. This would be mentioned as one of the steps when you enable HDFS encryption via the wizard. Refer below document https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/sg_hdfs_encryption_wizard.html#concept_n2p_5vq_vt Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
08-07-2020
01:09 AM
@Mondi You do not need to install Cloudera Navigator for KMS and KTS. Refer : https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/encryption_prereqs.html#concept_g23_454_y5__section_n4w_b5v_ls Please refer below documents for encrypting data at rest requirement and installing KMS and KTS. You must install Key Trustee Server before installing and using Key Trustee KMS. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/encryption_planning.html#concept_c4m_knq_w5 https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/key_trustee_install.html#xd_583c10bfdbd326ba-590cb1d1-149e9ca9886--7b84 https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ig_install_keytrustee.html#xd_583c10bfdbd326ba-590cb1d1-149e9ca9886--7860 Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
08-04-2020
08:42 PM
1 Kudo
@ebeb It seems there is some issue with either your credentials or connectivity to the URL. Please confirm if you are using credentials generated from the license file. Refer below document for obtaining username and password for adding to the baseurl https://docs.cloudera.com/cdp/latest/release-guide/topics/cdpdc-cm-download-information.html Also, confirm the URL connectivity from your CM server host using curl command : #ping archive.cloudera.com # curl https://username:password@archive.cloudera.com/p/cm7/7.1.2/redhat6/yum Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
07-29-2020
10:50 PM
@Mondi Please refer below document which explains steps to configure jar for UDFs. You can configure the cluster in one of several ways to find the JAR containing your UDF code, and then you register the UDF in Hive. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_mc_hive_udf.html#xd_583c10bfdbd326ba--43d5fd93-1410993f8c2--7ea3 Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
07-24-2020
06:20 AM
@rmr1989 Ideally, for a missing mounts in the cluster you would automatically get alerts for services if any hadoop service directories cannot be accessed which are mapped to the mountpoint. They can be generic though like "no such file or directory" or "file not found" errors. If you are looking for specific mountpoint availability, you should consider using script to scan for mountpoints in the cluster hosts and can send email alerts using SMTP from the host instead of Cloudera Manager. Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
07-23-2020
04:09 AM
@rmr1989 You can edit the expression manually to include the NOT operator. Check the below example which uses NOT operator for a trigger. A trigger expression takes the form: IF (CONDITIONS) DO HEALTH_ACTION A condition is any valid tsquery statement with below syntax. SELECT [metric expression]WHERE [predicate] Mount point is an attribute which can be used in filter conditions but not metric expression. Hence, I believe it would not be possible to create a trigger on mount point scans. Refer below document which lists the supported metrics: https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_metrics.html#xd_583c10bfdbd326ba--7f25092b-13fba2465e5--7e52 Example: IF (SELECT total_xceivers_across_datanodes WHERE serviceName=$SERVICENAME AND last(total_xceivers_across_datanodes) != 0 AND entityName = "HDFS-1:ns1" AND category = "SERVICE") DO health:concerning Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more
07-23-2020
03:36 AM
@fransyk It is not compulsory to have both the roles on different hosts. Having said that, in production environments it is recommended to differentiate worker hosts and master hosts. Please refer below document for recommended role allocations for different cluster sizes: https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_host_allocations.html#concept_f43_j4y_dw Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
... View more