Cloudera Community
rki_
user rank
user rank
Super Collaborator

Re: Are there any effects of Spark2 by CVE-2022-33...

by Super Collaborator Super Collaborator in Support Questions
‎08-07-2022 11:38 PM
‎08-07-2022 11:38 PM
Hi @JiHoone    Spark security vulnerability CVE-2022-33891 affects Spark 2 and Spark 3 versions but not 3.1.3, 3.0.4, 3.3.0, 3.2.2 versions". The CVE is only affected if you have enabled ACLs on the SHS UI. By default, ACLs are disabled. If ACLs are enabled, then specified users and groups have access, and group membership is checked using ShellBasedGroupsMappingProvider (which is the class with the vulnerability).   Cluster is affected by the CVE only when the GroupMappingServiceProvider is called - which means when spark.history.ui.acls.enable or spark.acls.enable is enabled. ... View more

Re: Hbase export_snapshot between different major ...

by Super Collaborator Super Collaborator in Support Questions
‎08-03-2022 12:02 AM
‎08-03-2022 12:02 AM
Hi @Krisssh    1. '/hbase' is a hbase.root directory 2. The steps should work for HDP3 to CDP, I haven't checked for HDP2 to CDP. There are few known issues when migrating phoenix tables from HDP2 to CDP and it should follow a path HDP2=> HDP3 => CDP. For Hbase tables, as per this it has worked.   -- Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Re: Hbase export_snapshot between different major ...

by Super Collaborator Super Collaborator in Support Questions
‎08-02-2022 03:46 AM
1 Kudo
‎08-02-2022 03:46 AM
1 Kudo
Hello @Krisssh , I don't think there should be any challenge exporting the snapshot from CDH5 to CDH6 just like we export it to CDP. So I believe the solution here is not very accurate when it comes to exporting snapshot between major versions.  0) Cluster versions $ hbase version HBase 1.2.0-cdh5.17.0-SNAPSHOT $ hbase version HBase 2.1.0-cdh6.3.2 0.1) Make sure there's no inconsistencies reported for the target table 1) Take a snapshot in C5 hbase> count 'cluster_test' 100000 row(s) in 16.2700 seconds hbase> snapshot 'cluster_test', 'cluster_test-ss1' 2) Run the ExportSnapshot tool in C5 $ hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot cluster_test-ss1 -copy-to hdfs://host-10-17-xx.xx:8020/hbase 3) Clone the snapshot in C6 hbase> list_snapshots <=== returns available snapshots hbase> clone_snapshot 'cluster_test-ss1','cluster_test-new' 4) Confirm the data in C6 hbase> count 'cluster_test-new' 100000 row(s) 5) Run major compaction against the cloned table in C6H     ... View more

Re: Hbase export_snapshot between different major ...

by Super Collaborator Super Collaborator in Support Questions
‎08-01-2022 11:35 PM
1 Kudo
‎08-01-2022 11:35 PM
1 Kudo
Hello @Krisssh    Yes, You can perform an export_snapshot from  CDH 5 to CDP 7. In CDH5, the default Hfiles version is 2 and in CDP, it's 3. So the snapshotted files will remain in version 2 in CDP and when the tables are restored from the snapshot, the snapshot will gradually have the snapshot files rewritten into Version 3 files, as the new data is ingested and compactions will rewrite data originally in the snapshot Version 2 file into the new Version 3 files for the table. ... View more

Re: Connection between nodes

by Super Collaborator Super Collaborator in Support Questions
‎08-01-2022 11:11 PM
‎08-01-2022 11:11 PM
Hi @Big-dAta  A simple test would be a ping test from the source node to the target node. #ping <ip-address-of-target-node> You can also use Telnet to check if the other node is listening on a specific port. # telnet <ip-address-of-target-node> <port> ... View more

Re: Hbase erros

by Super Collaborator Super Collaborator in Support Questions
‎07-28-2022 10:27 AM
‎07-28-2022 10:27 AM
Hi @Jasthi ,   These are alerts coming from the CM. For more details on those, you can click on specific alerts which can give more clarity as to why the alert is seen.   For more details, you can refer the below doc : https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ht_regionserver.html ... View more

Re: add hosts for old version

by Super Collaborator Super Collaborator in Support Questions
‎07-28-2022 06:00 AM
‎07-28-2022 06:00 AM
Hi,   If this is not working from any of the hosts, I believe you need to try the below URLs for 3.1.0   https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/hdp_31_repositories.html   Just please bear in mind that the repositories are now behind a paywall, for which you'll have to provide credentials. https://www.cloudera.com/downloads/paywall-expansion.html ... View more

Re: add hosts for old version

by Super Collaborator Super Collaborator in Support Questions
‎07-28-2022 04:03 AM
‎07-28-2022 04:03 AM
Hi, can you check in the Ambari server log and see what error are you getting there. ... View more

Re: add hosts for old version

by Super Collaborator Super Collaborator in Support Questions
‎07-28-2022 01:18 AM
‎07-28-2022 01:18 AM
Hi, Can you check if you have the same repo file on the new host which in there in the old hosts. Check if you are able to install the package from commandline.   # yum clean all # yum repolist # yum install -y hive-3-1-0-0-78   ... View more

Re: CVE-2021-33036

by Super Collaborator Super Collaborator in Support Questions
‎07-26-2022 02:57 AM
‎07-26-2022 02:57 AM
Hi @jeromedruais ,   This CVE will be addressed in CDP 7.1.8. Till then, you can use the below precautions:   1. ensure in the linux sudoers files that there is no entry allowing users or groups to run as the yarn account. 2. ensure the cluster is kerberized 3. ensure the permissions for the yarn keytabs are not readable by others. find /var/run/cloudera-scm-agent/ | grep yarn | grep keytab (by default in kerberized cdp, others can't read these service keytabs) ... View more
Contact Me
Online
Online
Last Visited
‎11-09-2024 07:28 AM
Community Statistics
Member Since ‎07-30-2020 02:04 AM
Last Visited ‎11-09-2024 07:28 AM
Posts 216
Kudos received 39