Member since
10-01-2018
802
Posts
144
Kudos Received
130
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3552 | 04-15-2022 09:39 AM | |
| 2870 | 03-16-2022 06:22 AM | |
| 7506 | 03-02-2022 09:44 PM | |
| 3457 | 03-02-2022 08:40 PM | |
| 2365 | 01-05-2022 07:01 AM |
01-12-2021
05:10 AM
@Mamun_Shaheed CDP doesn’t support Python 3 and higher for CDH services. Here is the Software Dependency Note for reference: Python - CDP Private Cloud Base, with the exceptions of Hue and Spark, is supported on the Python version that is included in the operating system by default, as well as higher versions, but is not compatible with Python 3.0 or higher. For example, CDP Private Cloud Base requires Python 2.7 or higher on RHEL 7 compatible operating systems. Spark 2 requires Python 2.7 or higher, and supports Python 3. If the right level of Python is not picked up by default, set the PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON environment variables to point to the correct Python executable before running the pyspark command. I am assuming you want to use Python 3 for CDSW etc. For that you can use custom engine with required Python version which is independent with CDH services. Some reference docs are below. https://docs.cloudera.com/documentation/data-science-workbench/1-8-x/topics/cdsw_extensible_engines.html In short you can use the distinct Python in hosts but just make sure Cloudera services are using only the supported Python version.
... View more
01-09-2021
08:14 PM
@mig_aguir Yes, I agree with you.
... View more
01-08-2021
07:46 AM
CM uses BitTorrent to distrubte parcels so it's already very efficient. My recommendation would be to let CM do the work and not bother with trying to save yourself a few minutes.
... View more
01-05-2021
11:50 PM
@GangWar thank you so much for your help I assigned myself as "Power User" and it worked like charm. However I'm bit surprised as my user is admin user still I had to assign a power user role.
... View more
01-03-2021
12:17 PM
@PauloNeves Yes, the command show databases will list all databases in a Hive instance whether you are authorized to access it or not. I am sure this is cluster devoid of Ranger or Sentry which are the 2 authorization tools in Cloudera!!! Once the ranger plugin is enabled then authorization is delegated to Ranger to provide fine-grained data access control in Hive, including row-level filtering and column-level masking. This is the recommended setting to make your database administration easier as it provides a centralized security administration, access control, and detailed auditing for user access within the Hadoop, Hive, HBase, and other components in the ecosystem. Unfortunately, I had already enabled the Ranger plugin for hive on my cluster but all the same, it confirms what I wrote above. Once the ranger plugin is enabled for a component ie. hive,HBase or Kafka then the authorization is managed exclusively through Ranger Database listing before Ranger Below is what happens if my user sheltong has not explicitly been given authorization through Ranger, see [screenshots] I see no database though I have over 8 databases See the output of the hive user who has explicit access to all the tables due to the default policy he could see the databases. Database listing after Ranger After creating a policy explicitly giving the user sheltong access to the 3 databases Policy granting explicit access to 3 databases Now when I re-run the show databases bingo! Back to your question show tables from forbidden_db, it returns an empty list, this can be true especially if the database is empty! has not table like the screenshot below though I have access to the database it's empty Now I create a table and re-run the select now I am able to see the table I hope this demonstrates the power of Ranger and explains maybe what you are encountering, I am also thinking if your cluster has Ranger hive plugin enabled you could have select on the databases but you will need explicit minimum select or the following permission on the underlying database tables to be able to see them. Happy Hadooping
... View more
12-30-2020
10:18 AM
@Navyarani_A Looks like we have already gave you the answers here: https://community.cloudera.com/t5/Support-Questions/Paywall-also-for-CDH-6-3-x-and-open-source-availability/m-p/308500#M223583
... View more
12-28-2020
05:56 AM
1 Kudo
@Navyarani_A See the similar discussion here: https://community.cloudera.com/t5/Support-Questions/Paywall-also-for-CDH-6-3-x-and-open-source-availability/m-p/306682/highlight/true#M222959
... View more
12-28-2020
05:13 AM
@syedshakir This is most probably ssh is not setup properly. You can try below steps. On the Oozie Server host run the command: ps -ef| grep oozie Identify the user that runs the Oozie server. For example, the user is oozie Modify /etc/passwd file to edit the user oozie Change: oozie:x:485:483:Oozie User:/var/lib/oozie:/bin/false to: oozie:x:485:483:Oozie User:/var/lib/oozie:/bin/bash Note: This will enable the user oozie to login. In the command prompt switch user as oozie: su - oozie Verify that the user is switched by executing the command: id Execute ssh-keygen: Note:Do not give any password. This generates Public and Private Key for passwordless authentication and saves it in the Oozie user's home directory. ssh-keygen Execute ssh-copy-id to copy the public key to user’s home directory in the remote host. This user will be the one that runs ssh commands in remote host: ssh-copy-id -i /home/oozie/.ssh/id_rsa.pub cloudera@example.local.com Test by executing ssh without a password to confirm a successful authentication: ssh cloudera@example.local.com Run the Oozie workflow and verify success.
... View more
12-20-2020
06:24 AM
@Mondi you can follow below doc for reference. All you have to do is modify the db.properties file and point to the server which is having CM DB installed. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_mysql.html#cmig_topic_5_5
... View more
12-16-2020
03:40 AM
@Prav_kumar Yes you can but since you are going to upgrade in Feb to 6.3.4 it's purely your decision to choose what is most feasible path. Just a tip make sure to read the release notes and known issue of the respective version you are Upgrading to make better decision.
... View more