Member since
08-03-2018
23
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3653 | 05-02-2019 05:18 AM |
02-16-2022
07:46 PM
Hi All, I want to append cluster name in the 'Cloudera Alert mail subject'. I am not getting any configuration for same. Please suggest how to do that. Current Subject: [Cloudera Alert] 4 Alerts since 2:31:41 AM Want to change as below (assuming cluster name as ABC): [Cloudera Alert - ABC ] 4 Alerts since 2:31:41 AM Regards, Banshi.
... View more
Labels:
- Labels:
-
Cloudera Manager
11-05-2020
10:32 AM
Hi Team, Thank you very much for promptly responding and providing useful solution/direction. While testing, app team reported that child dir/files are having r-x (for dir) and r--(files) for Others. Looks like ACL are not getting inherited to child dir and files. Can you confirm if ACL should inherit to child dir and files or not? Is there any other configuration that I need to check and modify? Regards, Banshi.
... View more
11-04-2020
11:02 PM
Hi @Shelton, Thank you very much for sharing the exact commands. Only thing that needs to change in the shared commands is - others should be other Here is the command that worked for me. $ hdfs dfs -setfacl -m other::--- /path/to/dir Regards, Banshi.
... View more
11-04-2020
08:30 AM
Hi @tusharkathpal , Thank you very much. I tested it. It worked for ownership. I want 750 permission on the directory recursively. However it's not reflecting in case of new file. Is there a way to do that? Idea is to restrict 'others' from accessing the file/dir. Regards, Banshi.
... View more
11-04-2020
04:50 AM
Hi All,
In our CDP 7.1.2 cluster, default ownership of any file or directory is <user>and supergroup.
One application team wants their data owner group to be their own group in stead of supergroup.
for example:
Let the app team user is 'abc' and group is 'abc'.
Currently owner and group for any file/dir in HDFS is abc:supergroup.
They want it to be abc:abc.
Please suggest how to achieve this so that any new file created by abc user will have ownership as abc:abc.
Regards,
Banshi.
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
-
HDFS
09-07-2020
06:17 AM
Hi @GangWar, As per CDH package information, Impala 3.2 comes with CDH 6.3.x. Not with CDH 5. Refer below details. ====== CDH 5.x comes with Impala 2.x. https://docs.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_515.html#cm_vd_cdh_package_tarball_515 CDH 6.3.x comes with Impala 3.2. https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_63_packaging.html#concept_rtm_b5p_m3b ====== Can you elaborate how to upgrade impala from 2.11 to 3.2 in CDH 5.14. Regards, Banshi.
... View more
09-07-2020
03:51 AM
Hi All,
Good Afternoon.
We have CDH 5.14 and Impala 2.11 in one of our Cloudera cluster.
We have a requirement to upgrade Impala to 3.2 in the same cluster.
Please suggest us the best way to achieve this.
Can we just upgrade Impala without upgrading CDH.
Regards,
Banshi.
... View more
Labels:
06-22-2020
10:53 AM
Here is the error snapshot.
... View more
06-22-2020
10:46 AM
Hi Team, We have a Cloudera Cluster with OEL6 nodes. Recently we have plan to add 10 OEL7 data nodes to cluster. We installed ClouderaManagerAgent in them using OEL7 repo URL and hosts are listing in ClouderaManager now. While adding them to the cluster, we are getting below error while parcel distribution. Attached error snapshot. "Parcel not available for os distribution RHEL7" Here is the content of " Local Parcel Repository Path " in Cloudera manager server node. ==== root# ls -lrth /ngs/app/cloudera-scm/parcel-repo total 1.8G -rwxr-xr-x 1 cloudera-scm cloudera-scm 73K Sep 6 2018 manifest.json -rwxr-xr-x 1 cloudera-scm cloudera-scm 41 Sep 6 2018 CDH-5.14.4-1.cdh5.14.4.p0.3-el6.parcel.sha -rwxr-xr-x 1 cloudera-scm cloudera-scm 1.8G Sep 6 2018 CDH-5.14.4-1.cdh5.14.4.p0.3-el6.parcel -rw-r----- 1 cloudera-scm cloudera-scm 70K Sep 6 2018 CDH-5.14.4-1.cdh5.14.4.p0.3-el6.parcel.torrent drwxr-x--- 3 root root 4.0K Oct 12 2018 keytrustee-server-6.0.0-parcels -rw-r----- 1 cloudera-scm cloudera-scm 26M Oct 12 2018 KEYTRUSTEE_SERVER-6.0.0-1.keytrustee6.0.0.p0.541004-el6.parcel -rw-r----- 1 cloudera-scm cloudera-scm 41 Oct 12 2018 KEYTRUSTEE_SERVER-6.0.0-1.keytrustee6.0.0.p0.541004-el6.parcel.sha -rw-r----- 1 cloudera-scm cloudera-scm 1.2K Oct 12 2018 KEYTRUSTEE_SERVER-6.0.0-1.keytrustee6.0.0.p0.541004-el6.parcel.torrent root# ==== Can we add OEL7 *.parcel, *.parcel.sha, *.parcel.torrent files in the same " Local Parcel Repository Path "? Please share detailed steps to fix this error. Regards, Banshi.
... View more
- Tags:
- CM
Labels:
- Labels:
-
Cloudera Manager
04-19-2020
11:47 PM
Hi Everyone, Can someone give some update or pointer on this. Regards, Banshi.
... View more
- Tags:
- e
04-17-2020
11:29 AM
Hi Team,
Can we enable both Kerberos and LDAP authentication for HiveServer2 at the same time?
Secondly, can you share a sample workflow.xml and job.properties for an Oozie job that has a HiveServer2 action where LDAP authentication is enabled for Hiveserver2.
Regards,
Banshi.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Oozie
-
Kerberos
-
Security
05-02-2019
05:18 AM
Hi @bgooley , Thank you for your suggestion. We set the same property and it fixed the issue. Cloudera Manager --> YARN --> searched for: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hadoop-env.sh and added this: HADOOP_CLIENT_OPTS="-Djava.io.tmpdir=/ngs/app/$(whoami)/hadoop/tmp" Regards, Banshi.
... View more
04-30-2019
05:02 AM
Hi Team, We are facing an issue where mapreduce jobs are failing with below error. Distribution: Cloudera (CDH 5.14.4) ==== Exception in thread "main" java.io.FileNotFoundException: /tmp/hadoop-unjar5272208588996002870/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore$AsyncClient$revoke_privileges_call.class (No space left on device) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:162) at org.apache.hadoop.util.RunJar.unJar(RunJar.java:110) at org.apache.hadoop.util.RunJar.unJar(RunJar.java:81) at org.apache.hadoop.util.RunJar.run(RunJar.java:214) at org.apache.hadoop.util.RunJar.main(RunJar.java:141) ==== We figured out that MR framework tries to keep temporary class files under /tmp dir with a folder named hadoop-unjarxxxxxx. As there is not enough space in /tmp to hold the class files, it fails with above error. We want to change the default location for hadoop-unjarxxxxxx directory. We changed the default value of hadoop.tmp.dir in core-site.xml (safety valve) to /ngs/app/${user.name}/hadoop/tmp , but it’s of no help. Any suggestion on how to change the default hadoop-unjar location from /tmp to something else. Regards, Banshi.
... View more
- Tags:
- cdh
- cloudera-manager
Labels:
- Labels:
-
Cloudera Manager
-
MapReduce
08-14-2018
02:18 PM
Hi Herald, Thank you for your response. Yes, we have posted the question in Cloudera Community as well. Now we got the fix for same. We copied the directories (fsimage and index) to the new path. Then, updated the path as Reports Manager Working Directory in Cloudera Manager. Reports manager is running fine now. Regards, Banshi.
... View more
08-08-2018
08:45 AM
Hi, This is related to Cloudera Management Service component , i.e. Cloudera Reports Manager. Regards, Banshi.
... View more
08-03-2018
12:40 PM
Hi, We are getting frequent File System Utilisation alert for a directory. Got to know that it’s caused because of Reports Manager Working Directory.
So, we are planning to change the same. It contains two directories inside, i.e.fsimage and index. Do we need to copy these directories to the new Reports Manager Working Directory? Regards, Banshi.
... View more
- Tags:
- cloudera
06-30-2017
02:05 PM
Please share Hortonworks documentation if any.
... View more
06-30-2017
02:04 PM
Hi, I need the list of Ports for which ACL needs to be opened to enable Distcp between two HDP Clusters? Regards, Banshi.
... View more
Labels:
- Labels:
-
Apache Hadoop
04-06-2017
01:32 PM
Thank you Jay.
... View more
04-06-2017
12:53 PM
Does hortonworks support 2.5.0.3 version of Ambari
... View more
04-06-2017
11:24 AM
Hi All, What is the latest stable ambari version supported by Hortonworks. Regards, Banshi.
... View more
Labels:
- Labels:
-
Apache Ambari