About banshidhar_saho

banshidhar_saho · ‎11-05-2020

Hi Team, Thank you very much for promptly responding and providing useful solution/direction. While testing, app team reported that child dir/files are having r-x (for dir) and r--(files) for Others. Looks like ACL are not getting inherited to child dir and files. Can you confirm if ACL should inherit to child dir and files or not? Is there any other configuration that I need to check and modify? Regards, Banshi.

banshidhar_saho · ‎11-04-2020

Hi @Shelton, Thank you very much for sharing the exact commands. Only thing that needs to change in the shared commands is - others should be other Here is the command that worked for me. $ hdfs dfs -setfacl -m other::--- /path/to/dir Regards, Banshi.

banshidhar_saho · ‎11-04-2020

Hi @tusharkathpal , Thank you very much. I tested it. It worked for ownership. I want 750 permission on the directory recursively. However it's not reflecting in case of new file. Is there a way to do that? Idea is to restrict 'others' from accessing the file/dir. Regards, Banshi.

banshidhar_saho · ‎11-04-2020

Hi All, In our CDP 7.1.2 cluster, default ownership of any file or directory is <user>and supergroup. One application team wants their data owner group to be their own group in stead of supergroup. for example: Let the app team user is 'abc' and group is 'abc'. Currently owner and group for any file/dir in HDFS is abc:supergroup. They want it to be abc:abc. Please suggest how to achieve this so that any new file created by abc user will have ownership as abc:abc. Regards, Banshi.

banshidhar_saho · ‎09-07-2020

Hi @GangWar, As per CDH package information, Impala 3.2 comes with CDH 6.3.x. Not with CDH 5. Refer below details. ====== CDH 5.x comes with Impala 2.x. https://docs.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_515.html#cm_vd_cdh_package_tarball_515 CDH 6.3.x comes with Impala 3.2. https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_63_packaging.html#concept_rtm_b5p_m3b ====== Can you elaborate how to upgrade impala from 2.11 to 3.2 in CDH 5.14. Regards, Banshi.

banshidhar_saho · ‎09-07-2020

Hi All, Good Afternoon. We have CDH 5.14 and Impala 2.11 in one of our Cloudera cluster. We have a requirement to upgrade Impala to 3.2 in the same cluster. Please suggest us the best way to achieve this. Can we just upgrade Impala without upgrading CDH. Regards, Banshi.

banshidhar_saho · ‎06-22-2020

Here is the error snapshot.

banshidhar_saho · ‎06-22-2020

Hi Team, We have a Cloudera Cluster with OEL6 nodes. Recently we have plan to add 10 OEL7 data nodes to cluster. We installed ClouderaManagerAgent in them using OEL7 repo URL and hosts are listing in ClouderaManager now. While adding them to the cluster, we are getting below error while parcel distribution. Attached error snapshot. "Parcel not available for os distribution RHEL7" Here is the content of " Local Parcel Repository Path " in Cloudera manager server node. ==== root# ls -lrth /ngs/app/cloudera-scm/parcel-repo total 1.8G -rwxr-xr-x 1 cloudera-scm cloudera-scm 73K Sep 6 2018 manifest.json -rwxr-xr-x 1 cloudera-scm cloudera-scm 41 Sep 6 2018 CDH-5.14.4-1.cdh5.14.4.p0.3-el6.parcel.sha -rwxr-xr-x 1 cloudera-scm cloudera-scm 1.8G Sep 6 2018 CDH-5.14.4-1.cdh5.14.4.p0.3-el6.parcel -rw-r----- 1 cloudera-scm cloudera-scm 70K Sep 6 2018 CDH-5.14.4-1.cdh5.14.4.p0.3-el6.parcel.torrent drwxr-x--- 3 root root 4.0K Oct 12 2018 keytrustee-server-6.0.0-parcels -rw-r----- 1 cloudera-scm cloudera-scm 26M Oct 12 2018 KEYTRUSTEE_SERVER-6.0.0-1.keytrustee6.0.0.p0.541004-el6.parcel -rw-r----- 1 cloudera-scm cloudera-scm 41 Oct 12 2018 KEYTRUSTEE_SERVER-6.0.0-1.keytrustee6.0.0.p0.541004-el6.parcel.sha -rw-r----- 1 cloudera-scm cloudera-scm 1.2K Oct 12 2018 KEYTRUSTEE_SERVER-6.0.0-1.keytrustee6.0.0.p0.541004-el6.parcel.torrent root# ==== Can we add OEL7 *.parcel, *.parcel.sha, *.parcel.torrent files in the same " Local Parcel Repository Path "? Please share detailed steps to fix this error. Regards, Banshi.

banshidhar_saho · ‎04-19-2020

Hi Everyone, Can someone give some update or pointer on this. Regards, Banshi.

banshidhar_saho · ‎04-17-2020

Hi Team, Can we enable both Kerberos and LDAP authentication for HiveServer2 at the same time? Secondly, can you share a sample workflow.xml and job.properties for an Oozie job that has a HiveServer2 action where LDAP authentication is enabled for Hiveserver2. Regards, Banshi.

banshidhar_saho · ‎05-02-2019

Hi @bgooley , Thank you for your suggestion. We set the same property and it fixed the issue. Cloudera Manager --> YARN --> searched for: Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hadoop-env.sh and added this: HADOOP_CLIENT_OPTS="-Djava.io.tmpdir=/ngs/app/$(whoami)/hadoop/tmp" Regards, Banshi.

banshidhar_saho · ‎04-30-2019

Hi Team, We are facing an issue where mapreduce jobs are failing with below error. Distribution: Cloudera (CDH 5.14.4) ==== Exception in thread "main" java.io.FileNotFoundException: /tmp/hadoop-unjar5272208588996002870/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore$AsyncClient$revoke_privileges_call.class (No space left on device) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:162) at org.apache.hadoop.util.RunJar.unJar(RunJar.java:110) at org.apache.hadoop.util.RunJar.unJar(RunJar.java:81) at org.apache.hadoop.util.RunJar.run(RunJar.java:214) at org.apache.hadoop.util.RunJar.main(RunJar.java:141) ==== We figured out that MR framework tries to keep temporary class files under /tmp dir with a folder named hadoop-unjarxxxxxx. As there is not enough space in /tmp to hold the class files, it fails with above error. We want to change the default location for hadoop-unjarxxxxxx directory. We changed the default value of hadoop.tmp.dir in core-site.xml (safety valve) to /ngs/app/${user.name}/hadoop/tmp , but it’s of no help. Any suggestion on how to change the default hadoop-unjar location from /tmp to something else. Regards, Banshi.

banshidhar_saho · ‎08-14-2018

Hi Herald, Thank you for your response. Yes, we have posted the question in Cloudera Community as well. Now we got the fix for same. We copied the directories (fsimage and index) to the new path. Then, updated the path as Reports Manager Working Directory in Cloudera Manager. Reports manager is running fine now. Regards, Banshi.

banshidhar_saho · ‎08-08-2018

Hi, This is related to Cloudera Management Service component , i.e. Cloudera Reports Manager. Regards, Banshi.

banshidhar_saho · ‎08-03-2018

Hi, We are getting frequent File System Utilisation alert for a directory. Got to know that it’s caused because of Reports Manager Working Directory. So, we are planning to change the same. It contains two directories inside, i.e.fsimage and index. Do we need to copy these directories to the new Reports Manager Working Directory? Regards, Banshi.

banshidhar_saho · ‎08-03-2018

We are getting frequent FSU alert for a directory. Got to know that it’s caused because of Reports Manager Working Directory. So, we are planning to change the same. It contains two directories inside, i.e. fsimage and index. Do we need to copy these directories to the new Reports Manager Working Directory?

banshidhar_saho · ‎06-30-2017

Please share Hortonworks documentation if any.

banshidhar_saho · ‎06-30-2017

Hi, I need the list of Ports for which ACL needs to be opened to enable Distcp between two HDP Clusters? Regards, Banshi.

banshidhar_saho · ‎04-06-2017

Thank you Jay.

banshidhar_saho · ‎04-06-2017

Does hortonworks support 2.5.0.3 version of Ambari

banshidhar_saho · ‎04-06-2017

Hi All, What is the latest stable ambari version supported by Hortonworks. Regards, Banshi.

Online	Offline
Last Visited	‎01-14-2021 09:57 AM

Date Registered	‎08-03-2018 05:42 AM
Last Visited	‎01-14-2021 09:57 AM
Total Messages Posted	22

Re: Mapreduce job failure due to hadoop-unjarxxxxx...

Re: HDFS file/dir ownership to be <user>:<correspo...

Re: HDFS file/dir ownership to be <user>:<correspo...

Re: HDFS file/dir ownership to be <user>:<correspo...

HDFS file/dir ownership to be <user>:<correspondin...

Re: Upgrade Impala to 3.2 in CDH 5.14

Upgrade Impala to 3.2 in CDH 5.14

Re: Parcel not available for os distribution RHEL7...

Parcel not available for os distribution RHEL7 whi...

Re: HiveServer2 authentication - LDAP and Kerberos

HiveServer2 authentication - LDAP and Kerberos

Re: Mapreduce job failure due to hadoop-unjarxxxxx...

Mapreduce job failure due to hadoop-unjarxxxxxx di...

Re: Reports Manager Working Directory change

Re: Reports Manager Working Directory change

Reports Manager Working Directory change

Reports Manager Working Directory change

Re: What are the HDP ports used in Distcp?

What are the HDP ports used in Distcp?

Re: Latest stable ambari version supported by Hort...

Re: Latest stable ambari version supported by Hort...

Latest stable ambari version supported by Hortonwo...