About syedshakir

willx · ‎08-02-2022

Hello @syedshakir , Please let us know what is your cdh version? Case A: If I'm understanding correctly you have a kerberized cluster and the file is at local not on hdfs, so you don't need kerberos authentication. Just refer to below google docs, there are a few ways to do it: https://cloud.google.com/storage/docs/uploading-objects#upload-object-cli Case B: To be honest I never did it so I would try: 1. follow the below document to configure google cloud storage with hadoop: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/admin_gcs_config.html 2. if distcp cannot work then follow this document to configure some properties: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cdh_admin_distcp_secure_insecure.html 3. save the whole output of distcp then upload to here, I can help you to check. Remember to remove the sensitive information (such as hostname, ip) from the logs then you can upload. If the distcp output doesn't contain kerberos related errors then you can enable debug logs then re-run the distcp job and save the new output with debug logs: export HADOOP_ROOT_LOGGER=hadoop.root.logger=Debug,console;export HADOOP_OPTS="-Dsun.security.krb5.debug=true" Thanks, Will

syedshakir · ‎07-14-2022

Hi Vidya , Issue has been resolved by setting path : export PATH=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin:/usr/bin/python2:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/anaconda3/bin:/opt/anaconda3/condabin

paras · ‎01-20-2022

@syedshakir Refer below link for the transition steps for Navigator https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-cdh/topics/atlas-migrating-from-navigator-overview.html When you decide you have exhausted the value of the Navigator audits and after you've converted Navigator metadata to Atlas content, you can disable Navigator servers by simply stopping the service, delete the Navigator service and remove the navigator metadata storage directory. Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

syedshakir · ‎01-05-2022

Hi Mszurap , thanks for the reply . Impala query profile? --showing same error its not a dynamic partitioning and there is only one insert operation mentioned in query. CM > Impala > Queries page-- showing same error no multiple inserts Thanks, Syed

Scharan · ‎12-13-2021

@syedshakir I see "rcmprod" user doesn't have permission to access the interpreter page To provide access to interpreter page, comment/delete below line[1] from shiro configuration url section or configure roles as mentioned in doc[2] [1]: /api/interpreter/** = authc, roles[admin] [2]: https://zeppelin.apache.org/docs/0.6.2/security/shiroauthentication.html#active-directory

VidyaSargur · ‎08-30-2021

Thanks for the confirmation @syedshakir. Much appreciated.

GangWar · ‎12-28-2020

@syedshakir This is most probably ssh is not setup properly. You can try below steps. On the Oozie Server host run the command: ps -ef| grep oozie Identify the user that runs the Oozie server. For example, the user is oozie Modify /etc/passwd file to edit the user oozie Change: oozie:x:485:483:Oozie User:/var/lib/oozie:/bin/false to: oozie:x:485:483:Oozie User:/var/lib/oozie:/bin/bash Note: This will enable the user oozie to login. In the command prompt switch user as oozie: su - oozie Verify that the user is switched by executing the command: id Execute ssh-keygen: Note:Do not give any password. This generates Public and Private Key for passwordless authentication and saves it in the Oozie user's home directory. ssh-keygen Execute ssh-copy-id to copy the public key to user’s home directory in the remote host. This user will be the one that runs ssh commands in remote host: ssh-copy-id -i /home/oozie/.ssh/id_rsa.pub cloudera@example.local.com Test by executing ssh without a password to confirm a successful authentication: ssh cloudera@example.local.com Run the Oozie workflow and verify success.

tusharkathpal · ‎10-06-2020

Hello @syedshakir Are you inserting data into the table externally of Impala (that is via hive, sqoop, spark etc). If yes, the Impala may not be aware of the newly added files and running invalidate metadata/refresh on the table may fix your issue.

paras · ‎06-25-2020

@syedshakir For existing DB, stop the hue service and alter the DB using below query: ALTER DATABASE hue CHARACTER SET utf8 ; ALTER DATABASE hue COLLATE = 'utf8_general_ci'; Start the hue service. Hope this helps, Paras Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

lwang · ‎03-26-2020

Hi @syedshakir , Thanks for your update. Could you please clarify if you are talking about a new issue here? The original issue is not able to access oozie workflow from my documents and got 402 error message. And the latest update you mentioned about users not able to kill jobs. If the original issue got resolved, please close this thread and I would suggest you opening a new thread to explain what is the new issue and give some error message and screenshots will help. Thanks, Li

Online	Offline
Last Visited	‎10-17-2022 06:55 AM

Member Since	‎09-30-2019 11:47 PM
Last Visited	‎10-17-2022 06:55 AM
Posts	27
Kudos received	1

Cloudera Community

Re: Impala shell error

Re: You can't execute queries until the end of the...

Re: Copy HDFS data to GCP

Re: Impala shell error

Re: Steps to remove/clean up Navigator

Re: Loading Error

Re: zeppline interpreter unable to change

Re: You can't execute queries until the end of the...

Re: oozie job getting suspended

Re: Failed to open HDFS file

Re: How to resolve hue configuration

Re: oozie workflow issue 402