Hi @Anurag Mishra please accept the answer if it resolved your issue. ... View more

Hi @Anurag Mishra You can use value of 'yarn.resourcemanager.cluster-id' in jobTracker. # grep -A1 'yarn.resourcemanager.cluster-id' /etc/hadoop/conf/* jobTracker=yarn-cluster However, "Failing over to rm2" is just a "INFO" message , that indicates rm1 is Standby. Your issue with oozie spark2 action would be different. ... View more

Hi @Sergey Sheypak You may require hotfix on HDP with OOZIE-2606 OOZIE-2658 OOZIE-2787 OOZIE-2802. Please open a support case. ... View more

Hi @Bijay Deo You may require hotfix on HDP with OOZIE-2606 OOZIE-2658 OOZIE-2787 OOZIE-2802. Please open a support case. ... View more

Hi @Gagandeep Singh Chawla Did the above response help? ... View more

Hi @heta desai, Each service needs to be configured to use LDAP Server for login.(doc links below) Once configured, * For ambari-server, you need to run the following command periodically to sync up users and groups. /usr/sbin/ambari-server sync-ldap --ldap-sync-admin-name=admin --ldap-sync-admin-password=admin --all * For Ranger, user can login once setup for ldap authentication For both services, you need to grant respective privileges to user / groups, on what each can do upon login. Documentation Links: Ambari Server: HORTONWORKS DOCS » APACHE AMBARI 2.6.1.5 » APACHE AMBARI ADMINISTRATION > Chapter 3. Managing Users and Groups > Local and LDAP User and Group Types: Configure Ambari to use LDAP Server https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-security/content/configure_ambari_to_use_ldap_server.html Synchronizing LDAP Users and Groups https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-security/content/synchronizing_ldap_users_and_groups.html Specific Set of Users and Groups https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-security/content/specific_set_of_users_and_groups.html Existing Users and Groups https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-security/content/existing_users_and_groups.html All Users and Groups https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-security/content/all_users_and_groups.html Ranger: HORTONWORKS DOCS » DATA PLATFORM 2.6.4 » SECURITY Chapter 2. Authentication Configuring Ranger Authentication with UNIX, LDAP, or AD https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_security/content/_configuring_ambari_for_ldap_or_active_directory_authentication.html ... View more

Hi @Gagandeep Singh Chawla On Ambari Managed Cluster, Ambari > Oozie > configs > custom oozie-site > oozie.processing.timezone=GMT+0100 Reference: https://community.hortonworks.com/articles/73830/how-to-change-oozie-timezone-from-gmt-to-est.html ... View more

Hi @Swetha Nelwad Appears that you have not yet mapped existing hbase table to a phoenix table. Please follow the following guide to map hbase table in phoenix. https://phoenix.apache.org/faq.html#How_I_map_Phoenix_table_to_an_existing_HBase_table ... View more

Hi @Naveen Y Depending how you have provisioned your cluster, if it is ambari managed, could you please review the following article by @Kuldeep Kulkarni and see if this serves your purpose. https://community.hortonworks.com/articles/34747/ambari-admin-utility.html ... View more

hi @Narasimha K Looks like rmhost2 is in standby. could you please check if the connection to rmhost2 is working without knox. i.e. does the url get auto redirected to Active rmhost2 when you connect against standby RM i.e. rmhost1. Also, can you dump the output when rmhost1 is active resoucemanger. Need to check if curl -ivk -u narasik "http://knoxhost:8443/knox/topology1/resourcemanager/v1/cluster" ... View more

Hi @gsharma please reflect the title How to delete a Phoenix Table (created on Top of Existing Hbase table), Without Dropping HBase Table ... View more

Hi @Priyaranjan Swain Is this Kerberos enabled via Existing MIT KDC or Existing Active Directory? Please check if the principal is locked in your MIT KDC or Active Directory. Also as mention earlier, please check the /etc/krb5.conf for any issues in this file with respect to KDC information. You may try "Regenerating Keytabs" via Ambari-server and see if it helps. ... View more

Hi @Priyaranjan Swain Is this Kerberos enabled via Existing MIT KDC or Existing Active Directory? Please check if the principal is locked in your MIT KDC or Active Directory. Also as mention earlier, please check the /etc/krb5.conf for any issues in this file with respect to KDC information. You may try "Regenerating Keytabs" via Ambari-server and see if it helps. ... View more

Hi @sudi ts Create a "Config Group" under YARN Service. Note, just increasing RAM capacity might not be enough. You may need additional CPUs to handle more jobs / containers. yarn-site.xml yarn.nodemanager.resource.memory-mb yarn.nodemanager.resource.cpu-vcores Add Node Manager Host to this config group Restart Respective Nodemanagers associated to this config group. ... View more

Hi @Priyaranjan Swain Try running following command on host where you have yarn resource Manager "RM" installed. /usr/bin/kinit -kt /etc/security/keytabs/rm.service.keytab rm/ip-192-168-0-50.eu-west-1.compute.internal@TECHNIPFMC.COM; If this does not return the following error, then try restarting service again via Ambari. returned 1. kinit: Preauthentication failed while getting initial credentials If returns above error, check the /etc/krb5.conf to check for any issues here. or in case of KDC Load balancer, see if the principals are replicated across all servers serving under this KDC. [realms] TECHNIPFMC.COM = { admin_server = <FQDN> kdc = <FQDN> } ... View more

Hi @Pooja Kamle following error indicates that hbase user does not have correct permissions. Looks like you have ranger enabled. Can you please check if you have correct privileges for hbase user. ERROR [RS_OPEN_PRIORITY_REGION-hostname:16020-1] handler.OpenRegionHandler: Failed open of region=hbase:namespace,,1508913064554.16ee288e7e2f92b959283a91a2205c93., starting to roll back the global memstore size. org.apache.hadoop.hbase.security.AccessDeniedException: Insufficient permissions for user 'hbase/principal' (action=admin Also make sure following property is set correctly: Ambari Web UI > hbase > config > Advanced hbase-site >hbase.superuser=hbase For Ranger Policy: Sample Screenshot ... View more

Is this ORC data? For Application Master to run, you can set the following property and then run the query. This should reduce the memory pressure on AM, trying to figure out how many mappers , going through all hdfs files. set hive.exec.orc.split.strategy=BI; How many partitions would you have in total for 14TB data? Notes: hive.exec.orc.split.strategy Default Value: HYBRID Added In: Hive 1.2.0 with HIVE-10114 What strategy ORC should use to create splits for execution. The available options are "BI", "ETL" and "HYBRID".<br> The HYBRID mode reads the footers for all files if there are fewer files than expected mapper count, switching over to generating 1 split per file if the average file sizes are smaller than the default HDFS blocksize. ETL strategy always reads the ORC footers before generating splits, while the BI strategy generates per-file splits fast without reading any data from HDFS. Other Article on how mappers are determined: https://community.hortonworks.com/questions/905/how-are-number-of-mappers-determined-for-a-query-w.html ... View more