@Sarnath K Your cluster definition might be wrong. What's your HDP version? You can try it with HDP 2.5.3. Create cluster definition using falcon gui and try. ... View more

@Niraj Parmar follow this document to run different user. https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.1/bk_dataflow-security/content/secure-storm-ui.html ... View more

@Sandeep Gade Did you follow this link https://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.1/bk_dataflow-security/content/secure-storm-ui.html ... View more

Hi @Vishakha Agarwal Use this link below for windows. https://community.hortonworks.com/articles/28537/user-authentication-from-windows-workstation-to-hd.html ... View more

@Vishal Gupta Ranger cannot authenticate the users. It's for authorization. Delete local users in Ranger to block users. ... View more

It's a Tez issue. Update the below parameters in tez-site and hive-site. It might resolve your issue. Tez-site.xml: <name>tez.am.launch.cmd-opts</name> <value>-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC</value <name>tez.task.launch.cmd-opts</name> <value>-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC</value> Hive-site.xm: <name>hive.tez.java.opts</name> <value>-server -Djava.net.preferIPv4Stack=true -XX:NewRatio=8 -XX:+UseNUMA -XX:+UseParallelGC -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps</value> ... View more

Restart Spark, Livy , Zeppelin servers and interpreters. It worked for me. Ram Baskaran ... View more

Hi @Pardeep I had a same issue. The problem is /etc/krb5.conf file. Just match it with https://community.hortonworks.com/articles/59635/one-way-trust-mit-kdc-to-active-directory.html ... View more

you need to create directory /apps/falcon/extensions/hdfs-mirroring. Verify the link https://community.hortonworks.com/articles/55382/hive-disaster-recovery-using-falcon.html ... View more

Remove the falcon service and reinstall it with ambari. ... View more

Falcon requires hive bootstrapping export method. hive -e “EXPORT TABLE TABLE_NAME TO ‘hdfs://BACKUP_CLUSTER:8020/hiveimport/' FOR replication('bootstrapping’)” ... View more

It will work when you use the correct hive bootstrapping method. The correct way to replicate any hive table is hive -e “EXPORT TABLE TABLE_NAME TO ‘hdfs://BACKUP_CLUSTER:8020/hiveimport/' FOR replication('bootstrapping’)” ... View more

Use Falcon Cli to kill any running process. To find the status: falcon instance -type process -name NAME_OF_YOUR_PROCESS -status To kill the process : falcon instance -type process -name NAME_OF_YOUR_PROCESS -kill https://falcon.apache.org/FalconCLI.html ... View more

Use this link to connect kerberos hive in JDBC. ... View more

In order to distcp between two HDFS HA cluster (for example A and B), modify the following in the hdfs-site.xml for both clusters: For example, nameservice for cluster A and B is HAA and HAB respectively. - Add value to the nameservice for both clusters dfs.nameservices = HAA, HAB - Add property dfs.internal.nameservices In cluster A: dfs.internal.nameservices = HAA In cluster B: dfs.internal.nameservices = HAB - Add dfs.ha.namenodes.<nameservice> In cluster A dfs.ha.namenodes.HAB = nn1,nn2 In cluster B dfs.ha.namenodes.HAA = nn1,nn2 - Add property dfs.namenode.rpc-address.<cluster>.<nn> In cluster A dfs.namenode.rpc-address.HAB.nn1 = <NN1_fqdn>:8020 dfs.namenode.rpc-address.HAB.nn2 = <NN2_fqdn>:8020 In cluster B dfs.namenode.rpc-address.HAA.nn1 = <NN1_fqdn>:8020 dfs.namenode.rpc-address.HAA.nn2 = <NN2_fqdn>:8020 - Add property dfs.client.failover.proxy.provider.<cluster - i.e HAA or HAB> In cluster A dfs.client.failover.proxy.provider.HAB = org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider In cluster B dfs.client.failover.proxy.provider.HAA = org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider - Restart HDFS service. Once complete you will be able to run the distcp command using the nameservice ... View more