@Sanjib Behera It will be good if you can mark this HCC thread as Answerd by clicking on the "Accept" button on the correct answer that helps others. ... View more

@Sanjib Behera Good to know that previously mentioned suggestion worked. Regarding the " spoutConfig.securityProtoco " config you can refer to the following link to know more about it. Sometimes an incorrect value to this property causes issue, but in your case looks like it is alredy running fine. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_storm-user-guide/content/stormkafka-secure-config.html ... View more

@Jonathan T Instead of shutting down the VM completely i usually do "Save State" because there are many components running inside the VM and it takes some time to get all those services restarted. But it depends on the usecase. If we have some time then sometimes it is better to restart the VM that way it is comparatively bit faster. ... View more

@n c Hadoop DistCp (distributed copy) can be used to copy data between Hadoop clusters (and also within a Hadoop cluster). DistCp uses MapReduce to implement its distribution, error handling, and reporting. It expands a list of files and directories into map tasks, each of which copies a partition of the files specified in the source list. - You can use Falcon to continuously sync Hive tables between clusters. It uses "distcp" under the cover for the data but keeps track of Partitions added etc. Including secure ones being in the same realm makes it easier. Some setup is needed in the configuration to add both clusters to the environment of the one running the "distcp". https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_Sys_Admin_Guides/content/ch_distcp.html Some information if your clusters are HA: http://henning.kropponline.de/2015/03/15/distcp-two-ha-cluster/ And some info on Falcon Hive https://falcon.apache.org/HiveIntegration.html . ... View more

@zkfs Also have you performed the Hive MySQl setup as mentioned in the previously shared doc. like user creation and giving enough permission to the user. Example: Where <HIVEUSER> is the Hive user name, <HIVEPASSWORD> is the Hive user password and <HIVEMETASTOREFQDN> is the Fully Qualified Domain Name of the Hive Metastore host. # mysql -u root -p CREATE USER '<HIVEUSER>'@'localhost' IDENTIFIED BY '<HIVEPASSWORD>'; GRANT ALL PRIVILEGES ON *.* TO '<HIVEUSER>'@'localhost'; CREATE USER '<HIVEUSER>'@'%' IDENTIFIED BY '<HIVEPASSWORD>'; GRANT ALL PRIVILEGES ON *.* TO '<HIVEUSER>'@'%'; CREATE USER '<HIVEUSER>'@'<HIVEMETASTOREFQDN>' IDENTIFIED BY '<HIVEPASSWORD>'; GRANT ALL PRIVILEGES ON *.* TO '<HIVEUSER>'@'<HIVEMETASTOREFQDN>'; FLUSH PRIVILEGES; ... View more