I am doing one activity in which I have created external table in one cluster say source cluster and created same table in destination table with different hdfs location, Then I have moved hdfs folder of source location (hive data) to destination and then renamed this folder to the destination hive location path , but when I am trying to select data in destination cluster, I am getting below error: FAILED: SemanticException Unable to determine if hdfs://<namenode>:8020/apps/hive/warehouse/test_ext is encrypted: java.lang.IllegalArgumentException: Wrong FS: hdfs://<namenode>:8020/apps/hive/warehouse/test_ext, expected: hdfs://<namenode>:8020 Please find below details on above : 1. created hive table in source cluster: CREATE EXTERNAL TABLE IF NOT EXISTS test_ext (ID int, DEPT int, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION '/poc_hive'; 2.loading data into table : load data local inpath '/tmp/hive_data.txt' into table test_ext; 3. Destination cluster : CREATE EXTERNAL TABLE IF NOT EXISTS test_ext (ID int, DEPT int, NAME string ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE LOCATION '/old_hive'; but here did not load any data . 4. distcp from source to destination hadoop distcp hdfs://<namenode>:8020/poc_hive hdfs://<namenode>:8020/ 5. renamed /poc_hive to /old_hive 6. when I try to fetch data in destination cluster I get error : select *from test_ext; error : FAILED: SemanticException Unable to determine if hdfs://<namenode>:8020/apps/hive/warehouse/test_ext is encrypted: java.lang.IllegalArgumentException: Wrong FS: hdfs://<namenode>:8020/apps/hive/warehouse/test_ext, expected: hdfs://<namenode>:8020 ... View more

I want to check from when hadoop services are up or running . is there some command to check same ? for e.g if there is hbase service i want to check its uptime in other way its last start time . in the same way I want to check for other hadoop services as well. Thanks in advance ... View more

I am trying to integrate Knox with Ldap but i have some doubts on the same .Please help me out . Please find below queries on the same : 1. I can see below property under /etc/knox/conf/topologies/admin.xml file <role>authentication</role> <name>ShiroProvider</name> <enabled>true</enabled> what is shiroProvider , can we customize it ? where does it exist ldap server end or knox ? 2. value of main.ldapRealm.contextFactory.authenticationMechanism is set to Simple and in documentation it is mentioned as well Apache Knox supports only simple authentication. What does it really mean , what is here contextFactory and main.ldapRealm.contextFactory.authenticationMechanism value simple ? what does simple refer to ? 3. urls./** : authcBasic what does it really signify I have gone through below link below but not much understanding , please help me on this . https://developer.ibm.com/hadoop/2016/08/03/ldap-integration-with-apache-knox/ 4. How to deny access to the user which is present already in the main.ldapRealm.userDnTemplate . Thanks in advance ... View more