Reply
Posts: 394
Topics: 11
Kudos: 60
Solutions: 35
Registered: ‎09-02-2016

Re: Cannot select * from tables in hive

Since you update nameservice just now, it may require a restart! not sure... pls query after cluster restart! it may help

Explorer
Posts: 21
Registered: ‎09-11-2014

Re: Cannot select * from tables in hive

I have restarted the cluster and I am still seeing 

select * from nz_test;
Error: Error while compiling statement: FAILED: SemanticException Unable to determine if hdfs://nameservice1/user/hive/warehouse/nz_test is encrypted: java.lang.IllegalArgumentException: Wrong FS: hdfs://nameservice1/user/hive/warehouse/nz_test, expected: hdfs://zeus.corpdom.com:8020 (state=42000,code=40000)

 

I dont understand why the expected result is not changing.

 

THank You

Jamie

Explorer
Posts: 21
Registered: ‎09-11-2014

Re: Cannot select * from tables in hive

Would the HA have anything to do with this? Before it had a master and secondary master and now it has a namenode and secondary name node. I am going to try and set up HA again and see what happens.

 

Thank You

Posts: 394
Topics: 11
Kudos: 60
Solutions: 35
Registered: ‎09-02-2016

Re: Cannot select * from tables in hive

Posts: 394
Topics: 11
Kudos: 60
Solutions: 35
Registered: ‎09-02-2016

Re: Cannot select * from tables in hive

If not aware already, do not get confuse with /apps/hive/warehouse/ 

 

in Cloudera Hive meta store databases are usually created under /user/hive/warehouse where as in Hortonworks distribution it is usually under /apps/hive/warehouse/

 

bottom line of that link is to make sure the Hive Warehouse Directory should be match in all possible areas

Explorer
Posts: 21
Registered: ‎09-11-2014

Re: Cannot select * from tables in hive

I do not have that metatool on the metastore anywhere. Is it installed with Cloudera Manager?

Thank You

Posts: 394
Topics: 11
Kudos: 60
Solutions: 35
Registered: ‎09-02-2016

Re: Cannot select * from tables in hive

 

From your examples, i hope you are getting this issue for almost all the tables....

 

1. Can you try to access the table from Impala?

2. Pls do not forget to execute "invalidate metadata table"

3. Are you getting this issue for only existing tables? Can you create a new table in hive and test it? if new table works, compare the configuration difference between old & new tables

Explorer
Posts: 21
Registered: ‎09-11-2014

Re: Cannot select * from tables in hive

Yes that is correct all tables show same results. 

I can create a new table and the location is set to zeus.corpdom.com and I can view that table fine. It is looking like this is coming from the cluster not in HA anymore. I believe the namespace1 is available only when you have 2 masters. I will be putting this cluster into HA mode tomorrow to try that out. 

I have not tried Impala yet, since I do not have that installed. I can install that as well and try it out.

 

Thank you so much

Jamie

Explorer
Posts: 21
Registered: ‎09-11-2014

Re: Cannot select * from tables in hive

I re-enabled HA and these queries started working again.

Thank You so much

Jamie

Highlighted
Posts: 394
Topics: 11
Kudos: 60
Solutions: 35
Registered: ‎09-02-2016

Re: Cannot select * from tables in hive

@cpuengr happy to hear it is working now!!

Announcements