Member since
09-25-2015
356
Posts
382
Kudos Received
62
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3212 | 11-03-2017 09:16 PM | |
2460 | 10-17-2017 09:48 PM | |
5205 | 09-18-2017 08:33 PM | |
5973 | 08-04-2017 04:14 PM | |
4190 | 05-19-2017 06:53 AM |
03-14-2017
10:35 PM
2 Kudos
Depending on the client the data flow from the query works differently. In case of using Hive CLI, you access the HDFS directly to get the data, and Hive Metastore for table metadata. In case of HiveServer2 client (ex Beeline CLI) all data transmission happens through HiveServer2. HiveServer2 is recommended from security and scalability perspective.
... View more
03-14-2017
04:10 PM
1 Kudo
I am guessing the issue here is that you are not able to read the server config. To run this, ssh into the hive host and run the following: export HIVE_CONF_DIR=/etc/hive/conf/conf.server
hive --service metatool -listFSRoot
... View more
03-14-2017
04:03 PM
1 Kudo
You will need to set the following in the hive-site.xml and restart the HiveServer2. hive.server2.enable.doAs = false
hive.security.authorization.manager = org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory
hive.security.authenticator.manager = org.apache.hadoop.hive.ql.security.SessionStateUserAuthenticator
hive.users.in.admin.role = hive
hive.security.authorization.enabled = true Note that the permissions are enforced in HS2 session only. So, if hive user created some table and did not explicitly give permissions to user mxl then mxl wouldn't be able to operate on it. Example - Login as user hive and in beeline session run the following:
create table test (key string, val int);
- Now login as user mxl and in beeline session run the following:
insert into table test select * from foo;
You will see an error like "Permission denied. name=mxl does not have following privileges. INSERT."
- To explicitly provide permissions, login as user hive in beeline session and run:
grant insert on test to user mxl; Hope this is what you were looking for, not very sure reading your question.
... View more
01-04-2017
04:49 PM
1 Kudo
Above posted data is in Sequence file format. If you are using the HDFS sink, please specify the following on your agent hdfsSink conf: agent.sinks.hdfsSink.hdfs.fileType = DataStream
agent.sinks.hdfsSink.hdfs.writeFormat = Text
... View more
10-28-2016
07:54 PM
1 Kudo
The two properties hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager and hive.support.concurrency = true are set for ACID tables. External tables cannot be ACID tables as the ACID compactor cannot control the data managed by them.
... View more
10-28-2016
07:44 PM
1 Kudo
Can you run a create table in the same session and do a ls on the HDFS directory to see who is the owner of the table directory? One possible explanation of the user mismatch could be the custom user mapping defined in hadoop.security.auth_to_local property in /etc/hadoop/conf/core-site.xml. Can you check that?
... View more
10-24-2016
09:54 PM
Can you post the schema for your table and the query that failed?
... View more
06-27-2016
05:14 PM
Can you post the application logs? You can collect them by running "yarn logs -applicationId <application_Id>"
... View more
06-27-2016
05:09 PM
HiveServer2 instance registers itself to Zookeeper under the /hiveserver2 node.
... View more
06-27-2016
05:25 AM
The attached log shows error registering with the zookeeper. Can you check the zookeeper log if you spot any errors there?
... View more