- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
hiveserver2 not starting using ambari
- Labels:
-
Apache Ambari
-
Apache Hive
Created ‎07-14-2016 03:27 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
I've installed ambari and have everything else running but for some reason, hiveserver2 won't start up.I attempted to run hiveserver2 through the command line and it runs fine. After starting hiveserver2 through Ambari (and failing), I looked into the hiveserver2.log file, the following error appears:
2016-07-13 20:18:23,476 INFO [main]: server.HiveServer2 (HiveServer2.java:startHiveServer2(421)) - Starting HiveServer2 2016-07-13 20:18:24,376 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:newRawStore(599)) - 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 2016-07-13 20:18:24,411 INFO [main]: metastore.ObjectStore (ObjectStore.java:initialize(294)) - ObjectStore, initialize called 2016-07-13 20:18:26,081 INFO [main]: metastore.ObjectStore (ObjectStore.java:getPMF(379)) - Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,Database,Type,FieldSchema,Order" 2016-07-13 20:18:27,790 INFO [main]: metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:<init>(140)) - Using direct SQL, underlying DB is MYSQL 2016-07-13 20:18:27,792 INFO [main]: metastore.ObjectStore (ObjectStore.java:setConf(277)) - Initialized ObjectStore 2016-07-13 20:18:28,072 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:createDefaultRoles_core(673)) - Added admin role in metastore 2016-07-13 20:18:28,074 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:createDefaultRoles_core(682)) - Added public role in metastore 2016-07-13 20:18:28,148 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:addAdminUsers_core(722)) - No user is added in admin role, since config is empty 2016-07-13 20:18:28,587 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(756)) - 0: get_all_databases 2016-07-13 20:18:28,594 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(367)) - ugi=hive ip=unknown-ip-addr cmd=get_all_databases 2016-07-13 20:18:28,676 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(756)) - 0: get_functions: db=default pat=* 2016-07-13 20:18:28,676 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(367)) - ugi=hive ip=unknown-ip-addr cmd=get_functions: db=default pat=* 2016-07-13 20:18:30,024 INFO [main]: session.SessionState (SessionState.java:createPath(633)) - Created local directory: /tmp/8f3ed0f1-2045-4a32-b484-cbe16f3fdd44_resources 2016-07-13 20:18:30,032 INFO [main]: session.SessionState (SessionState.java:createPath(633)) - Created HDFS directory: /tmp/hive/hive/8f3ed0f1-2045-4a32-b484-cbe16f3fdd44 2016-07-13 20:18:30,035 INFO [main]: session.SessionState (SessionState.java:createPath(633)) - Created local directory: /tmp/hive/8f3ed0f1-2045-4a32-b484-cbe16f3fdd44 2016-07-13 20:18:30,038 INFO [main]: session.SessionState (SessionState.java:createPath(633)) - Created HDFS directory: /tmp/hive/hive/8f3ed0f1-2045-4a32-b484-cbe16f3fdd44/_tmp_space.db 2016-07-13 20:18:30,039 INFO [main]: server.HiveServer2 (HiveServer2.java:stop(387)) - Shutting down HiveServer2 2016-07-13 20:18:30,040 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(756)) - 0: Shutting down the object store... 2016-07-13 20:18:30,040 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(367)) - ugi=hive ip=unknown-ip-addr cmd=Shutting down the object store... 2016-07-13 20:18:30,040 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(756)) - 0: Metastore shutdown complete. 2016-07-13 20:18:30,040 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(367)) - ugi=hive ip=unknown-ip-addr cmd=Metastore shutdown complete. 2016-07-13 20:18:30,041 WARN [main]: server.HiveServer2 (HiveServer2.java:startHiveServer2(453)) - Error starting HiveServer2 on attempt 1, will retry in 60 seconds java.lang.RuntimeException: Error applying authorization policy on hive configuration: java.lang.RuntimeException: java.io.IOException: Permission denied at org.apache.hive.service.cli.CLIService.init(CLIService.java:114) at org.apache.hive.service.CompositeService.init(CompositeService.java:59) at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:105) at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:427) at org.apache.hive.service.server.HiveServer2.access$700(HiveServer2.java:79) at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:665) at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:538) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Permission denied at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:127) at org.apache.hive.service.cli.CLIService.init(CLIService.java:112) ... 12 more Caused by: java.lang.RuntimeException: java.io.IOException: Permission denied at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:496) ... 14 more Caused by: java.io.IOException: Permission denied at java.io.UnixFileSystem.createFileExclusively(Native Method) at java.io.File.createNewFile(File.java:1006) at java.io.File.createTempFile(File.java:1989) at org.apache.hadoop.hive.ql.session.SessionState.createTempFile(SessionState.java:820) at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:494) ... 14 more
So based on the log, the startup script being used by ambari is definitely using something it doesn't have access to. But from the log, I can't tell what file/folder/library i need to grant access to the hive user.
Anyone have any ideas?
Created ‎07-14-2016 03:47 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Figured it out. The hive user didn't have write access to /tmp/hive, which i believe was created from a previous installation. Everything works now. yay!
Created ‎07-14-2016 03:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
May I know is Ranger installed in your cluster?
Created ‎07-14-2016 03:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
No, ranger isn't. But authentication is set to none.
Created ‎07-14-2016 03:47 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Figured it out. The hive user didn't have write access to /tmp/hive, which i believe was created from a previous installation. Everything works now. yay!
Created on ‎02-21-2023 08:03 PM - edited ‎02-21-2023 09:36 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Nice,works for me. chown -R hive.hive /tmp/hive
same errors and my hive-tmp dir like this
drwxr-xr-x 3 yarn yarn 19 Feb 15 17:22 hive
Created ‎09-15-2016 04:47 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, Permission denied belongs to you have run the hive server in normal command Prompt. If you run hiveserver and metastore in Administrator Mode CMD Prompt,then this issue will be resolved. Thanks,
