- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Getting erro in hive.
- Labels:
-
Apache Hive
Created ‎08-28-2017 07:43 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am using HDP 2.5.
Getting following error while running select * from query with different user. like test user.
Error:- See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. Aug 28, 2017 7:40:44 AM WARNING: org.apache.parquet.CorruptStatistics: Ignoring statistics because created_by could not be parsed (see PARQUET-251): parquet-mr (build 32c46643845ea8a705c35d4ec8fc654cc8ff816d) org.apache.parquet.VersionParser$VersionParseException: Could not parse created_by: parquet-mr (build 32c46643845ea8a705c35d4ec8fc654cc8ff816d) using format: (.+) version ((.*) )?\(build ?(.*)\)
Created ‎09-13-2017 05:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Issue was with permission of folder. I have provided appropriate permission to /tmp/ and /apps/hive folder.
Created ‎08-28-2017 08:00 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The underlying reason for this seems to that this file was written using different version of parquet-hadoop and trying to read with another version.
Look out for the hive version run the below command
# locate parquet-hadoop
Please upgrade the parquet version being used and retry
Created ‎08-28-2017 08:09 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Please check if you have the "parquet-logging.properties" file present inside the "/etc/hive/conf/" directory or not?
If not then please copy that file "parquet-logging.properties" from hive2 conf directory to "/etc/hive/conf/" directory and then try again. That file might be missing there due to : https://issues.apache.org/jira/browse/AMBARI-21265
Created ‎08-28-2017 09:11 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
File is there.
@ Geoffrey
version is updated only /usr/hdp/2.5.6.0-40/hive/lib/parquet-hadoop-bundle-1.8.1.jar.
is there any soultion.
Created ‎08-28-2017 09:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is that file also available inside the "/etc/hive/conf" as well as inside "/etc/hive/conf/conf.server" ?
Also as we see that it is a WARNING message so we can suppress it as well.
Or else can you please share the complete stackTrace so that we can see the complete trace to find out the APIs involved in this WARN.
Created ‎08-28-2017 11:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
File is there on both path.
Created ‎08-28-2017 10:12 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
The writing and reading should use the same version of parquet-hadoop.Use the newer version of parquet-hadoop for writing parquet files Also check the permission on the parquet-0.log.lock
Created ‎08-28-2017 11:15 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Could you please help me with link? And I able to run with root and hie user without any error or warning. Getting error while running with different user.
Created ‎09-04-2017 08:55 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Can you check the value for hive.server2.enable.doAs in Hive-->Configs-->settings and filter hive.server2.enable.doAs
Do you have a Ranger default policy configured for hive user ?
Created ‎09-13-2017 05:58 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Issue was with permission of folder. I have provided appropriate permission to /tmp/ and /apps/hive folder.
