Community Articles

Find and share helpful community-sourced technical articles.
Labels (1)

Hive Pre Upgrade tool command fails after not able to access HDFS

The command is not able to find the right configuration of hadoop core components, primarily due to unavailability of hadoop core component configuration files in the command.

Resolution steps

There are different ways to export the hadoop core configuration, one of them is below.

1. Follow the below HWX document to make sure you have properly followed the steps. (Check appropriate link for your version) 

2. Follow till "Procedure for compacting Hive tables (no Kerberos)" step 3 and before running the pre-upgrade tool command, export hadoop and hive env files

source /etc/hadoop/conf/ 
source /etc/hive/conf/ 

3. Now while running the pre-upgrade tool command, include two more paths in the command (/etc/hadoop/conf:/etc/hive/conf). So the command below similar to below.

java (optional) -cp /etc/hadoop/conf:/etc/hive/conf:/usr/hdp/$STACK_VERSION/hive/lib/derby-
hadoop/etc/hadoop/*:/tmp/hive-pre-upgrade-<your version>.jar:/usr/hdp/$STACK_VERSION/hive/conf/conf.server org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool
0 Kudos
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.
Version history
Last update:
‎02-01-2019 07:26 PM
Updated by:
Top Kudoed Authors