Hive Pre Upgrade tool command fails after not able to access HDFS
The command is not able to find the right configuration of hadoop core components, primarily due to unavailability of hadoop core component configuration files in the command.
There are different ways to export the hadoop core configuration, one of them is below.
1. Follow the below HWX document to make sure you have properly followed the steps. (Check appropriate link for your version)
2. Follow till "Procedure for compacting Hive tables (no Kerberos)" step 3 and before running the pre-upgrade tool command, export hadoop and hive env files
3. Now while running the pre-upgrade tool command, include two more paths in the command (/etc/hadoop/conf:/etc/hive/conf).
So the command below similar to below.
java -Djavax.security.auth.useSubjectCredsOnly=false (optional) -cp /etc/hadoop/conf:/etc/hive/conf:/usr/hdp/$STACK_VERSION/hive/lib/derby-10.10.2.0.jar:
hadoop/etc/hadoop/*:/tmp/hive-pre-upgrade-<your version>.jar:/usr/hdp/$STACK_VERSION/hive/conf/conf.server org.apache.hadoop.hive.upgrade.acid.PreUpgradeTool