Not Able to run import command. it fails with invalid path

jayes — Thu, 02 May 2024 12:03:22 GMT

Hello Team,

I am unable to run the import command for Hive, since it is failing with error invalid path.
I copied the table content to another folder and it has permission for hive user, but while running import command it says invalid path. i ran import command on the path where the source table location still it fails with same reason.

Beeline version 3.1.3000.7.1.8.28-1 by Apache Hive

[root@machine1 Log_Files]# sudo -u hive hadoop fs -ls /warehouse/tablespace/managed/hive/demo.db/test1/*
Found 1 items
-rw-r--r-- 3 hive hive 621 2024-05-02 16:05 /warehouse/tablespace/managed/hive/demo.db/test1/delta_0000004_0000004_0000/bucket_00000_0

[root@machine1 Log_Files]# sudo -u hive hadoop fs -ls /jay123/restore_jobid123243/jayesh/*
Found 1 items
drwxr-xr-x - hive hive 0 2024-05-02 16:05 /jay123/restore_jobid123243/jayesh/test1/delta_0000004_0000004_0000

[root@machine1 Log_Files]# sudo -E -u hive beeline -u "jdbc:hive2://machine1.testride.com:2181,machine22.testride.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;;principal=hive/_HOST@hdpcluster.test;" -n hive --showHeader=false --outputformat=tsv2 -e "use demo; show create table test1;"

CREATE TABLE `test1`(
`nm` int)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.orc.OrcSerde'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
LOCATION
'hdfs://machine1.testride.com:8020/warehouse/tablespace/managed/hive/demo.db/test1'
TBLPROPERTIES (
'bucketing_version'='2',
'last_modified_by'='hive',
'last_modified_time'='1713262492',
'transactional'='true',
'transactional_properties'='default',
'transient_lastDdlTime'='1714646145')
17 rows selected (0.329 seconds)

0: jdbc:hive2://machine1.testride.com:2181,machine2.t> use jayesh;import table test1 from '/jay123/restore_jobid123243/jayesh/test1';
INFO : Compiling command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217): use jayesh
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217); Time taken: 0.007 seconds
INFO : Executing command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217): use jayesh
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217); Time taken: 0.014 seconds
INFO : OK
No rows affected (0.13 seconds)
Error: Error while compiling statement: FAILED: SemanticException [Error 10027]: Invalid path (state=42000,code=10027)

0: jdbc:hive2://machine1.testride.com:2181,machine2.t> use jayesh;import table test1 from '/warehouse/tablespace/managed/hive/demo.db/test1';
INFO : Compiling command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e): use jayesh
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e); Time taken: 0.006 seconds
INFO : Executing command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e): use jayesh
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e); Time taken: 0.006 seconds
INFO : OK
No rows affected (0.027 seconds)
Error: Error while compiling statement: FAILED: SemanticException [Error 10027]: Invalid path (state=42000,code=10027)

Can you please help me here to understand what's the issue and how can i resolve this.

Re: Not Able to run import command. it fails with invalid path

smruti — Sun, 05 May 2024 20:09:52 GMT

@jayes Instead of copying the data using hdfs copy command, could you try EXPORT TABLE?

e.g.

EXPORT TABLE test1 to '/jay123/restore_jobid123243/jayesh/'

Then run your IMPORT command.

use jayesh; import table test1 from '/jay123/restore_jobid123243/jayesh/'

Import table command requires metadata along with table data which gets dumped only when you use EXPORT command.

Re: Not Able to run import command. it fails with invalid path

jayes — Tue, 07 May 2024 10:03:18 GMT

Hello @smruti ,

Thanks for the help.

question Not Able to run import command. it fails with invalid path in Support Questions

Not Able to run import command. it fails with invalid path

Re: Not Able to run import command. it fails with invalid path

Re: Not Able to run import command. it fails with invalid path