Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Not Able to run import command. it fails with invalid path

avatar
Contributor

Hello Team,

I am unable to run the import command for Hive, since it is failing with error invalid path.
I copied the table content to another folder and it has permission for hive user, but while running import command it says invalid path. i ran import command on the path where the source table location still it fails with same reason.

Beeline version 3.1.3000.7.1.8.28-1 by Apache Hive


[root@machine1 Log_Files]# sudo -u hive hadoop fs -ls /warehouse/tablespace/managed/hive/demo.db/test1/*
Found 1 items
-rw-r--r-- 3 hive hive 621 2024-05-02 16:05 /warehouse/tablespace/managed/hive/demo.db/test1/delta_0000004_0000004_0000/bucket_00000_0


[root@machine1 Log_Files]# sudo -u hive hadoop fs -ls /jay123/restore_jobid123243/jayesh/*
Found 1 items
drwxr-xr-x - hive hive 0 2024-05-02 16:05 /jay123/restore_jobid123243/jayesh/test1/delta_0000004_0000004_0000

[root@machine1 Log_Files]# sudo -E -u hive beeline -u "jdbc:hive2://machine1.testride.com:2181,machine22.testride.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;;principal=hive/_HOST@hdpcluster.test;" -n hive --showHeader=false --outputformat=tsv2 -e "use demo; show create table test1;"


CREATE TABLE `test1`(
`nm` int)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.orc.OrcSerde'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
LOCATION
'hdfs://machine1.testride.com:8020/warehouse/tablespace/managed/hive/demo.db/test1'
TBLPROPERTIES (
'bucketing_version'='2',
'last_modified_by'='hive',
'last_modified_time'='1713262492',
'transactional'='true',
'transactional_properties'='default',
'transient_lastDdlTime'='1714646145')
17 rows selected (0.329 seconds)

0: jdbc:hive2://machine1.testride.com:2181,machine2.t> use jayesh;import table test1 from '/jay123/restore_jobid123243/jayesh/test1';
INFO : Compiling command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217): use jayesh
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217); Time taken: 0.007 seconds
INFO : Executing command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217): use jayesh
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217); Time taken: 0.014 seconds
INFO : OK
No rows affected (0.13 seconds)
Error: Error while compiling statement: FAILED: SemanticException [Error 10027]: Invalid path (state=42000,code=10027)

 


0: jdbc:hive2://machine1.testride.com:2181,machine2.t> use jayesh;import table test1 from '/warehouse/tablespace/managed/hive/demo.db/test1';
INFO : Compiling command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e): use jayesh
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e); Time taken: 0.006 seconds
INFO : Executing command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e): use jayesh
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e); Time taken: 0.006 seconds
INFO : OK
No rows affected (0.027 seconds)
Error: Error while compiling statement: FAILED: SemanticException [Error 10027]: Invalid path (state=42000,code=10027)

Can you please help me here to understand what's the issue and how can i resolve this.

 

1 ACCEPTED SOLUTION

avatar
Master Collaborator

@jayes  Instead of copying the data using hdfs copy command, could you try EXPORT TABLE?

e.g.

EXPORT TABLE test1 to '/jay123/restore_jobid123243/jayesh/'

Then run your IMPORT command.

use jayesh; import table test1 from '/jay123/restore_jobid123243/jayesh/'

Import table command requires metadata along with table data which gets dumped only when you use EXPORT command.

View solution in original post

2 REPLIES 2

avatar
Master Collaborator

@jayes  Instead of copying the data using hdfs copy command, could you try EXPORT TABLE?

e.g.

EXPORT TABLE test1 to '/jay123/restore_jobid123243/jayesh/'

Then run your IMPORT command.

use jayesh; import table test1 from '/jay123/restore_jobid123243/jayesh/'

Import table command requires metadata along with table data which gets dumped only when you use EXPORT command.

avatar
Contributor

Hello @smruti ,


Thanks for the help.