Created 05-02-2024 05:03 AM
Hello Team,
I am unable to run the import command for Hive, since it is failing with error invalid path.
I copied the table content to another folder and it has permission for hive user, but while running import command it says invalid path. i ran import command on the path where the source table location still it fails with same reason.
Beeline version 3.1.3000.7.1.8.28-1 by Apache Hive
[root@machine1 Log_Files]# sudo -u hive hadoop fs -ls /warehouse/tablespace/managed/hive/demo.db/test1/*
Found 1 items
-rw-r--r-- 3 hive hive 621 2024-05-02 16:05 /warehouse/tablespace/managed/hive/demo.db/test1/delta_0000004_0000004_0000/bucket_00000_0
[root@machine1 Log_Files]# sudo -u hive hadoop fs -ls /jay123/restore_jobid123243/jayesh/*
Found 1 items
drwxr-xr-x - hive hive 0 2024-05-02 16:05 /jay123/restore_jobid123243/jayesh/test1/delta_0000004_0000004_0000
[root@machine1 Log_Files]# sudo -E -u hive beeline -u "jdbc:hive2://machine1.testride.com:2181,machine22.testride.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;;principal=hive/_HOST@hdpcluster.test;" -n hive --showHeader=false --outputformat=tsv2 -e "use demo; show create table test1;"
CREATE TABLE `test1`(
`nm` int)
ROW FORMAT SERDE
'org.apache.hadoop.hive.ql.io.orc.OrcSerde'
STORED AS INPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
LOCATION
'hdfs://machine1.testride.com:8020/warehouse/tablespace/managed/hive/demo.db/test1'
TBLPROPERTIES (
'bucketing_version'='2',
'last_modified_by'='hive',
'last_modified_time'='1713262492',
'transactional'='true',
'transactional_properties'='default',
'transient_lastDdlTime'='1714646145')
17 rows selected (0.329 seconds)
0: jdbc:hive2://machine1.testride.com:2181,machine2.t> use jayesh;import table test1 from '/jay123/restore_jobid123243/jayesh/test1';
INFO : Compiling command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217): use jayesh
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217); Time taken: 0.007 seconds
INFO : Executing command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217): use jayesh
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20240502173023_4e2433fa-dc38-4357-a5be-90892c65a217); Time taken: 0.014 seconds
INFO : OK
No rows affected (0.13 seconds)
Error: Error while compiling statement: FAILED: SemanticException [Error 10027]: Invalid path (state=42000,code=10027)
0: jdbc:hive2://machine1.testride.com:2181,machine2.t> use jayesh;import table test1 from '/warehouse/tablespace/managed/hive/demo.db/test1';
INFO : Compiling command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e): use jayesh
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
INFO : Completed compiling command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e); Time taken: 0.006 seconds
INFO : Executing command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e): use jayesh
INFO : Starting task [Stage-0:DDL] in serial mode
INFO : Completed executing command(queryId=hive_20240502173047_d1f036dc-8722-4fc2-be00-1bafd032971e); Time taken: 0.006 seconds
INFO : OK
No rows affected (0.027 seconds)
Error: Error while compiling statement: FAILED: SemanticException [Error 10027]: Invalid path (state=42000,code=10027)
Can you please help me here to understand what's the issue and how can i resolve this.
Created 05-05-2024 01:09 PM
@jayes Instead of copying the data using hdfs copy command, could you try EXPORT TABLE?
e.g.
EXPORT TABLE test1 to '/jay123/restore_jobid123243/jayesh/'
Then run your IMPORT command.
use jayesh; import table test1 from '/jay123/restore_jobid123243/jayesh/'
Import table command requires metadata along with table data which gets dumped only when you use EXPORT command.
Created 05-05-2024 01:09 PM
@jayes Instead of copying the data using hdfs copy command, could you try EXPORT TABLE?
e.g.
EXPORT TABLE test1 to '/jay123/restore_jobid123243/jayesh/'
Then run your IMPORT command.
use jayesh; import table test1 from '/jay123/restore_jobid123243/jayesh/'
Import table command requires metadata along with table data which gets dumped only when you use EXPORT command.
Created 05-07-2024 03:03 AM
Hello @smruti ,
Thanks for the help.