Created 07-17-2019 12:34 PM
i have created acid orc partition table in hive. By using spark i insert the data to that table . in table pointing location its showing data like
/warehouse/tablespace/managed/hive/testdb.db/table__2/full_date=2019-07-17/delta_0000000_0000000_0000/ 0000_0 .
when i query the table it showing only column names can any one give me a solution
Created 07-18-2019 03:25 AM
You can run Major compaction on the partition in Hive, after the major compaction is done base-**** directory will be created.
Then spark able to read the specific partition which have base-*** directories in it.
But spark not able to read delta directories as there is an open Jira [SPARK-15348] about spark is not able to read acid table.
Created 07-18-2019 03:25 AM
You can run Major compaction on the partition in Hive, after the major compaction is done base-**** directory will be created.
Then spark able to read the specific partition which have base-*** directories in it.
But spark not able to read delta directories as there is an open Jira [SPARK-15348] about spark is not able to read acid table.
Created 07-18-2019 06:13 AM
thank u 4 the info
Created 07-18-2019 04:15 PM
If the answer is helpful to resolve the issue, Login and Click on Accept button below to close this thread.This will help other community users to find answers quickly 🙂
Created 07-18-2019 04:38 PM
@shu
hive warehouse connector support for acid table is available in HDP-3.0 r do i need to upgrade HDP-3.0 to HDP-3.1
Created 07-18-2019 04:39 PM
@Shu hive warehouse connector support for acid table is available in HDP-3.0 r do i need to upgrade HDP-3.0 to HDP-3.1