Created 07-21-2023 02:25 AM
Hello
I want to set up a local environment of Hive with Iceberg similar to my working environment - CDP public cloud 7.2.15 so I can test locally.
The problem is that on my local environment insert into iceberg tables (via Hive) does not work with Tez execution engine (works only with MapReduce). And according to the Iceberg documentation it should not work with Tez for Hive 3. But the thing is that it does work on CDP - I am able to insert data into Iceberg tables with Tez on Hive 3.
Is there a way to make it work locally? Thank you
Here is my local config:
Hadoop: 3.2.1
Hive: 3.1.3 (on CDP 3.1.3000.2023.0.14.0-155 is used)
Iceberg-hive-runtime: 0.13.1.7.2.15.0-147 (the same version is used on CDP)
Tez: 0.9.1.7.2.15.0-147 (the same version is used on CDP)
Created 07-21-2023 03:14 AM
Hi,
You can try to use CDP public cloud 7.2.17 which officially supports iceberg on Hive.
https://docs.cloudera.com/runtime/7.2.17/iceberg-overview/topics/iceberg-overview.html
Created 07-23-2023 07:20 PM
Hello @BennyZ
Thanks for reply. I can use Iceberg on 7.2.15 as well.
My question was how come that insert into iceberg tables works on Tez execution engine when according to the documentation it should not (only with MapReduce)?