Member since
01-27-2022
9
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2857 | 03-08-2022 08:39 AM |
01-20-2023
08:52 AM
In case of HWC, user query will be processed by HWC API connecting to HS2 server where HS2 will execute query either within HS2 or Tez/LLAP daemons In case of Spark API, spark's framework is used to execute the query by getting necessary metadata about table from HMS Please refer to below articles to know more about HWC https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.0/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html https://community.cloudera.com/t5/Community-Articles/Integrating-Apache-Hive-with-Apache-Spark-Hive-Warehouse/ta-p/249035
... View more
01-03-2023
09:02 AM
@aval Can you please confirm on which version of Cloudera you are currently on ? Basically HWC is required when you want to access Managed tables via Spark. Also use of spark.sql.hive.hwc.execution.mode is deprecated as per CDP 7.1.7 https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/integrating-hive-and-bi/topics/hive-hwc-reader-mode.html
... View more
05-06-2022
04:39 PM
Thanks for that! That's helpful.
... View more