Cloudera Community
afm_ryu
user rank
New Contributor

Re: SparkSQL returns empty result when accessing H...

by New Contributor in Support Questions
‎08-02-2018 04:59 AM
‎08-02-2018 04:59 AM
Thank you for your reply @bkosaraju, but it seems I have no luck with suggested query. I don't see any differences after submit both queries. I just found this (Hive Transactional Tables are not readable by Spark) question. as per JIRA tickets, my situation seems caused by exact same problem that is still exists in latest Spark version. Is there any workarounds to use Hive 3.0 Table (sure, with 'transaction = true', it is mandatory for Hive 3.0 as I know) with Spark? If not, maybe I should rollback to HDP 2.6... ... View more

SparkSQL returns empty result when accessing Hive ...

by New Contributor in Support Questions
‎08-01-2018 06:32 PM
1 Kudo
‎08-01-2018 06:32 PM
1 Kudo
Hi Community ! I recently upgraded the HDP version from 2.6.4 to 3.0.0. There were some problems but most of them were resolved, except one important problem. Strangely, when I query 'SELECT' to Hive's tables with SparkQL, It shows no results, just like empty tables, but when I try exact same 'SELECT' query at beeline shell, It works perfectlly. More Strangely, if I query 'SHOW TABLES' or 'SHOW PARTITIONS table_name' with SparkQL, It works perfectlly as I expected. I already spent few days for this problem, but I couldn't find any solutions. also I checked all logs, but I did not see any errors or warnings. Did I misconfigured Spark or Hive something? Has anyone experienced this like problem? ... View more
Contact Me
Online
Offline
Last Visited
‎10-03-2019 07:42 AM
Community Statistics
Member Since ‎08-01-2018 05:48 PM
Last Visited ‎10-03-2019 07:42 AM
Posts 2
Kudos received 1