About afm_ryu

afm_ryu · ‎08-02-2018

Thank you for your reply @bkosaraju, but it seems I have no luck with suggested query. I don't see any differences after submit both queries. I just found this (Hive Transactional Tables are not readable by Spark) question. as per JIRA tickets, my situation seems caused by exact same problem that is still exists in latest Spark version. Is there any workarounds to use Hive 3.0 Table (sure, with 'transaction = true', it is mandatory for Hive 3.0 as I know) with Spark? If not, maybe I should rollback to HDP 2.6...

afm_ryu · ‎08-01-2018

Hi Community ! I recently upgraded the HDP version from 2.6.4 to 3.0.0. There were some problems but most of them were resolved, except one important problem. Strangely, when I query 'SELECT' to Hive's tables with SparkQL, It shows no results, just like empty tables, but when I try exact same 'SELECT' query at beeline shell, It works perfectlly. More Strangely, if I query 'SHOW TABLES' or 'SHOW PARTITIONS table_name' with SparkQL, It works perfectlly as I expected. I already spent few days for this problem, but I couldn't find any solutions. also I checked all logs, but I did not see any errors or warnings. Did I misconfigured Spark or Hive something? Has anyone experienced this like problem?

Online	Offline
Last Visited	‎10-03-2019 07:42 AM

Member Since	‎08-01-2018 05:48 PM
Last Visited	‎10-03-2019 07:42 AM
Posts	2
Kudos received	1

Cloudera Community

Cloudera Community

Re: SparkSQL returns empty result when accessing H...

SparkSQL returns empty result when accessing Hive ...