Member since
05-11-2017
11
Posts
0
Kudos Received
0
Solutions
11-01-2017
05:36 AM
We need run Create table and alter table statements to hive from within a spark streaming application. The spark version is 2.1.X and it is HDP 2.6.2. spark.sqlContext.sql("CREATE ...")
spark.sqlContext.sql("ALTER ...") The create statement works but alter fails with Spark error "Operation not allowed". We are stuck and not able to proceed further. Is there any way by which we can run Alter table commands to hive with HDP 2.6.2 from within a spark application. From the SparkSession we cannot get hold of HiveContext hence that approach is also not possible. Any help in this matter is much appreciated.
... View more
Labels:
- Labels:
-
Apache Spark