Thanks for the update. Do we have any changes regarding External or internal tables? Any limitations for no.of rows/partitions or code/syntax changes ... View more

Thanks for the update. Do we have any changes regarding External or internal tables? Any limitations for no.of rows/partitions or code/syntax changes ... View more

Thanks for the update. One more thing need clarification. While looking into the Spark unsupported features in CDP private cloud, i can see below statement  "Using the JDBC Datasource API to access Hive or Impala is not supported" Can you please explain this? If JDBC datasource is not supported, can't we access hive? Is this true? Is there any fix for this. Appreciate your quick response.   ... View more

Thanks for the update. Is there any changes in sizing and memory for spark 2.4? ... View more

Hi    As mentioned below, Spark 2.3 -> 2.4 version changes have higher potential of risks. May i know what are the those risks. It would be more helpful if you share right link for these and also share what the considerations need to be taken while upgrading form spark 1.6 to 2.4 and spark 2.3 to spark 2.4   Thanks Rajesh ... View more