Which version of R is compatible with Spark 2.3.0 & Spark 1.6.3 in HDP 18.104.22.168-292 .
We plan to use SparkR for Spark and Spark2 on Cli as well as RStudio .
I earlier had R 2.3.1 and was getting the below warning
Version mismatch between Spark JVM and SparkR package. JVM version was 22.214.171.124.6.5.0-292 , while R package version was 2.3.1
Hello @tauqeer khan!You can use any R version >= 3.0 https://spark.apache.org/docs/2.3.0/api/R/index.html
Hope this helps.