We are running R code on a non edge/gateway node. We are trying to use sparklyr package to connect to the spark remote CDH yarn cluseter. Couldn't connect and create spark context.
Locally we tried to submit spark job and it worked fine. Is it possible to connect from non edge node using sparklyr?