Created on 08-22-2017 06:07 AM - edited 09-16-2022 05:07 AM
Hello!
Is it possible to run "standalone" Python and R code using Yarn as a resource manager? "Standalone" means native Python or R code, not Spark jobs following by Python->PySpark->Spark or R->SparklyR->Spark execution. We want to use Yarn as a resource allocation service to run Python and R code in allocated by Yarn containers inside cluster node. Obviously, it's not distributed execution, still standalone, but worker node supposed to be allocated by Yarn. CDH 5.10.
Thanks!
Created 09-05-2017 11:59 PM
Created 09-05-2017 11:59 PM