Thanks for the reply @vafs ; I can't be sure that was the definite answer though, because it is combining answers from two different sources: - first one is about supporting spark (nothing about gpu mentioned). - second one is about gpu (nothing about spark mentioned). And when I tried a Spark code that works in YARN+GPU, with slight modification to fit into CML, it just didnt go well. Not sure if I've done something wrong, that's why I am looking for a definite answer, probably with some github example like what Cloudera have provided for pytorch and tensorflow for CML. Hence, me raising this question. Somehow, I kind of remembering seeing somewhere that in CDE, it is only Technical Preview, but in CML it is not yet; but can't seem to be able to find where was that page :).
... View more
