New Contributor
Posts: 5
Registered: ‎11-17-2017

How to run spark2 in Docker container

[ Edited ]

Hey All


Here we are running spark2 on CDH 5.8.3 and we have couple of Docker containers to run spark-submit. and now I got a request from developer that they need running spark2-submit/shell in Docker container. From my understanding, install spark2 only support parcels way, which means we have to install CM firstly, then install CDH and Spark2. And I think is it possible to bypass install cm, directly install CDH and spark2 like rpm package's way?


Anyone has  any idea? Thanks in advance.




New Contributor
Posts: 3
Registered: ‎07-31-2017

Re: How to run spark2 in Docker container

I have the same issue. The best bet is to install apache spark with the same version and try it out.