Running Custom Java Application via Slider

[#1]

Hi all,

I developed a Spring boot Java Application and built into a jar file.We have scalability concerns, so we want to run application on Yarn. How can i deploy custom jar or docker image on YARN via Slider?

Any comment appreciated.

[#2]

You can start from here -

http://slider.incubator.apache.org/

You can jump to Slider application package creation documentation here -

http://slider.incubator.apache.org/docs/slider_specs/index.html

And refer to several apps already in github -

https://github.com/apache/incubator-slider/tree/develop/app-packages

Docker app packages doc is here -

http://slider.incubator.apache.org/docs/slider_specs/application_pkg_docker.html

Note, the Docker app support in current released versions of Slider is in Tech Preview mode. Also, the Docker support is not a first class integration with YARN. However a significant effort is underway for Hadoop 3.0 where Docker is going to be natively supported by YARN and Slider (note, in 3.0 Slider is migrated to be a YARN project). For more details you can refer to these -

https://issues.apache.org/jira/browse/YARN-4692

and the 2 series blog (with more to come) -

https://hortonworks.com/blog/data-lake-3-0-deploy-minutes-cut-tco-half/

https://hortonworks.com/blog/data-lake-3-0-part-2-multi-colored-yarn/

[#3]

Hi @Gour Saha,

Is there any java example?

I mean, can slider run any java application? Can it run my jar? Do I need to convert it to any standard structure or template?

[#4]

@MSertac Turkel most of the applications here (https://github.com/apache/incubator-slider/tree/develop/app-packages) are Java based apps. Of course, most of them have some shell/python scripts to start the apps and those scripts need to be hooked up with the Slider wrapper scripts (which are in python and are pretty simple and straightforward).

Few apps like memcached call the java cmd line directly from the Slider python wrapper -

https://github.com/apache/incubator-slider/blob/develop/app-packages/memcached/package/scripts/memca...