@Boris Demerov I guess we are both data scientists. Storm comes with Python and Ruby. The right place to start is src/storm.thrift. Since Storm topologies are just Thrift structures, and Nimbus is a Thrift daemon, you can create and submit topologies in any language. Here's a specification of the protocol: Multilang protocol. The thrift structure lets you define multilang components explicitly as a program and a script, e.g., python and the file implementing your bolt. Multilang uses json messages over stdin/stdout to communicate with the sub-process. Python supports emitting, anchoring, acking, and logging. Storm "shell" command makes constructing jar and uploading to nimbus easy. Here is a good reference: https://docs.microsoft.com/en-us/azure/hdinsight/storm/apache-storm-develop-python-topology ... View more

@Boris Demerov TensorFlow on HDP will be supported this year. I understood from a conversation with an Hortonworks engineer that running a GPU application like TensorFlow on HDP requires YARN enhancements. They are likely to be included in HDP 3.0, scheduled to be launched at DataWorks conference held in San Jose, June 2018. If you plan to attend DataWorks in Berlin (April 16-19, 2018), the conference schedule includes 4 presentations and one 2-day workshop in Deep Learning. You may get more updates from that conference and Hortonworks folks attending it. ... View more