Integrating Machine Learning Models into Your Big Data Pipelines in Real-Time With No Coding

[#1]

Using Deployed Models as a Function as a Service

Using Cloudera Data Science Workbench with Apache NiFi we can easily call functions within our deployed models from Apache NiFi as part of flows. I am working against CDSW on HDP (https://www.cloudera.com/documentation/data-science-workbench/latest/topics/cdsw_hdp.html), but it will work for all CDSW regardless of install type.

In my simple example, I built a Python model that uses TextBlob to run sentiment against a passed in sentence. It returns Sentiment Polarity and Subjectivity which we can immediately act upon in our flow.

CDSW is extremely easy to work with and I was up and running in a few minutes. For my model, I created a python 3 script and a shell script for install details. Both of these artifacts are available here: https://github.com/tspannhw/nifi-cdsw

My Apache NiFi 1.8 flow is here (I use no custom processors): cdsw-twitter-sentiment.xml

Deploying a Machine Learning Model as a REST Service

Once you login to CDSW and create a project or choose an existing one (https://www.cloudera.com/documentation/data-science-workbench/latest/topics/cdsw_projects.html). From your project, open workbench and you can install some libraries and test some Python. I am using a Python 3 session to download the TextBlob/NLTK Corpora for NLP.

Let's Pip Install some libraries for testing

Let's Create a new Model

You choose your file (mine is sentiment.py see github). The function name is actually sentiment. Notice a typo I had to rebuild this and deploy. You setup an example input (sentence is the input parameter name) and an example output. Input and output will be JSON since this is a REST API.

Let's Deploy It (Python 3)

The deploy will build it for deployment.

We can see standard output, standard error, status, # of REST calls received and success.

Once a Model is Deployed We Can Control It

We can stop it, rebuild it or replace the files if need be. I had to update things a few times. The amount of resources used for the model rest hosting if your choice from a drop down. Since I am doing something small I picked the smallest model with only 1 virtual CPU and 2 GB of RAM. All of this is running in Docker on Kubernetes!

Once Deployed, It's Ready To Test and Use From Apache NiFi

Just click test. See the JSON results and we can now call it from an Apache NiFi flow.

Once Deployed We Can Monitor The Model

Let's Run the Test

See the status and response!

Apache NiFi Example Flow

Step 1: Call Twitter

Step 2: Extract Social Attributes of Interest

Step 3: Build our web call with our access key and function parameter

Step 4: Extract our string as a flow file to send to the HTTP Post

Step 5: Call Our Cloudera Data Science Workbench REST API (see tester).

Step 6: Extract the two result values.

Step 7: Let's route on the sentiment

We can have negative (<0), neutral (0), positive (>0) and very positive (1) polarity of the sentiment. See TextBlob for more information on how this works.

Step 8: Send bad sentiment to a slack channel for human analysis.

We send all the related information to a slack channel including the message.

Example Message Sent to Slack

Step 9: Store all the results (or some) in either Phoenix/HBase, Hive LLAP, Impala, Kudu or HDFS.

Results as Attributes

Slack Message Call
${msg:append(" User:"):append(${user_name}):append(${handle}):append(" Geo:"):append(${coordinates}):append(${geo}):append(${location}):append(${place}):append(" Hashtags:"):append(${hashtags}):append(" Polarity:"):append(${polarity}):append(" Subjectivity:"):append(${subjectivity}):append(" Friends Count:"):append(${friends_count}):append(" Followers Count:"):append(${followers_count}):append(" Retweet Count:"):append(${retweet_count}):append(" Source:"):append(${source}):append(" Time:"):append(${time}):append(" Tweet ID:"):append(${tweet_id})}

REST CALL to Model
{"accessKey":"from your workbench","request":{"sentence":"${msg:replaceAll('\"', ''):replaceAll('\n','')}"}}

Resources

• https://textblob.readthedocs.io/en/dev/api_reference.html#textblob.blob.TextBlob.sentiment
• https://community.hortonworks.com/articles/222605/converting-powerpoint-presentations-into-french-fr...
• https://community.hortonworks.com/articles/76935/using-sentiment-analysis-and-nlp-tools-with-hdp-25....