question Re: No R interpreter in Zeppelin, HDP 2.5 in Archives of Support Questions (Read Only)

No R interpreter in Zeppelin, HDP 2.5

justinkuspa — Mon, 19 Aug 2019 08:33:57 GMT

Version Information:

CentOS release 6.7 (Final)

Ambari 2.4.0.1

HDP 2.5.0.0

Zeppelin 0.6.0.2.5.0.0-1245

R version 3.2.3 is installed on all data nodes.

I followed the below directions to install Zeppelin on data node 01.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/ch_overview.html

When I view the interpreters tab, the following interpreters appear.

- angular - jdbc - livy - markdown - sh - spark

By using the example notebooks, I can see that the %sh, %md, and %pyspark interpreters work, but no %r interpreter exists.

No %r interpreter.

No %sparkr interpreter.

Does the ambari deployed Zeppelin not support R? This says it does. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/using-interp.html

Or is there some hook that only invokes it if it detects a certain version ?

Re: No R interpreter in Zeppelin, HDP 2.5

ldaluz — Wed, 07 Sep 2016 00:08:40 GMT

@justin kuspa

In HDP 2.5, r is provided in Zeppelin via the Livy interpreter.

Try using the following:

%livy.sparkr

Note, you will need to make sure you have R installed on your machine first.

If you haven't already, install it with the following (on all nodes):

yum install R R-devel libcurl-devel openssl-devel

Validate it was installed correctly:

R -e "print(1+1)"

Once it is installed, test out sparkr in Zeppelin with Livy to confirm it is working:

%livy.sparkr
foo <- TRUE
print(foo)

Re: No R interpreter in Zeppelin, HDP 2.5

myoung — Fri, 09 Sep 2016 04:22:23 GMT

@justin kuspa

In addition to what @Laurence Da Luz provided, you can read up on the Zeppelin interpreters here:

https://zeppelin.apache.org/docs/0.6.0/interpreter/livy.html

Re: No R interpreter in Zeppelin, HDP 2.5

justinkuspa — Sat, 10 Sep 2016 00:36:35 GMT

Thanks Laurence, that explains a lot.

R was already on the cluster, and I had to manually configure and start Livy, and then it worked. I expected Ambari to start Livy on the same host that Zeppelin was installed on, but that didn't happen.

This post was very helpful in starting the server.

https://community.hortonworks.com/articles/34424/apache-zeppelin-on-hdp-242.html

Once livy was up and running I was able to run sparkR commands.

Re: No R interpreter in Zeppelin, HDP 2.5

lgeorge — Sat, 10 Sep 2016 01:19:55 GMT

There's also info in our new Zeppelin component guide for HDP 2.5.0,

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_zeppelin-component-guide/content/using-interp.html

Re: No R interpreter in Zeppelin, HDP 2.5

justinkuspa — Sat, 10 Sep 2016 02:09:38 GMT

Correct, that page clearly says the R interpreter is supported 🙂

That doesn't seem to be the case.

Re: No R interpreter in Zeppelin, HDP 2.5

lgeorge — Sun, 11 Sep 2016 06:11:11 GMT

I'll follow up on that and correct or clarify.

Re: No R interpreter in Zeppelin, HDP 2.5

lgeorge — Thu, 22 Sep 2016 02:13:47 GMT

Quick update: the R interpreter has been removed from the list for now. SparkR via Livy remains on the list.

Re: No R interpreter in Zeppelin, HDP 2.5

rick_moritz — Fri, 30 Sep 2016 21:54:47 GMT

Were you able to use the full R interpreter functionality? A quick test showed me that all of the more interesting features are broken, when using livy as an intermediary. Am I missing some step (well, I AM missing some R libraries potentially) or is the vis/rendering aspect broken?

Re: No R interpreter in Zeppelin, HDP 2.5

justinkuspa — Sat, 01 Oct 2016 01:22:16 GMT

I am not an R expert, but I found that much of the ggplot visualization is broken, because it expects it to be rendered locally.

If you run in a yarn-client mode, as we are, ggplot doesn't work.

Re: No R interpreter in Zeppelin, HDP 2.5

justinkuspa — Sat, 01 Oct 2016 01:22:40 GMT

Thanks!

Re: No R interpreter in Zeppelin, HDP 2.5

avijeetd — Tue, 08 Nov 2016 18:06:45 GMT

Hi, @Laurence Da Luz

SparkR works using livy interpreter and sparkR shell.

However is there a way to launch a sparkR job from command prompt something like spark-submit.

Thanks,

Avijeet

Re: No R interpreter in Zeppelin, HDP 2.5

jimmy29304825 — Fri, 11 Nov 2016 15:08:05 GMT

Hi, @Laurence Da Luz

I have some problem

I use

%livy.sparkr

but it tell me that

"Cannot start sparkr."

how can I solve it?

where can I check SparkR has installed?

Re: No R interpreter in Zeppelin, HDP 2.5

michael_boulter — Thu, 22 Dec 2016 23:24:57 GMT

Out of curiosity, why is R/SparkR only provided through Livy in HDP 2.5 as it is provided as standard with the standalone Zeppelin package? Thanks.

Re: No R interpreter in Zeppelin, HDP 2.5

JeffG — Thu, 09 Feb 2017 05:55:02 GMT

Would the following apt-get commands accomplish the same for installing R on Ubunto?:

sudo apt-get update
sudo apt-get install r-base
sudo apt-get install r-base-dev
sudo apt-get install libcurl4-openssl-dev
sudo apt-get install libssl-dev

Re: No R interpreter in Zeppelin, HDP 2.5

mnath — Fri, 23 Feb 2018 04:28:19 GMT

@lgeorge @justin kuspa @Rick Moritz

Any further updates on why the R interpreter was removed in 2016? Will functionality differ from RStudio in terms of running R Code through the Livy interpreter in Zeppelin?