question Re: How to remotely connect to HDP2.4VM with RStudio using R? in Support Questions

How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 01:55:34 GMT

Hi,

I have experience using Hive with Ambari. However, I would like to use Hive on the RDP2.4VM with RStudio using R. Simply put, connecting to the hortonwork vm remotely using R. If a user has done this, can they please tell me here how to do this and also where to find literature online on how to accomplish this if it is documented? I would also appreciate any tips on how to set up the dependencies if this was accomplished using rHive.

Thanks, Heath

Re: How to remotely connect to HDP2.4VM with RStudio using R?

egarelnabi — Thu, 21 Jul 2016 03:39:38 GMT

@Heath Yates

Take a look at the below posting. It lists all the dependencies as well as setup instructions (not all steps will apply to you though).

http://www.rdatamining.com/big-data/r-hadoop-setup-guide

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 04:50:46 GMT

Sure. Will you be around tonight in case I have questions? I'll try this in an hour or two after my commute home and dinner. I actually got RStudio working on the HDP sandbox. Do you think that will make things simpler? At that point things local and hopefully simpler. I do hope to be able to access a Hadoop/hive server remotely eventually, but hope doing things locally will simplify this problem.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

divakarreddy_a — Thu, 21 Jul 2016 05:15:22 GMT

@Heath Yates

link for RStudio Commercial pro Version:

https://www.rstudio.com/products/rstudio/download-commercial/ Pro will work for 45 days without license.

Download Server:

https://www.rstudio.com/products/rstudio/download-server/

Documentation:

https://s3.amazonaws.com/rstudio-server/rstudio-server-pro-0.99.903-admin-guide.pdf

URL for connecting Remotely

http://<SandBox IP:8787/auth-sign-in

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 07:17:55 GMT

Here is a broken tutorial. I think we need the updated HADOOP_HOME and HIVE paths. Can someone please help? See tutorial for details.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 07:53:59 GMT

Going to try HADOOP_HOME and HIVE_HOME paths soon with the tutorial I found. I will let you know if it works. In the meantime, could you please tell me how you found that path information? I am willing to learn and appreciate the time you have taken to reply.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

divakarreddy_a — Thu, 21 Jul 2016 08:29:31 GMT

I installed RStudio on my production environment and handling Since 2 yrs.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 08:30:36 GMT

I am getting the error '/root/RHive/usr/lib/hive/lib does not exist' when I do ant build in the ~/Rhive directory. Please see tutorial here for details. I am stuck on step 4.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 08:32:59 GMT

Just kidding, the error has not resolved. I will mark yours as answer if I can get ant to build Rhive or get Hive working R. 🙂

Re: How to remotely connect to HDP2.4VM with RStudio using R?

divakarreddy_a — Thu, 21 Jul 2016 08:35:05 GMT

Here is the link for RHive

https://github.com/nexr/RHive

Just FYI..RHive & rhdfs both are same.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

divakarreddy_a — Thu, 21 Jul 2016 08:38:48 GMT

sure..If this is what you wanted, please vote the response and accepted it as a best answer.

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 08:42:51 GMT

I still am getting the error for step 4. You mentioned rhdfs and rhive are both the same. Which is newer and which one should I be using in R then? I am just trying to get Hive functionality in my Rscripts. Thanks. 🙂

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 08:48:25 GMT

I think we are close? The error states 'BUILD FAILED' at /root/Rhive/build.xml:39: /root/RHive/usr/hdp/current/hive-server2/lib does not exist'. Shouldn't it be looking in /usr/hdp/current and not in /root/Rhive? Not sure what build.xml is doing. 😞

Re: How to remotely connect to HDP2.4VM with RStudio using R?

divakarreddy_a — Thu, 21 Jul 2016 08:53:51 GMT

you can try tar.gz file from below link if you have an issue with Build.xml

https://cran.r-project.org/src/contrib/Archive/RHive/

R CMD INSTALL RHive_2.0-0.10.tar.gz

Re: How to remotely connect to HDP2.4VM with RStudio using R?

hlyates — Thu, 21 Jul 2016 09:02:05 GMT

I'm not sure if this will fix the problem. I will try, but curios as to why you suggest this? I think this original question I asked here has been resolved, but this ant build problem has merited a separate question and asked it here.