About mrizvi

mrizvi · ‎12-07-2016

@Dmitry Otblesk , you have to use the password for root user. The same password which you used when you did SSH to the terminal.

mrizvi · ‎12-07-2016

@Osoeng Kwon , hdfs and spark user do not have any password. You should run su hdfs and su spark from root user. It would not ask your password then.

mrizvi · ‎12-07-2016

thanks for the reply @jzhang, is there any way to initialize the new sqlContext object with the first one?

mrizvi · ‎12-07-2016

Hi experts, I am using livy sparkr interpreter to do some analysis on airline data. I have registered my SparkR data frame as temporary table which works successfully but when I am running : %sql select * from tableName It shows that table is not found. When I start sparkR, it starts a new application in Yarn and when I do select *, it starts an another application. Have a look at the yarn-applications.png. I am assuming the table got registered in the first sqlContext and I am doing select * from another sqlContext which do no have this table. Is there a way to do both operations in just one application? If this is not possible, then how do I assign the same sqlContext across all applications? Thanks in advance.

mrizvi · ‎12-06-2016

Got it working finally, thanks to @Robert Hryniewicz. Go to interpreter settings page and add the new property under livy settings - livy.spark.jars.packages and the value com.databricks:spark-csv_2.10:1.4.0. Restart the interpreter and retry the query.

mrizvi · ‎12-06-2016

I tried that, but it didn't work

mrizvi · ‎12-05-2016

@jzhang,should I add it in the livy interpreter?

mrizvi · ‎12-03-2016

@Pankaj Panjiar, this looks like a network issue. Can you please restart your VM and retry?

mrizvi · ‎12-01-2016

Please follow the below steps: 1. SSH into Sandbox by typing: ssh root@127.0.0.1 -p2222 2. Download the RStudio rpm package and install it wget https://download2.rstudio.org/rstudio-server-rhel-0.99.893-x86_64.rpm sudo yum install --nogpgcheck rstudio-server-rhel-0.99.893-x86_64.rpm 3. Install dpkg to divert the location of /sbin/initctl. yum install dpkg dpkg-divert --local --rename --add /sbin/initctl ln -s /bin/true /sbin/initctl 4. Install R and then verify the installation of RStudio yum install -y R yum -y install libcurl-devel rstudio-server verify-installation 5. The default port of RStudio server is 8787 which is not opened in the Docker Sandbox. You can either add it by following this tutorial or just edit rserver.conf file to change the port to another which is opened. Let us edit the rserver.conf file, run the following sed command: sed -i "1 a www-port=8090" /etc/rstudio/rserver.conf 6. Restart the server by typing exec /usr/lib/rstudio-server/bin/rserver It will take you out from the docker shell but you can re-login. Go to browser anyway and access RStudio by typing 127.0.0.1:8090. The login page will appear, use user credentials amy_ds/amy_ds.

mrizvi · ‎11-29-2016

@Xavier VAN AUSLOOS, where is the issue? I cannot see any errors. Moreover, if you scroll down, you will see this: Input(s): Successfully read 100 records (1442 bytes) from: "drivermileage" Successfully read 8000 records (24641 bytes) from: "geolocation" Output(s): Successfully stored 99 records (1532 bytes) in: "riskfactor" 2016-11-29 15:48:54,163 [main] INFO org.apache.pig.Main - Pig script completed in 29 seconds and 51 milliseconds (29051 ms) Check your riskfactor table, you should see your data.

Online	Offline
Last Visited	‎08-14-2019 08:03 PM

Member Since	‎05-09-2016 01:14 AM
Last Visited	‎08-14-2019 08:03 PM
Posts	280
Kudos received	58

Cloudera Community

Re: Hive database/table monitoring

Re: Exception while using Spark HBase Connector on...

Re: Like Example.jar is there any sample pig scrip...

Re: I am trying to use sandbox with virtual machin...

Re: Pig on Hortonworks Sandbox In Azure

Re: Password for scp command

Re: su hadf, what's default password?

Re: Getting Table not found Exception in %sql inte...

Getting Table not found Exception in %sql interpre...

Re: Not able to create SparkR dataframe using read...

Re: Not able to create SparkR dataframe using read...

Re: Not able to create SparkR dataframe using read...

Re: Couldn't resolve host 'raw.githubusercontent.c...

Setting up RStudio on Hortonworks Docker Sandbox 2...

Re: I need help with the riskfactor pig script fro...